00000001:02000400:2.0F:1788573901.498645:0:3293:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg451-server.virtnet: executing set_hostid 00000001:02000400:1.0F:1788573911.665856:0:3495:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg451-server.virtnet: executing load_modules_local 00000001:01000000:3.0F:1788573913.531662:0:3557:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 375 MB/s 00000001:01000000:1.0:1788573913.783304:0:3557:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 563 MB/s 00000001:01000000:3.0:1788573914.038416:0:3557:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 2066 MB/s 00000020:02000000:2.0:1788573914.759532:0:3586:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_3_g4a08d7b 00000400:02000000:0.0F:1788573915.660887:0:3601:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.204.151@tcp [8/256/0/180] 00008000:02000000:2.0:1788573919.079578:0:3751:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0:1788573982.310106:0:5719:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg451-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1788573995.547591:0:6469:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788573995.547596:0:6469:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1788573995.547598:0:6469:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1788573995.547758:0:6469:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000000a8314d3 00000080:02000400:1.0:1788573995.547768:0:6469:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:1.0:1788573995.562842:0:6469:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:1.0:1788573995.562855:0:6469:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788573995.562883:0:6469:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000000676bfc0) 00000020:00000080:1.0:1788573995.562901:0:6469:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788573995.623049:0:6469:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1788573995.623130:0:6469:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:1.0:1788573995.670916:0:6469:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788573995.671935:0:6469:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1788573995.671945:0:6469:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788573995.671957:0:6469:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5bf8706fdac8ba05 00000020:01000004:1.0:1788573995.671965:0:6469:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1788573995.671970:0:6469:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1788573995.671975:0:6469:0:(tgt_mount.c:101:server_register_mount()) register mount 000000000a8314d3 from MGS 00000020:01000004:1.0:1788573995.671979:0:6469:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1788573995.671990:0:6469:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000001fcc8a11) 00000020:00000080:1.0:1788573995.672012:0:6469:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1788573995.672073:0:6469:0:(tgt_mount.c:153:server_get_mount()) get mount 000000000a8314d3 from MGS, refs=2 00080000:01000000:1.0:1788573995.672080:0:6469:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788573995.672084:0:6469:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5bf8706fdac8ba13 00000100:00100000:1.0:1788573995.672178:0:6469:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1788573995.672478:0:6469:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1788573995.672484:0:6469:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1788573995.673053:0:6469:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1788573995.673061:0:6469:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1788573995.674038:0:6469:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788573995.674533:0:6469:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1788573995.674539:0:6469:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1788573995.675459:0:6469:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1788573995.675469:0:6469:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1788573995.676137:0:6469:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1788573995.676146:0:6469:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1788573995.678177:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788573995.678183:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788573995.678184:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788573995.679427:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788573995.679431:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788573995.679433:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788573995.680150:0:6469:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1788573995.685538:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1788573995.929403:0:6469:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3279 MB/s 00000001:01000000:3.0:1788573996.179416:0:6469:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 4639 MB/s 00000001:01000000:1.0:1788573996.429820:0:6469:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 867 MB/s 00000001:01000000:3.0:1788573996.679340:0:6469:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 1211 MB/s 00080000:10000000:3.0:1788573996.683703:0:6469:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:3.0:1788573996.691009:0:6469:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 00010000:00010000:2.0:1788573996.691386:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788573996.693326:0:6483:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788573996.695438:0:6469:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788573996.695491:0:6469:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1788573996.695708:0:6469:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1788573996.695734:0:6469:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788573996.696078:0:6469:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788573996.696280:0:6469:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788573996.696286:0:6469:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1788573996.698933:0:6469:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1788573996.698945:0:6469:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788573996.699354:0:6469:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788573996.699362:0:6469:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1788573996.700519:0:6469:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788573996.700542:0:6469:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.151@tcp' 00000020:01000004:3.0:1788573996.700543:0:6469:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1788573996.700596:0:6469:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.151@tcp (typ=mgc) 00000020:00000080:3.0:1788573996.700617:0:6469:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.151@tcp (00000000107d8ad3) 00000020:00000080:3.0:1788573996.700635:0:6469:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1788573996.700763:0:6469:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000e586e1f2@MGC192.168.204.151@tcp: add connection 192.168.204.151@tcp at head 00010000:00010000:3.0:1788573996.700916:0:6469:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.151@tcp-0 is initialized 00000040:01000000:3.0:1788573996.700923:0:6469:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.151@tcp ctxt 1 is initialized 00000100:00080000:0.0:1788573996.706478:0:6488:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1788573996.708944:0:6490:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1788573996.709058:0:6469:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.151@tcp (uuid 69505170-06bc-41d1-9626-ab1a3c7f32a0) 00000020:00000080:1.0:1788573996.709083:0:6469:0:(genops.c:1385:class_connect()) connect: client 69505170-06bc-41d1-9626-ab1a3c7f32a0, cookie 0x5bf8706fdac8ba21 00000100:00080000:1.0:1788573996.709095:0:6469:0:(import.c:545:import_select_connection()) MGC192.168.204.151@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788573996.709101:0:6469:0:(import.c:665:import_select_connection()) MGC192.168.204.151@tcp: import 00000000e586e1f2 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:1.0:1788573996.709150:0:6469:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000b09b8f20 x1875455681495168/t0(0) o250->MGC192.168.204.151@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788573996.709668:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b09b8f20 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:69505170-06bc-41d1-9626-ab1a3c7f32a0:3616:1875455681495168:0@lo:250: 00000100:00100000:3.0:1788573996.709910:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788573996.709960:0:6469:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 69505170-06bc-41d1-9626-ab1a3c7f32a0->MGS 00000020:01000004:1.0:1788573996.709989:0:6469:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1788573996.709995:0:6469:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1788573996.710008:0:6469:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000ca15ca25) 00000020:00000080:1.0:1788573996.710022:0:6469:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1788573996.710045:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681495168 00000100:00100000:2.0:1788573996.710052:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681495168 00000100:00100000:2.0:1788573996.711806:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788573996.711818:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f9b078e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3616:x1875455681495168:12345-0@lo:250: 00010000:00080000:2.0:1788573996.711849:0:6485:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 69505170-06bc-41d1-9626-ab1a3c7f32a0@0@lo t0 exp 0000000000000000 cur 136 last 0 00000020:00000080:2.0:1788573996.711878:0:6485:0:(genops.c:1385:class_connect()) connect: client 69505170-06bc-41d1-9626-ab1a3c7f32a0, cookie 0x5bf8706fdac8ba2f 00000100:00080000:2.0:1788573996.712032:0:6485:0:(import.c:65:import_set_state_nolock()) 00000000895e60c0 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788573996.712134:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f9b078e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+5:3616:x1875455681495168:12345-0@lo:250: Request processed in 316us (2224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788573996.712143:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788573996.712616:0:3616:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.204.151@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788573996.712627:0:3616:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.204.151@tcp: connect to target with instance 0 00000100:00080000:3.0:1788573996.712634:0:3616:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.204.151@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788573996.712639:0:3616:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788573996.712642:0:3616:0:(import.c:65:import_set_state_nolock()) 00000000e586e1f2 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788573996.712644:0:3616:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788573996.712658:0:3616:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788573996.712663:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b09b8f20 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:69505170-06bc-41d1-9626-ab1a3c7f32a0:3616:1875455681495168:0@lo:250: 00000100:00100000:0.0:1788573996.724637:0:6469:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788573996.726404:0:6469:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1788573996.726414:0:6469:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1788573996.727311:0:6469:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788573996.727322:0:6469:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1788573996.729508:0:6469:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1788573996.729519:0:6469:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1788573996.730992:0:6469:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788573996.731170:0:6469:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1788573996.731176:0:6469:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1788573996.731820:0:6469:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788573996.731828:0:6469:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1788573996.762624:0:6469:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788573996.762951:0:6469:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1788573996.762958:0:6469:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1788573996.764597:0:6469:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1788573996.764610:0:6469:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1788573996.765604:0:6469:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788573996.765927:0:6469:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788573996.765933:0:6469:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1788573996.766608:0:6469:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788573996.766618:0:6469:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788573996.767504:0:6469:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788573996.767749:0:6469:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788573996.767755:0:6469:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1788573996.768549:0:6469:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788573996.768558:0:6469:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1788573996.769615:0:6469:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788573996.769942:0:6469:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788573996.769954:0:6469:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1788573996.770867:0:6469:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788573996.770876:0:6469:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788573996.787675:0:6469:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788573996.788049:0:6469:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788573996.788056:0:6469:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1788573996.790169:0:6469:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788573996.790184:0:6469:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1788573996.791377:0:6469:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788573996.791389:0:6469:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1788573996.792401:0:6469:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1788573996.792430:0:6469:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1788573996.792436:0:6469:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.151@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1788573996.792532:0:6469:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.151@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788573996.792564:0:6469:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.151@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1788573996.792568:0:6469:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788573996.792570:0:6469:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788573996.792571:0:6469:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788573996.792572:0:6469:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788573996.792574:0:6469:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788573996.792575:0:6469:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788573996.792576:0:6469:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788573996.792578:0:6469:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788573996.792579:0:6469:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788573996.792580:0:6469:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788573996.792582:0:6469:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788573996.792583:0:6469:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788573996.792585:0:6469:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1788573996.792588:0:6469:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788573996.792589:0:6469:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788573996.792590:0:6469:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788573996.792592:0:6469:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788573996.792593:0:6469:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788573996.792594:0:6469:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788573996.792594:0:6469:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788573996.792595:0:6469:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788573996.792596:0:6469:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788573996.792602:0:6469:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788573996.792602:0:6469:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788573996.792603:0:6469:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788573996.792717:0:6469:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788573996.792737:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e04eb3b9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:6469:1875455681495296:0@lo:253: 00000100:00100000:2.0:1788573996.792882:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788573996.792993:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set 000000001b25152e going to sleep for 11 seconds 00000100:00100000:1.0:1788573996.793047:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681495296 00000100:00100000:1.0:1788573996.793056:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681495296 00000100:00100000:1.0:1788573996.793155:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788573996.793165:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008699f79f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+5:6469:x1875455681495296:12345-0@lo:253: 20000000:01000000:1.0:1788573996.793243:0:6487:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788573996.793246:0:6487:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1788573996.793686:0:6508:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788573996.793860:0:6487:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1788573996.795895:0:6487:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788573996.799543:0:6509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1788573996.800152:0:6487:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788573996.800157:0:6487:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1788573996.800163:0:6487:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1788573996.800166:0:6487:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1788573996.800605:0:6487:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1788573996.800972:0:6487:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788573996.801151:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1788573996.801172:0:6487:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788573996.801222:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1788573996.801242:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1788573996.801257:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1788573996.801391:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1788573996.801401:0:6487:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1788573996.801415:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1788573996.801420:0:6487:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1788573996.801432:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1788573996.801437:0:6487:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1788573996.801449:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1788573996.801463:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1788573996.801492:0:6487:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1788573996.801496:0:6487:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1788573996.801503:0:6487:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788573996.801622:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1788573996.801739:0:6487:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788573996.801758:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1788573996.801776:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1788573996.801862:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1788573996.801875:0:6487:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1788573996.801903:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1788573996.801912:0:6487:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1788573996.801924:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1788573996.801938:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1788573996.801953:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1788573996.801963:0:6487:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1788573996.801997:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1788573996.802007:0:6487:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1788573996.802031:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1788573996.802047:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1788573996.802113:0:6487:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1788573996.802134:0:6487:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1788573996.802140:0:6487:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1788573996.802776:0:6510:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1788573996.803035:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1788573996.803058:0:6487:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.151@tcp for mdt 20000000:01000000:1.0:1788573996.803060:0:6487:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.151@tcp (null) (null) (null) 00000040:00080000:1.0:1788573996.803074:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1788573996.803080:0:6487:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1788573996.803092:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1788573996.803097:0:6487:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.204.151@tcp (null) (null) 00000040:00080000:1.0:1788573996.803109:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1788573996.803116:0:6487:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1788573996.803129:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1788573996.803161:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1788573996.803216:0:6487:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788573996.803221:0:6487:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788573996.803225:0:6487:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788573996.803279:0:6487:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788573996.803282:0:6487:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788573996.803899:0:6511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:1.0:1788573996.804088:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1788573996.804115:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:1.0:1788573996.804129:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:1.0:1788573996.804139:0:6487:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788573996.804141:0:6487:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788573996.804617:0:6512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1788573996.804898:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1788573996.804922:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1788573996.804937:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:1.0:1788573996.804947:0:6487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788573996.804950:0:6487:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:1.0:1788573996.804961:0:6487:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1788573996.804964:0:6487:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1788573996.804970:0:6487:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1788573996.804976:0:6487:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1788573996.805489:0:6513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:1.0:1788573996.805613:0:6487:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1788573996.819437:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:1.0:1788573996.819506:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:1.0:1788573996.819628:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:1.0:1788573996.819715:0:6487:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788573996.819742:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000d49959d4/0x5bf8706fdac8ba36 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788573996.819760:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d49959d4/0x5bf8706fdac8ba36 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788573996.819771:0:6487:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d49959d4/0x5bf8706fdac8ba36 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788573996.819778:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d49959d4/0x5bf8706fdac8ba36 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788573996.819848:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000d49959d4/0x5bf8706fdac8ba36 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788573996.819857:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000d49959d4/0x5bf8706fdac8ba36 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788573996.819863:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d49959d4 already unused, calling callback (0000000000887628) 00010000:00010000:1.0:1788573996.819867:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000d49959d4/0x5bf8706fdac8ba36 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788573996.819892:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000d49959d4/0x5bf8706fdac8ba36 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788573996.819905:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000d49959d4/0x5bf8706fdac8ba36 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788573996.819913:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000d49959d4/0x5bf8706fdac8ba36 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788573996.819918:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d49959d4/0x5bf8706fdac8ba36 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788573996.819937:0:6487:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1788573996.833907:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e04eb3b9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:6469:1875455681495296:0@lo:253: 10000000:01000000:2.0:1788573996.833929:0:6469:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788573996.833932:0:6469:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788573996.833934:0:6469:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788573996.833935:0:6469:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788573996.833936:0:6469:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1788573996.833937:0:6469:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788573996.833939:0:6469:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788573996.833940:0:6469:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788573996.833942:0:6469:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788573996.833943:0:6469:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788573996.833944:0:6469:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788573996.833946:0:6469:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788573996.833968:0:6469:0:(tgt_mount.c:101:server_register_mount()) register mount 000000000a8314d3 from lustre-MDT0000 10000000:01000000:2.0:1788573996.834012:0:6469:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 00000100:00100000:1.0:1788573996.834082:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008699f79f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+5:6469:x1875455681495296:12345-0@lo:253: Request processed in 40612us (40893us total) trans 0 rc 0/0 00000100:00100000:1.0:1788573996.834099:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 10000000:01000000:2.0:1788573996.834176:0:6469:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788573996.834181:0:6469:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9c85e56999c0 10000000:01000000:2.0:1788573996.834187:0:6469:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788573996.834218:0:6469:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9c85e56999c0 from 1 10000000:01000000:2.0:1788573996.834222:0:6469:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788573996.834263:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: 0000000066d8bbf5/0x5bf8706fdac8ba3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788573996.834274:0:6469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: 0000000066d8bbf5/0x5bf8706fdac8ba3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788573996.834370:0:6469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: 0000000066d8bbf5/0x5bf8706fdac8ba3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788573996.834388:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e04eb3b9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:6469:1875455681495424:0@lo:101: 00000100:00100000:2.0:1788573996.834432:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788573996.834563:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set 00000000adda3847 going to sleep for 11 seconds 00000100:00100000:3.0:1788573996.834654:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681495424 00000100:00100000:3.0:1788573996.834662:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681495424 00000100:00100000:3.0:1788573996.834712:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788573996.834722:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b779ad54 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+5:6469:x1875455681495424:12345-0@lo:101: 00010000:00010000:3.0:1788573996.834740:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788573996.834755:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ac844b1f/0x5bf8706fdac8ba44 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8ba3d expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788573996.834782:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ac844b1f/0x5bf8706fdac8ba44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8ba3d expref: 6 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788573996.834805:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ac844b1f/0x5bf8706fdac8ba44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8ba3d expref: 6 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788573996.834815:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ac844b1f, rc 0) 00000100:00100000:3.0:1788573996.834857:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b779ad54 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+6:6469:x1875455681495424:12345-0@lo:101: Request processed in 137us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788573996.834871:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788573996.835033:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e04eb3b9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:6469:1875455681495424:0@lo:101: 00010000:00010000:2.0:1788573996.835049:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: 0000000066d8bbf5/0x5bf8706fdac8ba3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8ba44 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788573996.835058:0:6469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: 0000000066d8bbf5/0x5bf8706fdac8ba3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8ba44 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788573996.835121:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e04eb3b9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:6469:1875455681495552:0@lo:501: 00000100:00100000:2.0:1788573996.835151:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788573996.835176:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set 00000000adda3847 going to sleep for 11 seconds 00000100:00100000:3.0:1788573996.835441:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681495552 00000100:00100000:3.0:1788573996.835446:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681495552 00000100:00100000:3.0:1788573996.835478:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788573996.835484:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c1ccf925 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+6:6469:x1875455681495552:12345-0@lo:501: 00000100:00100000:3.0:1788573996.835556:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c1ccf925 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+6:6469:x1875455681495552:12345-0@lo:501: Request processed in 72us (405us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788573996.835562:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788573996.835944:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e04eb3b9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:6469:1875455681495552:0@lo:501: 10000000:01000000:0.0:1788573996.835987:0:6469:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788573996.836089:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: 0000000066d8bbf5/0x5bf8706fdac8ba3d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8ba44 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788573996.836099:0:6469:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: 0000000066d8bbf5/0x5bf8706fdac8ba3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8ba44 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788573996.836107:0:6469:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c85c2bfb800 10000000:01000000:0.0:1788573996.836113:0:6469:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788573996.836117:0:6469:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9c85c2bfb800 10000000:01000000:0.0:1788573996.836120:0:6469:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788573996.836123:0:6469:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9c85c2bfb800 from 1 10000000:01000000:0.0:1788573996.836125:0:6469:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788573996.836163:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: 000000009f082877/0x5bf8706fdac8ba4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788573996.836170:0:6469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: 000000009f082877/0x5bf8706fdac8ba4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788573996.836182:0:6469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: 000000009f082877/0x5bf8706fdac8ba4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788573996.836228:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009b22f3f8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:6469:1875455681495680:0@lo:101: 00000100:00100000:0.0:1788573996.836261:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788573996.836403:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681495680 00000100:00100000:3.0:1788573996.836408:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681495680 00000100:00100000:3.0:1788573996.836441:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788573996.836447:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ab3434f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+6:6469:x1875455681495680:12345-0@lo:101: 00010000:00010000:3.0:1788573996.836455:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788573996.836464:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000061eee383/0x5bf8706fdac8ba52 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8ba4b expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788573996.836482:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000061eee383/0x5bf8706fdac8ba52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8ba4b expref: 7 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788573996.836490:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000061eee383/0x5bf8706fdac8ba52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8ba4b expref: 7 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788573996.836498:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000061eee383, rc 0) 00000100:00100000:3.0:1788573996.836521:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ab3434f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+7:6469:x1875455681495680:12345-0@lo:101: Request processed in 75us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788573996.836526:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788573996.836617:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f9b9084b going to sleep for 11 seconds 00000100:00100000:0.0:1788573996.836631:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009b22f3f8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:6469:1875455681495680:0@lo:101: 00010000:00010000:0.0:1788573996.836648:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: 000000009f082877/0x5bf8706fdac8ba4b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8ba52 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788573996.836656:0:6469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: 000000009f082877/0x5bf8706fdac8ba4b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8ba52 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788573996.836667:0:6469:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788573996.836867:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: 000000009f082877/0x5bf8706fdac8ba4b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8ba52 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788573996.836875:0:6469:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: 000000009f082877/0x5bf8706fdac8ba4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8ba52 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788573996.836881:0:6469:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788573996.836885:0:6469:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788573996.836889:0:6469:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9c85c2bfb800 10000000:01000000:0.0:1788573996.836891:0:6469:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788573996.836894:0:6469:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1788573996.836895:0:6469:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788573996.836908:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: 00000000e2dcc77a/0x5bf8706fdac8ba59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788573996.836922:0:6469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: 00000000e2dcc77a/0x5bf8706fdac8ba59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788573996.836928:0:6469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: 00000000e2dcc77a/0x5bf8706fdac8ba59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788573996.836939:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009b22f3f8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:6469:1875455681495808:0@lo:101: 00000100:00100000:0.0:1788573996.836963:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788573996.836991:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f9b9084b going to sleep for 11 seconds 00000100:00100000:1.0:1788573996.837095:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681495808 00000100:00100000:1.0:1788573996.837100:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681495808 00000100:00100000:1.0:1788573996.837127:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788573996.837133:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000031827b6b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+7:6469:x1875455681495808:12345-0@lo:101: 00010000:00010000:1.0:1788573996.837140:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788573996.837147:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d49959d4/0x5bf8706fdac8ba60 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8ba59 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788573996.837160:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d49959d4/0x5bf8706fdac8ba60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8ba59 expref: 8 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788573996.837168:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d49959d4/0x5bf8706fdac8ba60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8ba59 expref: 8 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788573996.837184:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d49959d4, rc 0) 00000100:00100000:1.0:1788573996.837231:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000031827b6b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+8:6469:x1875455681495808:12345-0@lo:101: Request processed in 98us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788573996.837237:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788573996.837391:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009b22f3f8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:6469:1875455681495808:0@lo:101: 00010000:00010000:0.0:1788573996.837401:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: 00000000e2dcc77a/0x5bf8706fdac8ba59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8ba60 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788573996.837407:0:6469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: 00000000e2dcc77a/0x5bf8706fdac8ba59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8ba60 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788573996.837467:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009b22f3f8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:6469:1875455681495936:0@lo:501: 00000100:00100000:0.0:1788573996.837488:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788573996.837513:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f9b9084b going to sleep for 11 seconds 00000100:00100000:1.0:1788573996.837557:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681495936 00000100:00100000:1.0:1788573996.837561:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681495936 00000100:00100000:1.0:1788573996.837586:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788573996.837591:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b9889ab9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+8:6469:x1875455681495936:12345-0@lo:501: 00000100:00100000:1.0:1788573996.837695:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b9889ab9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+9:6469:x1875455681495936:12345-0@lo:501: Request processed in 104us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1788573996.837701:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788573996.837823:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009b22f3f8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:6469:1875455681495936:0@lo:501: 00000100:00100000:0.0:1788573996.837854:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009b22f3f8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:6469:1875455681496064:0@lo:503: 00000100:00100000:0.0:1788573996.837885:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788573996.837901:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f9b9084b going to sleep for 11 seconds 00000100:00100000:1.0:1788573996.838002:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681496064 00000100:00100000:1.0:1788573996.838006:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681496064 00000100:00100000:1.0:1788573996.838095:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788573996.838101:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000033624fba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+9:6469:x1875455681496064:12345-0@lo:503: 00000100:00100000:1.0:1788573996.838164:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000033624fba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+9:6469:x1875455681496064:12345-0@lo:503: Request processed in 64us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788573996.838170:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788573996.838351:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009b22f3f8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:6469:1875455681496064:0@lo:503: 00000100:00100000:0.0:1788573996.838752:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009b22f3f8 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:6514:1875455681496192:0@lo:502: 00000100:00100000:0.0:1788573996.838866:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788573996.838899:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e29dac64 going to sleep for 11 seconds 00000100:00100000:1.0:1788573996.838952:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681496192 00000100:00100000:1.0:1788573996.838957:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681496192 00000100:00100000:1.0:1788573996.838998:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788573996.839004:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001e73f69a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+9:6514:x1875455681496192:12345-0@lo:502: 00000100:00100000:1.0:1788573996.839301:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001e73f69a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+9:6514:x1875455681496192:12345-0@lo:502: Request processed in 287us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788573996.839308:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788573996.839478:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009b22f3f8 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:6514:1875455681496192:0@lo:502: 00000020:01000000:0.0:1788573996.839505:0:6514:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788573996.839524:0:6514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788573996.839527:0:6514:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788573996.839532:0:6514:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1788573996.839536:0:6514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788573996.839554:0:6514:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000000985aaa6) 00000020:00000080:0.0:1788573996.839570:0:6514:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1788573996.839576:0:6514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788573996.839773:0:6514:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788573996.839781:0:6514:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5bf8706fdac8ba6e 00000020:00000080:0.0:1788573996.840154:0:6514:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788573996.840159:0:6514:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788573996.840162:0:6514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788573996.840164:0:6514:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788573996.840167:0:6514:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788573996.840171:0:6514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788573996.840172:0:6514:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1788573996.840175:0:6514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788573996.840181:0:6514:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000634067f1) 00000020:00000080:0.0:1788573996.840271:0:6514:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1788573996.840277:0:6514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788573996.840279:0:6514:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1788573996.840282:0:6514:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1788573996.840288:0:6514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788573996.840414:0:6514:0:(tgt_mount.c:153:server_get_mount()) get mount 000000000a8314d3 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1788573996.840425:0:6514:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (0000000059549463) 00000020:00000080:0.0:1788573996.840433:0:6514:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1788573996.840485:0:6514:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788573996.840496:0:6514:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5bf8706fdac8ba83 00000020:00000080:0.0:1788573996.840602:0:6514:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1788573996.840608:0:6514:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788573996.840612:0:6514:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x5bf8706fdac8ba8a 00080000:01000000:0.0:1788573996.840618:0:6514:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788573996.840621:0:6514:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5bf8706fdac8ba91 00080000:10000000:0.0:1788573996.841654:0:6514:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:0.0:1788573996.841841:0:6514:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:0.0:1788573996.847605:0:6514:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1788573996.929350:0:6514:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1788573996.929706:0:6514:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1788573996.932478:0:6514:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1788573996.932873:0:6514:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788573996.936157:0:6514:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000e244f46e) 00000020:00000080:2.0:1788573996.936322:0:6514:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788573996.936581:0:6514:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788573996.936590:0:6514:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5bf8706fdac8ba9f 00000020:00000080:1.0:1788573996.937114:0:6514:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1788573996.938015:0:6514:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:1.0:1788573996.946158:0:6514:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:1.0:1788573996.948348:0:6514:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:3.0:1788573996.952334:0:6514:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:3.0:1788573996.955159:0:6514:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:3.0:1788573996.957181:0:6514:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:3.0:1788573996.959341:0:6514:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x5bf8706fdac8baa6 00000020:00000080:3.0:1788573996.959665:0:6514:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788573996.959677:0:6514:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788573996.959683:0:6514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788573996.959686:0:6514:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788573996.959689:0:6514:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788573996.959693:0:6514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788573996.959694:0:6514:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788573996.959697:0:6514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788573996.959699:0:6514:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788573996.959701:0:6514:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788573996.959704:0:6514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788573996.959705:0:6514:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788573996.959708:0:6514:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788573996.959713:0:6514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788573996.959715:0:6514:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788573996.959719:0:6514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788573996.959767:0:6514:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:3.0:1788573996.959837:0:6514:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000ec08a30 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:6514:1875455681496320:0@lo:502: 00000100:00100000:3.0:1788573996.959921:0:6514:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788573996.959987:0:6514:0:(client.c:2716:ptlrpc_set_wait()) set 00000000388c068b going to sleep for 11 seconds 00000100:00100000:1.0:1788573996.960106:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681496320 00000100:00100000:1.0:1788573996.960114:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681496320 00000100:00100000:1.0:1788573996.960159:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788573996.960167:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a24b4f4f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+9:6514:x1875455681496320:12345-0@lo:502: 00000100:00100000:1.0:1788573996.960360:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a24b4f4f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+9:6514:x1875455681496320:12345-0@lo:502: Request processed in 193us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788573996.960368:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788573996.960499:0:6514:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000ec08a30 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:6514:1875455681496320:0@lo:502: 00000020:01000000:2.0:1788573996.966958:0:6514:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788573996.967120:0:6514:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788573996.967124:0:6514:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:2.0:1788573996.967147:0:6514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1788573996.967439:0:6469:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1788573996.967462:0:6469:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788573996.967482:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: 00000000e2dcc77a/0x5bf8706fdac8ba59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8ba60 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788573996.967496:0:6469:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: 00000000e2dcc77a/0x5bf8706fdac8ba59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8ba60 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788573996.967504:0:6469:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c85c2bfb800 from 1 10000000:01000000:0.0:1788573996.967507:0:6469:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788573996.967550:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: 00000000e2739887/0x5bf8706fdac8baad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788573996.967557:0:6469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: 00000000e2739887/0x5bf8706fdac8baad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788573996.967568:0:6469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: 00000000e2739887/0x5bf8706fdac8baad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788573996.967593:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009b22f3f8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:6469:1875455681496448:0@lo:101: 00000100:00100000:0.0:1788573996.967672:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788573996.967725:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set 000000002045b1b8 going to sleep for 11 seconds 00000100:00100000:3.0:1788573996.967785:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681496448 00000100:00100000:3.0:1788573996.967793:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681496448 00000100:00100000:3.0:1788573996.967844:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788573996.967852:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000068ad3095 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+9:6469:x1875455681496448:12345-0@lo:101: 00010000:00010000:3.0:1788573996.967867:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788573996.967879:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008bb15287/0x5bf8706fdac8bab4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8baad expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788573996.967908:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008bb15287/0x5bf8706fdac8bab4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8baad expref: 10 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788573996.967918:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008bb15287/0x5bf8706fdac8bab4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8baad expref: 10 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788573996.967927:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008bb15287, rc 0) 00000100:00100000:3.0:1788573996.967984:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000068ad3095 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+10:6469:x1875455681496448:12345-0@lo:101: Request processed in 122us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788573996.967992:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788573996.968118:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009b22f3f8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:6469:1875455681496448:0@lo:101: 00010000:00010000:2.0:1788573996.968133:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: 00000000e2739887/0x5bf8706fdac8baad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bab4 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788573996.968142:0:6469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: 00000000e2739887/0x5bf8706fdac8baad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8bab4 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788573996.968969:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001116ca59 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:6469:1875455681496576:0@lo:256: 00000100:00100000:2.0:1788573996.969100:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788573996.969145:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set 000000003c8098e3 going to sleep for 11 seconds 00000100:00100000:3.0:1788573996.969364:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681496576 00000100:00100000:3.0:1788573996.969371:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681496576 00000100:00100000:3.0:1788573996.969405:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788573996.969412:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f8fd7ba7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+10:6469:x1875455681496576:12345-0@lo:256: 20000000:01000000:3.0:1788573996.969429:0:6486:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788573996.969435:0:6486:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1788573996.969512:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f8fd7ba7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+10:6469:x1875455681496576:12345-0@lo:256: Request processed in 101us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788573996.969520:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788573996.969882:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001116ca59 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:6469:1875455681496576:0@lo:256: 10000000:01000000:2.0:1788573996.970654:0:6469:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788573996.970718:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: 00000000e2739887/0x5bf8706fdac8baad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bab4 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788573996.970729:0:6469:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: 00000000e2739887/0x5bf8706fdac8baad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bab4 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788573996.972166:0:6469:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c85c2bfb800 from 1 10000000:01000000:3.0:1788573996.972175:0:6469:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788573996.972244:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: 000000002cbc2156/0x5bf8706fdac8babb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788573996.972256:0:6469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: 000000002cbc2156/0x5bf8706fdac8babb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788573996.972267:0:6469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: 000000002cbc2156/0x5bf8706fdac8babb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788573996.972302:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006d76c9b4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:6469:1875455681496704:0@lo:101: 00000100:00100000:3.0:1788573996.972369:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788573996.972417:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e1a3bcd2 going to sleep for 11 seconds 00000100:00100000:2.0:1788573996.972484:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681496704 00000100:00100000:2.0:1788573996.972492:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681496704 00000100:00100000:2.0:1788573996.972554:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788573996.972563:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000086c9aced pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+10:6469:x1875455681496704:12345-0@lo:101: 00010000:00010000:2.0:1788573996.972576:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788573996.972590:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ef766547/0x5bf8706fdac8bac2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8babb expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788573996.972611:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ef766547/0x5bf8706fdac8bac2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8babb expref: 11 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788573996.972629:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ef766547/0x5bf8706fdac8bac2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8babb expref: 11 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788573996.972637:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ef766547, rc 0) 00000100:00100000:2.0:1788573996.972674:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000086c9aced pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+11:6469:x1875455681496704:12345-0@lo:101: Request processed in 113us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788573996.972681:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788573996.973028:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006d76c9b4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:6469:1875455681496704:0@lo:101: 00010000:00010000:3.0:1788573996.973044:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: 000000002cbc2156/0x5bf8706fdac8babb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bac2 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788573996.973053:0:6469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: 000000002cbc2156/0x5bf8706fdac8babb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8bac2 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788573996.973122:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006d76c9b4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:6469:1875455681496832:0@lo:501: 00000100:00100000:3.0:1788573996.973153:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788573996.973181:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e1a3bcd2 going to sleep for 11 seconds 00000100:00100000:1.0:1788573996.973254:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681496832 00000100:00100000:1.0:1788573996.973260:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681496832 00000100:00100000:1.0:1788573996.973292:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788573996.973297:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cb49c35f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+11:6469:x1875455681496832:12345-0@lo:501: 00000100:00100000:1.0:1788573996.976509:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cb49c35f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+11:6469:x1875455681496832:12345-0@lo:501: Request processed in 3203us (3347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788573996.976535:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788573996.979127:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006d76c9b4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:6469:1875455681496832:0@lo:501: 00000100:00100000:3.0:1788573996.979377:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006d76c9b4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:6469:1875455681496960:0@lo:503: 00000100:00100000:3.0:1788573996.979449:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788573996.979548:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e1a3bcd2 going to sleep for 11 seconds 00000100:00100000:1.0:1788573996.982707:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681496960 00000100:00100000:1.0:1788573996.982724:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681496960 00000100:00100000:2.0:1788573996.986362:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788573996.986381:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000449b3a36 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+11:6469:x1875455681496960:12345-0@lo:503: 00000040:00080000:2.0:1788573996.986454:0:6485:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788573996.986573:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000449b3a36 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+11:6469:x1875455681496960:12345-0@lo:503: Request processed in 196us (7123us total) trans 0 rc 0/0 00000100:00100000:2.0:1788573996.986582:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788573996.986692:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006d76c9b4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:6469:1875455681496960:0@lo:503: 00000040:00080000:3.0:1788573996.987703:0:6518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1788573996.987916:0:6469:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1788573996.987938:0:6469:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788573996.987955:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: 000000002cbc2156/0x5bf8706fdac8babb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bac2 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788573996.987966:0:6469:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: 000000002cbc2156/0x5bf8706fdac8babb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bac2 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788573996.988034:0:6469:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788573996.988038:0:6469:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c85c2bfb800 10000000:01000000:1.0:1788573996.988049:0:6469:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c85c2bfb800 10000000:01000000:1.0:1788573996.988053:0:6469:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788573996.988059:0:6469:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c85c2bfb800 from 1 10000000:01000000:1.0:1788573996.988062:0:6469:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788573996.988095:0:6469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: 0000000055846700/0x5bf8706fdac8bac9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788573996.988103:0:6469:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: 0000000055846700/0x5bf8706fdac8bac9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788573996.988112:0:6469:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: 0000000055846700/0x5bf8706fdac8bac9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788573996.988130:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000031ebd437 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:6469:1875455681497088:0@lo:101: 00000100:00100000:1.0:1788573996.988179:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788573996.988251:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f9b9084b going to sleep for 11 seconds 00000100:00100000:3.0:1788573996.988396:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681497088 00000100:00100000:3.0:1788573996.988404:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681497088 00000100:00100000:3.0:1788573996.988443:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788573996.988450:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001e2243f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+11:6469:x1875455681497088:12345-0@lo:101: 00010000:00010000:3.0:1788573996.988461:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788573996.988472:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000a77489b/0x5bf8706fdac8bad0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8bac9 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788573996.988501:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000a77489b/0x5bf8706fdac8bad0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8bac9 expref: 12 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788573996.988510:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000a77489b/0x5bf8706fdac8bad0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8bac9 expref: 12 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788573996.988519:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000a77489b, rc 0) 00000100:00100000:3.0:1788573996.988570:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001e2243f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+12:6469:x1875455681497088:12345-0@lo:101: Request processed in 121us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788573996.988576:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788573996.988712:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000031ebd437 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:6469:1875455681497088:0@lo:101: 00010000:00010000:1.0:1788573996.988725:0:6469:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: 0000000055846700/0x5bf8706fdac8bac9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bad0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788573996.988734:0:6469:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: 0000000055846700/0x5bf8706fdac8bac9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8bad0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788573996.988795:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000031ebd437 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:6469:1875455681497216:0@lo:501: 00000100:00100000:1.0:1788573996.988820:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788573996.988840:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f9b9084b going to sleep for 11 seconds 00000100:00100000:0.0:1788573996.988899:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681497216 00000100:00100000:0.0:1788573996.988905:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681497216 00000100:00100000:0.0:1788573996.988937:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788573996.988943:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000041e385b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+12:6469:x1875455681497216:12345-0@lo:501: 00000100:00100000:1.0:1788573996.989275:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000031ebd437 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:6469:1875455681497216:0@lo:501: 00000100:00100000:1.0:1788573996.989304:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000031ebd437 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:6469:1875455681497344:0@lo:503: 00000100:00100000:1.0:1788573996.989346:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788573996.989376:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f9b9084b going to sleep for 11 seconds 00000100:00100000:2.0:1788573996.989415:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681497344 00000100:00100000:2.0:1788573996.989419:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681497344 00000100:00100000:2.0:1788573996.989441:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788573996.989446:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e34816c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+13:6469:x1875455681497344:12345-0@lo:503: 00000100:00100000:2.0:1788573996.989546:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e34816c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+13:6469:x1875455681497344:12345-0@lo:503: Request processed in 100us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788573996.989554:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788573996.989665:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000041e385b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+12:6469:x1875455681497216:12345-0@lo:501: Request processed in 245us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788573996.989673:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788573996.989748:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000031ebd437 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:6469:1875455681497344:0@lo:503: 00000100:00100000:1.0:1788573996.990153:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000031ebd437 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:6519:1875455681497472:0@lo:502: 00000100:00100000:1.0:1788573996.990237:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788573996.990260:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e29dac64 going to sleep for 11 seconds 00000100:00100000:0.0:1788573996.990361:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681497472 00000100:00100000:0.0:1788573996.990367:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681497472 00000100:00100000:0.0:1788573996.990394:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788573996.990400:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f964809e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+12:6519:x1875455681497472:12345-0@lo:502: 00000100:00100000:0.0:1788573996.990493:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f964809e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+12:6519:x1875455681497472:12345-0@lo:502: Request processed in 92us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788573996.990499:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788573996.990706:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000031ebd437 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:6519:1875455681497472:0@lo:502: 00000020:01000004:1.0:1788573996.990764:0:6519:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1788573996.990781:0:6519:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000a2e2e671) 00000020:00000080:1.0:1788573996.990801:0:6519:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:1.0:1788573996.990898:0:6519:0:(tgt_mount.c:153:server_get_mount()) get mount 000000000a8314d3 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788573996.990902:0:6519:0:(tgt_mount.c:187:server_put_mount()) put mount 000000000a8314d3 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788573996.990905:0:6519:0:(obd_mount.c:710:lustre_put_lsi()) put 000000000a8314d3 4 00010000:00080000:1.0:1788573996.990941:0:6519:0:(ldlm_lib.c:102:import_set_conn()) imp 000000004ffb61ff@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.151@tcp at head 00010000:00010000:2.0:1788573996.997953:0:6519:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:2.0:1788573996.998267:0:6519:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1788573996.998309:0:6519:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788573996.998323:0:6519:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x5bf8706fdac8bade 00000100:00080000:2.0:1788573996.998333:0:6519:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788573996.998338:0:6519:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000004ffb61ff using connection 192.168.204.151@tcp/0@lo 00000100:00100000:2.0:1788573996.998380:0:6519:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000001116ca59 x1875455681497600/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788573996.998401:0:6519:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788573996.998604:0:6519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000287b2fe6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:6519:1875455681497728:0@lo:502: 00000100:00100000:2.0:1788573996.998682:0:6519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788573996.998721:0:6519:0:(client.c:2716:ptlrpc_set_wait()) set 00000000385107ec going to sleep for 11 seconds 00000100:00100000:3.0:1788573996.998966:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001116ca59 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875455681497600:0@lo:38: 00000100:00100000:3.0:1788573996.999016:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788573996.999073:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681497728 00000100:00100000:3.0:1788573996.999079:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681497728 00000100:00100000:3.0:1788573996.999115:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788573996.999121:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009c0e8940 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+12:6519:x1875455681497728:12345-0@lo:502: 00000100:00100000:3.0:1788573996.999251:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009c0e8940 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+12:6519:x1875455681497728:12345-0@lo:502: Request processed in 129us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1788573996.999259:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788573996.999474:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681497600 00000100:00100000:2.0:1788573996.999479:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681497600 00000100:00100000:2.0:1788573996.999509:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788573996.999513:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006d76c9b4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1875455681497600:12345-0@lo:38: 00000100:00100000:2.0:1788573996.999663:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006d76c9b4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1875455681497600:12345-0@lo:38: Request processed in 148us (646us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788573996.999669:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788573996.999702:0:6519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000287b2fe6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:6519:1875455681497728:0@lo:502: 00000040:00080000:2.0:1788573996.999731:0:6519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1788573997.001334:0:6469:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1788573997.001367:0:6469:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788573997.001389:0:6469:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: 0000000055846700/0x5bf8706fdac8bac9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bad0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788573997.001401:0:6469:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: 0000000055846700/0x5bf8706fdac8bac9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bad0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788573997.001452:0:6469:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788573997.001455:0:6469:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788573997.001456:0:6469:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788573997.001457:0:6469:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788573997.001458:0:6469:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788573997.001460:0:6469:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788573997.001464:0:6469:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788573997.001465:0:6469:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788573997.001466:0:6469:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788573997.001467:0:6469:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788573997.001468:0:6469:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788573997.001469:0:6469:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788573997.001473:0:6469:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1788573997.001476:0:6469:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788573997.001477:0:6469:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788573997.001478:0:6469:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788573997.001479:0:6469:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788573997.001480:0:6469:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788573997.001481:0:6469:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788573997.001481:0:6469:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788573997.001482:0:6469:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788573997.001483:0:6469:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788573997.001483:0:6469:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788573997.001484:0:6469:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788573997.001485:0:6469:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788573997.001509:0:6469:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788573997.001535:0:6469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000287b2fe6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:6469:1875455681497856:0@lo:253: 00000100:00100000:2.0:1788573997.001598:0:6469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788573997.001639:0:6469:0:(client.c:2716:ptlrpc_set_wait()) set 00000000385107ec going to sleep for 11 seconds 00000100:00100000:3.0:1788573997.002451:0:3616:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788573997.002463:0:3616:0:(import.c:65:import_set_state_nolock()) 000000004ffb61ff lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788573997.002468:0:3616:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788573997.002471:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001116ca59 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875455681497600:0@lo:38: 00000100:00100000:3.0:1788573997.002505:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681497856 00000100:00100000:3.0:1788573997.002511:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681497856 00000100:00100000:3.0:1788573997.002629:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788573997.002645:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000081b06207 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+12:6469:x1875455681497856:12345-0@lo:253: 20000000:01000000:3.0:1788573997.002674:0:6486:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788573997.002686:0:6486:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788573997.013060:0:6486:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788573997.013084:0:6486:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1788573997.013388:0:6508:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788573997.013394:0:6508:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788573997.013415:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000004e22631f/0x5bf8706fdac8bae5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788573997.013435:0:6508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000008bb15287/0x5bf8706fdac8bab4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8baad expref: 12 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788573997.013442:0:6508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000004e22631f/0x5bf8706fdac8bae5 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788573997.013487:0:6508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000008bb15287/0x5bf8706fdac8bab4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5bf8706fdac8baad expref: 12 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788573997.013502:0:6508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000008bb15287/0x5bf8706fdac8bab4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5bf8706fdac8baad expref: 12 pid: 6487 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788573997.013761:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000031ebd437 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6508:1875455681497984:0@lo:104: 00000100:00100000:1.0:1788573997.013803:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788573997.013866:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e29dac64 going to sleep for 11 seconds 00000100:00100000:3.0:1788573997.013921:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000081b06207 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+12:6469:x1875455681497856:12345-0@lo:253: Request processed in 11277us (12322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788573997.013933:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788573997.014035:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681497984 00000100:00100000:0.0:1788573997.014043:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681497984 00000100:00100000:0.0:1788573997.014092:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788573997.014099:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b472cc9e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:69505170-06bc-41d1-9626-ab1a3c7f32a0+3:6508:x1875455681497984:12345-0@lo:104: 00010000:00010000:0.0:1788573997.014111:0:6475:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: 00000000e2739887/0x5bf8706fdac8baad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8bab4 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788573997.014160:0:6475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788573997.014165:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b472cc9e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:69505170-06bc-41d1-9626-ab1a3c7f32a0+3:6508:x1875455681497984:12345-0@lo:104: Request processed in 68us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788573997.014171:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1788573997.014249:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788573997.014255:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: 00000000e2739887/0x5bf8706fdac8baad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8bab4 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788573997.014262:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e2739887 already unused, calling callback (000000002f942c2d) 10000000:00010000:3.0:1788573997.014266:0:6480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: 00000000e2739887/0x5bf8706fdac8baad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5bf8706fdac8bab4 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788573997.014274:0:6480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: 00000000e2739887/0x5bf8706fdac8baad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5bf8706fdac8bab4 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788573997.014281:0:6480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: 00000000e2739887/0x5bf8706fdac8baad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5bf8706fdac8bab4 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788573997.014287:0:6480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788573997.014324:0:6480:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: 00000000e2739887/0x5bf8706fdac8baad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bab4 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788573997.014331:0:6480:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788573997.014346:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: 00000000e2739887/0x5bf8706fdac8baad lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bab4 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788573997.014353:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: 00000000e2739887/0x5bf8706fdac8baad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bab4 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788573997.014377:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788573997.014379:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788573997.014381:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788573997.014438:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000be0eb8de pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:69505170-06bc-41d1-9626-ab1a3c7f32a0:3618:1875455681498112:0@lo:103: 00000100:00100000:3.0:1788573997.014465:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788573997.014654:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000031ebd437 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6508:1875455681497984:0@lo:104: 00010000:00010000:1.0:1788573997.014673:0:6508:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000004e22631f/0x5bf8706fdac8bae5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788573997.015308:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681498112 00000100:00100000:3.0:1788573997.015318:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681498112 00010000:00010000:3.0:1788573997.015341:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000008bb15287/0x5bf8706fdac8bab4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8baad expref: 12 pid: 6487 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788573997.015373:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788573997.015379:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000505aa89d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:69505170-06bc-41d1-9626-ab1a3c7f32a0+12:3618:x1875455681498112:12345-0@lo:103: 00010000:00010000:3.0:1788573997.015389:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788573997.015393:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000008bb15287/0x5bf8706fdac8bab4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8baad expref: 12 pid: 6487 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788573997.015402:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000008bb15287/0x5bf8706fdac8bab4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5bf8706fdac8baad expref: 12 pid: 6487 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788573997.015416:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008bb15287/0x5bf8706fdac8bab4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5bf8706fdac8baad expref: 12 pid: 6487 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788573997.015432:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000004e22631f/0x5bf8706fdac8bae5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788573997.015440:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004e22631f/0x5bf8706fdac8bae5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788573997.015455:0:6477:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002062078s 00010000:00010000:3.0:1788573997.015469:0:6477:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000004e22631f/0x5bf8706fdac8bae5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788573997.015475:0:6477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000004e22631f/0x5bf8706fdac8bae5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788573997.015482:0:6477:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000004e22631f/0x5bf8706fdac8bae5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788573997.015487:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000004e22631f/0x5bf8706fdac8bae5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788573997.015492:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004e22631f already unused, calling callback (0000000000887628) 00010000:00010000:3.0:1788573997.015497:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000004e22631f/0x5bf8706fdac8bae5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788573997.015504:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000004e22631f/0x5bf8706fdac8bae5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788573997.015517:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000004e22631f/0x5bf8706fdac8bae5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788573997.015536:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788573997.015583:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000505aa89d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:69505170-06bc-41d1-9626-ab1a3c7f32a0+11:3618:x1875455681498112:12345-0@lo:103: Request processed in 204us (1117us total) trans 0 rc 0/0 00000100:00100000:3.0:1788573997.015590:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788573997.015618:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000be0eb8de pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:69505170-06bc-41d1-9626-ab1a3c7f32a0:3618:1875455681498112:0@lo:103: 00010000:00010000:3.0:1788573997.015638:0:6508:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000004e22631f/0x5bf8706fdac8bae5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788573997.015645:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000004e22631f/0x5bf8706fdac8bae5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788573997.015657:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004e22631f/0x5bf8706fdac8bae5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788573997.017103:0:6469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000287b2fe6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:6469:1875455681497856:0@lo:253: 10000000:01000000:2.0:1788573997.017125:0:6469:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788573997.017128:0:6469:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788573997.017130:0:6469:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788573997.017132:0:6469:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788573997.017133:0:6469:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788573997.017134:0:6469:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788573997.017136:0:6469:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788573997.017137:0:6469:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788573997.017139:0:6469:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788573997.017140:0:6469:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788573997.017142:0:6469:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788573997.017143:0:6469:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788573997.017144:0:6469:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788573997.017160:0:6469:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788573997.027566:0:6469:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:3.0:1788573997.027781:0:6469:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1788573997.028039:0:6469:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:3.0:1788573997.028257:0:6469:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1788573997.028467:0:6469:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:3.0:1788573997.028628:0:6469:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:3.0:1788573997.034301:0:6469:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:3.0:1788573997.034463:0:6469:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:3.0:1788573997.034702:0:6469:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:3.0:1788573997.034869:0:6469:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:3.0:1788573997.035040:0:6469:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:3.0:1788573997.035168:0:6469:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:3.0:1788573997.039047:0:6469:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:3.0:1788573997.049268:0:6469:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1788573997.049585:0:6525:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000020:00080000:1.0:1788573997.050146:0:6524:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1788573997.050151:0:6524:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:0.0:1788573997.052094:0:6469:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788573997.052499:0:6469:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788573997.053013:0:6469:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788573997.053030:0:6469:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1788573997.055302:0:6469:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788573997.056336:0:6469:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788573997.056865:0:6469:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788573997.056898:0:6469:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1788573997.057118:0:6469:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788573997.057229:0:6525:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1788573997.057573:0:6469:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:0.0:1788573997.061171:0:6469:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1788573997.061310:0:6469:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1788573997.061428:0:6469:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1788573997.061546:0:6469:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1788573997.061709:0:6469:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1788573997.061836:0:6469:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1788573997.061952:0:6469:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1788573997.062078:0:6469:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1788573997.062185:0:6469:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1788573997.062342:0:6469:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1788573997.062464:0:6469:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1788573997.062607:0:6469:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1788573997.062724:0:6469:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1788573997.062851:0:6469:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1788573997.062969:0:6469:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1788573997.063098:0:6469:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00000040:00080000:2.0:1788573997.064342:0:6525:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788573997.064431:0:6525:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788573997.064436:0:6525:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00100000:10000000:0.0:1788573997.065070:0:6469:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1788573997.065294:0:6469:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1788573997.065425:0:6469:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1788573997.065583:0:6469:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1788573997.065940:0:6469:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1788573997.066126:0:6469:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1788573997.066384:0:6469:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1788573997.066626:0:6469:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1788573997.066837:0:6469:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1788573997.067002:0:6469:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1788573997.067128:0:6469:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1788573997.067425:0:6469:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1788573997.067621:0:6469:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1788573997.067860:0:6469:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1788573997.068005:0:6469:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1788573997.068142:0:6469:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1788573997.068658:0:6469:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:0.0:1788573997.071758:0:6469:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788573997.071797:0:6469:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb4d28198f988 00100000:10000000:0.0:1788573997.071805:0:6469:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1788573997.072469:0:6469:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788573997.072486:0:6469:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.151@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788573997.072509:0:6469:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=45 00000080:00000004:0.0:1788573997.072536:0:6469:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1788573997.073340:0:6469:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788573997.073572:0:6469:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:2.0:1788573997.715421:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788573998.743921:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788573999.770060:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574000.788344:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788574001.311777:0:6769:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg451-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788574001.815162:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788574002.159836:0:6822:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788574002.160113:0:6822:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00080000:2.0:1788574002.323438:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788574002.323447:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788574002.323450:0:37:0:(import.c:65:import_set_state_nolock()) 000000004ffb61ff lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788574002.323463:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000004ffb61ff using connection 192.168.204.151@tcp/0@lo 00000100:00100000:2.0:1788574002.323485:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000068000aca x1875455681498368/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788574002.323657:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000287b2fe6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69505170-06bc-41d1-9626-ab1a3c7f32a0:3619:1875455681498240:0@lo:400: 00000100:00100000:3.0:1788574002.323739:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574002.323813:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000068000aca pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875455681498368:0@lo:38: 00000100:00100000:3.0:1788574002.323842:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574002.323971:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681498240 00000100:00100000:2.0:1788574002.323980:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681498240 00000100:00100000:2.0:1788574002.324026:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788574002.324034:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000025ce38c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+11:3619:x1875455681498240:12345-0@lo:400: 00000100:00100000:2.0:1788574002.324081:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000025ce38c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+11:3619:x1875455681498240:12345-0@lo:400: Request processed in 48us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574002.324087:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788574002.324119:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681498368 00000100:00100000:2.0:1788574002.324122:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681498368 00000100:00100000:2.0:1788574002.324140:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788574002.324144:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000be0eb8de pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1875455681498368:12345-0@lo:38: 00010000:00080000:2.0:1788574002.324163:0:6494:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 142 last 0 00000020:00000080:2.0:1788574002.324221:0:6494:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x5bf8706fdac8baec 00000004:00100000:2.0:1788574002.324266:0:6494:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788574002.324376:0:6494:0:(import.c:65:import_set_state_nolock()) 000000001712069b : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788574002.324440:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000be0eb8de pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875455681498368:12345-0@lo:38: Request processed in 295us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574002.324448:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788574002.324615:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000068000aca x1875455681498368/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788574012 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788574002.324643:0:3616:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788574002.324651:0:3616:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788574002.324655:0:3616:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788574002.324657:0:3616:0:(import.c:65:import_set_state_nolock()) 000000004ffb61ff lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788574002.324662:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000068000aca pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875455681498368:0@lo:38: 00000100:00100000:3.0:1788574002.324773:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000287b2fe6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69505170-06bc-41d1-9626-ab1a3c7f32a0:3619:1875455681498240:0@lo:400: 00010000:00010000:2.0:1788574002.843494:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574003.859518:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574004.884332:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788574004.924841:0:6923:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788574004.925021:0:6923:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:0.0:1788574005.907322:0:6490:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788574005.907330:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c85c2bfb800 from 3 10000000:01000000:0.0:1788574005.907335:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788574005.907410:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: 000000003d9e234f/0x5bf8706fdac8baf3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574005.907422:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: 000000003d9e234f/0x5bf8706fdac8baf3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574005.907432:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: 000000003d9e234f/0x5bf8706fdac8baf3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574005.907567:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001d14bbb4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681498496:0@lo:101: 00000100:00100000:0.0:1788574005.907639:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574005.907704:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set 000000008b08cb60 going to sleep for 11 seconds 00010000:00010000:3.0:1788574005.908238:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574005.908292:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681498496 00000100:00100000:1.0:1788574005.908301:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681498496 00000100:00100000:1.0:1788574005.908359:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788574005.908369:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001c0ce8b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+11:6490:x1875455681498496:12345-0@lo:101: 00010000:00010000:1.0:1788574005.908383:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574005.908397:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005c30a402/0x5bf8706fdac8bafa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8baf3 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574005.908420:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005c30a402/0x5bf8706fdac8bafa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8baf3 expref: 12 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574005.908431:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005c30a402/0x5bf8706fdac8bafa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8baf3 expref: 12 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574005.908440:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005c30a402, rc 0) 00000100:00100000:1.0:1788574005.908499:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001c0ce8b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+12:6490:x1875455681498496:12345-0@lo:101: Request processed in 133us (861us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574005.908516:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788574005.908553:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001d14bbb4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681498496:0@lo:101: 00010000:00010000:0.0:1788574005.908571:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: 000000003d9e234f/0x5bf8706fdac8baf3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bafa expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574005.908579:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: 000000003d9e234f/0x5bf8706fdac8baf3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8bafa expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574005.908626:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001d14bbb4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681498624:0@lo:256: 00000100:00100000:0.0:1788574005.908659:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574005.908698:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set 000000008b08cb60 going to sleep for 11 seconds 00000100:00100000:3.0:1788574005.908714:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681498624 00000100:00100000:3.0:1788574005.908721:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681498624 00000100:00100000:3.0:1788574005.908756:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788574005.908763:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f3cc5c09 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+12:6490:x1875455681498624:12345-0@lo:256: 20000000:01000000:3.0:1788574005.908778:0:6487:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788574005.908794:0:6487:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788574005.908797:0:6487:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1788574005.908892:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f3cc5c09 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+12:6490:x1875455681498624:12345-0@lo:256: Request processed in 130us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574005.908900:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788574005.908938:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001d14bbb4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681498624:0@lo:256: 10000000:01000000:0.0:1788574005.908980:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788574005.908987:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: 000000003d9e234f/0x5bf8706fdac8baf3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bafa expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574005.908995:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: 000000003d9e234f/0x5bf8706fdac8baf3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bafa expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574006.932537:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574007.443992:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788574007.444018:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000031ebd437 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69505170-06bc-41d1-9626-ab1a3c7f32a0:3619:1875455681498752:0@lo:400: 00000100:00100000:1.0:1788574007.444104:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574007.444130:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681498752 00000100:00100000:3.0:1788574007.444138:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681498752 00000100:00100000:1.0:1788574007.444161:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007e6c50b7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875455681498880:0@lo:400: 00000100:00100000:1.0:1788574007.444218:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574007.444256:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681498880 00000100:00100000:1.0:1788574007.444260:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681498880 00000100:00100000:3.0:1788574007.444287:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788574007.444287:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788574007.444294:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005d85ac1d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+12:3619:x1875455681498752:12345-0@lo:400: 00000100:00100000:1.0:1788574007.444295:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005f0e011c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875455681498880:12345-0@lo:400: 00000100:00100000:1.0:1788574007.444829:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005f0e011c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875455681498880:12345-0@lo:400: Request processed in 533us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574007.444837:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788574007.445703:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000007e6c50b7 x1875455681498880/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574023 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574007.445721:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007e6c50b7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875455681498880:0@lo:400: 00000100:00100000:3.0:1788574007.446520:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005d85ac1d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+12:3619:x1875455681498752:12345-0@lo:400: Request processed in 2225us (2416us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574007.446532:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788574007.446640:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000031ebd437 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69505170-06bc-41d1-9626-ab1a3c7f32a0:3619:1875455681498752:0@lo:400: 00010000:00010000:3.0:1788574007.956478:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574008.981564:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574010.005143:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574011.027871:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574012.051898:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574012.567114:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b781de6a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875455681499136:0@lo:400: 00000100:00100000:1.0:1788574012.567185:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574012.567235:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001d14bbb4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:69505170-06bc-41d1-9626-ab1a3c7f32a0:3618:1875455681499008:0@lo:400: 00000100:00100000:2.0:1788574012.567270:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574012.567281:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681499136 00000100:00100000:1.0:1788574012.567289:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681499136 00000100:00100000:2.0:1788574012.567314:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681499008 00000100:00100000:2.0:1788574012.567317:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681499008 00000100:00100000:1.0:1788574012.567332:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788574012.567339:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000031ebd437 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875455681499136:12345-0@lo:400: 00000100:00100000:2.0:1788574012.567360:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788574012.567365:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000385e9279 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+12:3618:x1875455681499008:12345-0@lo:400: 00000100:00100000:2.0:1788574012.567401:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000385e9279 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+12:3618:x1875455681499008:12345-0@lo:400: Request processed in 35us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574012.567401:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000031ebd437 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875455681499136:12345-0@lo:400: Request processed in 61us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574012.567408:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788574012.567408:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788574012.567445:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001d14bbb4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:69505170-06bc-41d1-9626-ab1a3c7f32a0:3618:1875455681499008:0@lo:400: 00010000:00080000:1.0:1788574012.567445:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000b781de6a x1875455681499136/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574028 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574012.567469:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b781de6a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875455681499136:0@lo:400: 00010000:00010000:3.0:1788574013.076570:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788574013.592450:0:7421:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788574013.592454:0:7421:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1788574013.592455:0:7421:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788574013.592588:0:7421:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000b8e99646 00000020:01000004:2.0:1788574013.592604:0:7421:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:2.0:1788574013.592614:0:7421:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788574013.592633:0:7421:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (00000000c70bfda3) 00000020:00000080:2.0:1788574013.592647:0:7421:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788574013.647146:0:7421:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:3.0:1788574013.647248:0:7421:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:3.0:1788574013.680608:0:7421:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788574013.681184:0:7421:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1788574013.681316:0:7421:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788574013.681408:0:7421:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5bf8706fdac8bb08 00000020:01000004:3.0:1788574013.681417:0:7421:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1788574013.681547:0:7421:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.151@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788574013.681552:0:7421:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.151@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788574013.681558:0:7421:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1788574013.681594:0:7421:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1788574013.681598:0:7421:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.151@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:0.0:1788574013.719180:0:7421:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.151@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788574013.719334:0:7421:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.204.151@tcp, index=0001, flags=0x20061 00000020:01000004:0.0:1788574013.719338:0:7421:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788574013.719340:0:7421:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788574013.719341:0:7421:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788574013.719342:0:7421:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788574013.719343:0:7421:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788574013.719344:0:7421:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788574013.719345:0:7421:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788574013.719346:0:7421:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788574013.719347:0:7421:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788574013.719349:0:7421:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788574013.719350:0:7421:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788574013.719353:0:7421:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:0.0:1788574013.719355:0:7421:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788574013.719356:0:7421:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788574013.719357:0:7421:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788574013.719358:0:7421:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788574013.719359:0:7421:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788574013.719360:0:7421:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788574013.719361:0:7421:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788574013.719362:0:7421:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788574013.719363:0:7421:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788574013.719364:0:7421:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788574013.719365:0:7421:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788574013.719394:0:7421:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1788574013.719413:0:7421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e41198da pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:7421:1875455681499264:0@lo:253: 00000100:00100000:0.0:1788574013.719490:0:7421:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574013.719666:0:7421:0:(client.c:2716:ptlrpc_set_wait()) set 00000000879e1e7a going to sleep for 11 seconds 00000100:00100000:2.0:1788574013.719911:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681499264 00000100:00100000:2.0:1788574013.719920:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681499264 00000100:00100000:2.0:1788574013.720004:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788574013.720014:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004cd8f958 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+12:7421:x1875455681499264:12345-0@lo:253: 20000000:01000000:2.0:1788574013.720049:0:6485:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788574013.720054:0:6485:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:2.0:1788574013.720059:0:6485:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:2.0:1788574013.720063:0:6485:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:2.0:1788574013.720102:0:6485:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:2.0:1788574013.721578:0:6485:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788574013.722871:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:3.0:1788574013.722901:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788574013.722930:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:3.0:1788574013.722949:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:3.0:1788574013.722965:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:3.0:1788574013.723161:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:3.0:1788574013.723170:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:3.0:1788574013.723183:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:3.0:1788574013.723348:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:3.0:1788574013.723370:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:3.0:1788574013.723376:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:3.0:1788574013.723388:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:3.0:1788574013.723402:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:3.0:1788574013.723502:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:3.0:1788574013.723512:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.151@tcp (null) (null) (null) 00000040:00080000:3.0:1788574013.723527:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:3.0:1788574013.723533:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788574013.723544:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:3.0:1788574013.723550:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.204.151@tcp (null) (null) 00000040:00080000:3.0:1788574013.723562:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:3.0:1788574013.723568:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1788574013.723580:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:3.0:1788574013.723608:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:3.0:1788574013.723619:0:6485:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:2.0:1788574013.723932:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:2.0:1788574013.723942:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:2.0:1788574013.723956:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:2.0:1788574013.723972:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:2.0:1788574013.723988:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:2.0:1788574013.723994:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:2.0:1788574013.724007:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:2.0:1788574013.724027:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:2.0:1788574013.724033:0:6485:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:2.0:1788574013.724059:0:6485:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1788574013.724066:0:6485:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:1.0:1788574013.725647:0:7427:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:2.0:1788574013.726173:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1788574013.726430:0:6485:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.151@tcp for mdt 20000000:01000000:2.0:1788574013.726434:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.151@tcp (null) (null) (null) 00000040:00080000:2.0:1788574013.726465:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1788574013.726473:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1788574013.726493:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1788574013.726499:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.204.151@tcp (null) (null) 00000040:00080000:2.0:1788574013.726515:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1788574013.726523:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:2.0:1788574013.726538:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:2.0:1788574013.726554:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:2.0:1788574013.726608:0:6485:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:2.0:1788574013.726618:0:6485:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:3.0:1788574013.727040:0:7428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:0.0:1788574013.727585:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1788574013.727608:0:6485:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.204.151@tcp for mdt 20000000:01000000:0.0:1788574013.727610:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.151@tcp (null) (null) (null) 00000040:00080000:0.0:1788574013.727624:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1788574013.727629:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788574013.727673:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1788574013.727680:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.204.151@tcp (null) (null) 00000040:00080000:0.0:1788574013.727696:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1788574013.727702:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:0.0:1788574013.727714:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1788574013.727895:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:0.0:1788574013.727924:0:6485:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788574013.727928:0:6485:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788574013.727931:0:6485:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788574013.728607:0:6485:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788574013.728610:0:6485:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788574013.729150:0:7429:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:0.0:1788574013.729181:0:7429:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:0.0:1788574013.729466:0:7429:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1788574013.729718:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1788574013.729827:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1788574013.729852:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:2.0:1788574013.729865:0:6485:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788574013.729867:0:6485:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788574013.730570:0:7430:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1788574013.730600:0:7430:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1788574013.730615:0:7430:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1788574013.730875:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:2.0:1788574013.730898:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:2.0:1788574013.730911:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:2.0:1788574013.730921:0:6485:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1788574013.730923:0:6485:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788574013.731560:0:7431:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:0.0:1788574013.731586:0:7431:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:0.0:1788574013.731599:0:7431:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:2.0:1788574013.731841:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:2.0:1788574013.731861:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:2.0:1788574013.731877:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:2.0:1788574013.731890:0:6485:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788574013.731893:0:6485:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788574013.731898:0:6485:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1788574013.731905:0:6485:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1788574013.732174:0:7432:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:2.0:1788574013.732594:0:6485:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788574013.743114:0:6485:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788574013.743717:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000c7dc3eeb/0x5bf8706fdac8bb0f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574013.743750:0:6485:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000ac844b1f/0x5bf8706fdac8ba44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8ba3d expref: 12 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574013.743756:0:6485:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000d49959d4/0x5bf8706fdac8ba60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8ba59 expref: 12 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574013.743762:0:6485:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000000a77489b/0x5bf8706fdac8bad0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8bac9 expref: 12 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574013.743784:0:6485:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000c7dc3eeb/0x5bf8706fdac8bb0f lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574013.743825:0:6485:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000000a77489b/0x5bf8706fdac8bad0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5bf8706fdac8bac9 expref: 12 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574013.743839:0:6485:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000000a77489b/0x5bf8706fdac8bad0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5bf8706fdac8bac9 expref: 12 pid: 6487 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574013.743853:0:6485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001226e7dc pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6485:1875455681499392:0@lo:104: 00000100:00100000:0.0:1788574013.743923:0:6485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788574013.743988:0:6485:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000d49959d4/0x5bf8706fdac8ba60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5bf8706fdac8ba59 expref: 12 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574013.743996:0:6485:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000d49959d4/0x5bf8706fdac8ba60 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5bf8706fdac8ba59 expref: 12 pid: 6486 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574013.744004:0:6485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e4db824e pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6485:1875455681499520:0@lo:104: 00000100:00100000:0.0:1788574013.744026:0:6485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788574013.744062:0:6485:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000ac844b1f/0x5bf8706fdac8ba44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5bf8706fdac8ba3d expref: 12 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574013.744070:0:6485:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000ac844b1f/0x5bf8706fdac8ba44 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5bf8706fdac8ba3d expref: 12 pid: 6485 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574013.744078:0:6485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000668d677f pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6485:1875455681499648:0@lo:104: 00000100:00100000:0.0:1788574013.744098:0:6485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574013.744108:0:6485:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ced296cb going to sleep for 11 seconds 00000100:00100000:1.0:1788574013.744306:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681499392 00000100:00100000:1.0:1788574013.744315:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681499392 00000100:00100000:1.0:1788574013.744364:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681499520 00000100:00100000:1.0:1788574013.744367:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681499520 00000100:00100000:1.0:1788574013.744377:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681499648 00000100:00100000:1.0:1788574013.744380:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681499648 00000100:00100000:1.0:1788574013.744392:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788574013.744399:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000018846334 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:69505170-06bc-41d1-9626-ab1a3c7f32a0+5:6485:x1875455681499392:12345-0@lo:104: 00010000:00010000:1.0:1788574013.744412:0:6475:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: 0000000055846700/0x5bf8706fdac8bac9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8bad0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574013.744470:0:6475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788574013.744476:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000018846334 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:69505170-06bc-41d1-9626-ab1a3c7f32a0+5:6485:x1875455681499392:12345-0@lo:104: Request processed in 78us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574013.744483:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788574013.744502:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788574013.744508:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000930c06e1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:69505170-06bc-41d1-9626-ab1a3c7f32a0+4:6485:x1875455681499520:12345-0@lo:104: 00010000:00010000:1.0:1788574013.744516:0:6475:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: 00000000e2dcc77a/0x5bf8706fdac8ba59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8ba60 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574013.744551:0:6475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788574013.744556:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000930c06e1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:69505170-06bc-41d1-9626-ab1a3c7f32a0+4:6485:x1875455681499520:12345-0@lo:104: Request processed in 49us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574013.744561:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788574013.744574:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788574013.744588:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dd184595 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:69505170-06bc-41d1-9626-ab1a3c7f32a0+3:6485:x1875455681499648:12345-0@lo:104: 00010000:00010000:1.0:1788574013.744596:0:6475:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: 0000000066d8bbf5/0x5bf8706fdac8ba3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8ba44 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574013.744624:0:6475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788574013.744628:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dd184595 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:69505170-06bc-41d1-9626-ab1a3c7f32a0+3:6485:x1875455681499648:12345-0@lo:104: Request processed in 41us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574013.744633:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1788574013.744663:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788574013.744668:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: 0000000055846700/0x5bf8706fdac8bac9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8bad0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574013.744674:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000055846700 already unused, calling callback (000000002f942c2d) 10000000:00010000:1.0:1788574013.744677:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: 0000000055846700/0x5bf8706fdac8bac9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5bf8706fdac8bad0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574013.744685:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: 0000000055846700/0x5bf8706fdac8bac9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5bf8706fdac8bad0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788574013.744691:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: 0000000055846700/0x5bf8706fdac8bac9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5bf8706fdac8bad0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788574013.744697:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788574013.744727:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: 0000000055846700/0x5bf8706fdac8bac9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bad0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574013.744734:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788574013.744762:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: 0000000055846700/0x5bf8706fdac8bac9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bad0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574013.744779:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: 0000000055846700/0x5bf8706fdac8bac9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bad0 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574013.744795:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788574013.744798:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: 00000000e2dcc77a/0x5bf8706fdac8ba59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8ba60 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574013.744803:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e2dcc77a already unused, calling callback (000000002f942c2d) 10000000:00010000:1.0:1788574013.744805:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: 00000000e2dcc77a/0x5bf8706fdac8ba59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5bf8706fdac8ba60 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574013.744811:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: 00000000e2dcc77a/0x5bf8706fdac8ba59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5bf8706fdac8ba60 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788574013.744816:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: 00000000e2dcc77a/0x5bf8706fdac8ba59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5bf8706fdac8ba60 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788574013.744821:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788574013.744835:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: 00000000e2dcc77a/0x5bf8706fdac8ba59 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8ba60 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574013.744840:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788574013.744856:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: 00000000e2dcc77a/0x5bf8706fdac8ba59 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8ba60 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574013.744862:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: 00000000e2dcc77a/0x5bf8706fdac8ba59 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8ba60 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574013.744871:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788574013.744879:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: 0000000066d8bbf5/0x5bf8706fdac8ba3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8ba44 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574013.744884:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000066d8bbf5 already unused, calling callback (000000002f942c2d) 10000000:00010000:1.0:1788574013.744886:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: 0000000066d8bbf5/0x5bf8706fdac8ba3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5bf8706fdac8ba44 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574013.744892:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: 0000000066d8bbf5/0x5bf8706fdac8ba3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5bf8706fdac8ba44 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788574013.744897:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: 0000000066d8bbf5/0x5bf8706fdac8ba3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5bf8706fdac8ba44 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788574013.744902:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788574013.744914:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: 0000000066d8bbf5/0x5bf8706fdac8ba3d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8ba44 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574013.744920:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788574013.744924:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: 0000000066d8bbf5/0x5bf8706fdac8ba3d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8ba44 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574013.744930:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: 0000000066d8bbf5/0x5bf8706fdac8ba3d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8ba44 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574013.744942:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574013.744943:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574013.744945:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574013.744964:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fe4a125e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:69505170-06bc-41d1-9626-ab1a3c7f32a0:3620:1875455681499776:0@lo:103: 00000100:00100000:1.0:1788574013.744994:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574013.745038:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b86e7c50 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:69505170-06bc-41d1-9626-ab1a3c7f32a0:3617:1875455681499904:0@lo:103: 00000100:00100000:1.0:1788574013.745072:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574013.745092:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788574013.745097:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f5b49498 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:69505170-06bc-41d1-9626-ab1a3c7f32a0:3617:1875455681500032:0@lo:103: 00000100:00100000:1.0:1788574013.745114:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574013.745147:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681499776 00000100:00100000:1.0:1788574013.745151:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681499776 00010000:00010000:1.0:1788574013.745169:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000000a77489b/0x5bf8706fdac8bad0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8bac9 expref: 13 pid: 6487 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574013.745186:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681499904 00000100:00100000:1.0:1788574013.745502:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681499904 00010000:00010000:1.0:1788574013.745518:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000d49959d4/0x5bf8706fdac8ba60 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8ba59 expref: 14 pid: 6486 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574013.745533:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681500032 00000100:00100000:1.0:1788574013.745536:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681500032 00010000:00010000:1.0:1788574013.745546:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000ac844b1f/0x5bf8706fdac8ba44 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8ba3d expref: 15 pid: 6485 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574013.745558:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788574013.745564:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a1ff1fe2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:69505170-06bc-41d1-9626-ab1a3c7f32a0+15:3620:x1875455681499776:12345-0@lo:103: 00010000:00010000:1.0:1788574013.745573:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574013.745578:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000000a77489b/0x5bf8706fdac8bad0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8bac9 expref: 15 pid: 6487 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574013.745587:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000000a77489b/0x5bf8706fdac8bad0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5bf8706fdac8bac9 expref: 15 pid: 6487 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574013.745604:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788574013.745642:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a1ff1fe2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:69505170-06bc-41d1-9626-ab1a3c7f32a0+15:3620:x1875455681499776:12345-0@lo:103: Request processed in 79us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574013.745667:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788574013.745685:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788574013.745690:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000337a8c3e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:69505170-06bc-41d1-9626-ab1a3c7f32a0+14:3617:x1875455681499904:12345-0@lo:103: 00010000:00010000:1.0:1788574013.745697:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574013.745700:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000d49959d4/0x5bf8706fdac8ba60 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8ba59 expref: 14 pid: 6486 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574013.745708:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000d49959d4/0x5bf8706fdac8ba60 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5bf8706fdac8ba59 expref: 14 pid: 6486 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574013.745719:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788574013.745743:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574013.745934:0:6477:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1788574013.745943:0:6477:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1788574013.745959:0:6479:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1788574013.745968:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788574013.745977:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006bd39e7c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69505170-06bc-41d1-9626-ab1a3c7f32a0+14:3617:x1875455681500032:12345-0@lo:103: 00010000:00010000:0.0:1788574013.745982:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000a77489b/0x5bf8706fdac8bad0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5bf8706fdac8bac9 expref: 14 pid: 6487 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574013.745987:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574013.745994:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000ac844b1f/0x5bf8706fdac8ba44 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8ba3d expref: 14 pid: 6485 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574013.746005:0:6485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001226e7dc pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6485:1875455681499392:0@lo:104: 00010000:00010000:3.0:1788574013.746008:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000ac844b1f/0x5bf8706fdac8ba44 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5bf8706fdac8ba3d expref: 13 pid: 6485 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574013.746021:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d49959d4/0x5bf8706fdac8ba60 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5bf8706fdac8ba59 expref: 13 pid: 6486 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574013.746024:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000c7dc3eeb/0x5bf8706fdac8bb0f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574013.746035:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c7dc3eeb/0x5bf8706fdac8bb0f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574013.746035:0:6485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e4db824e pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6485:1875455681499520:0@lo:104: 00010000:00010000:0.0:1788574013.746049:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ac844b1f/0x5bf8706fdac8ba44 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5bf8706fdac8ba3d expref: 12 pid: 6485 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574013.746054:0:6479:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c7dc3eeb/0x5bf8706fdac8bb0f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574013.746059:0:6485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000668d677f pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6485:1875455681499648:0@lo:104: 00010000:00010000:3.0:1788574013.746065:0:6479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c7dc3eeb/0x5bf8706fdac8bb0f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574013.746073:0:6479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000c7dc3eeb/0x5bf8706fdac8bb0f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574013.746079:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000c7dc3eeb/0x5bf8706fdac8bb0f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574013.746086:0:6485:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000c7dc3eeb/0x5bf8706fdac8bb0f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574013.746102:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c7dc3eeb already unused, calling callback (0000000000887628) 00010000:00010000:0.0:1788574013.746105:0:6485:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGS lock: 00000000c7dc3eeb/0x5bf8706fdac8bb0f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574013.746107:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000c7dc3eeb/0x5bf8706fdac8bb0f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574013.746118:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000c7dc3eeb/0x5bf8706fdac8bb0f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574013.746122:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000c7dc3eeb/0x5bf8706fdac8bb0f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788574013.746134:0:6485:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00010000:00010000:3.0:1788574013.746135:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000c7dc3eeb/0x5bf8706fdac8bb0f lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574013.746144:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c7dc3eeb/0x5bf8706fdac8bb0f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574013.746160:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788574013.746231:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006bd39e7c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69505170-06bc-41d1-9626-ab1a3c7f32a0+11:3617:x1875455681500032:12345-0@lo:103: Request processed in 255us (1114us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574013.746238:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788574013.746251:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f5b49498 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:69505170-06bc-41d1-9626-ab1a3c7f32a0:3617:1875455681500032:0@lo:103: 00000100:00100000:2.0:1788574013.746508:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fe4a125e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:69505170-06bc-41d1-9626-ab1a3c7f32a0:3620:1875455681499776:0@lo:103: 00000100:00100000:1.0:1788574013.746650:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000337a8c3e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:69505170-06bc-41d1-9626-ab1a3c7f32a0+10:3617:x1875455681499904:12345-0@lo:103: Request processed in 959us (1577us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574013.746668:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788574013.748059:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b86e7c50 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:69505170-06bc-41d1-9626-ab1a3c7f32a0:3617:1875455681499904:0@lo:103: 00000100:00100000:0.0:1788574013.750035:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004cd8f958 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+9:7421:x1875455681499264:12345-0@lo:253: Request processed in 30014us (30536us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574013.750050:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788574013.750577:0:7421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e41198da pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:7421:1875455681499264:0@lo:253: 10000000:01000000:1.0:1788574013.750595:0:7421:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1788574013.750598:0:7421:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788574013.750600:0:7421:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788574013.750601:0:7421:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788574013.750602:0:7421:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:1.0:1788574013.750603:0:7421:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788574013.750604:0:7421:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788574013.750605:0:7421:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788574013.750607:0:7421:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1788574013.750608:0:7421:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788574013.750609:0:7421:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788574013.750626:0:7421:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000b8e99646 from lustre-MDT0001 10000000:01000000:1.0:1788574013.750672:0:7421:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:1.0:1788574013.750674:0:7421:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1788574013.750681:0:7421:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9c85e56999c0 local copy 10000000:01000000:1.0:1788574013.750685:0:7421:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788574013.750745:0:7421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: 00000000a40cbdcf/0x5bf8706fdac8bb16 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574013.750755:0:7421:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.151@tcp lock: 00000000a40cbdcf/0x5bf8706fdac8bb16 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574013.750763:0:7421:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: 00000000a40cbdcf/0x5bf8706fdac8bb16 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574013.750780:0:7421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009a62ed24 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:7421:1875455681500160:0@lo:101: 00000100:00100000:1.0:1788574013.750824:0:7421:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574013.750912:0:7421:0:(client.c:2716:ptlrpc_set_wait()) set 00000000017446cd going to sleep for 11 seconds 00000100:00100000:2.0:1788574013.751425:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681500160 00000100:00100000:2.0:1788574013.751433:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681500160 00000100:00100000:1.0:1788574013.751860:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788574013.751871:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b663c7bb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+9:7421:x1875455681500160:12345-0@lo:101: 00010000:00010000:1.0:1788574013.751886:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574013.751901:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000021220d68/0x5bf8706fdac8bb1d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8bb16 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574013.751931:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000021220d68/0x5bf8706fdac8bb1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8bb16 expref: 10 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574013.751942:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000021220d68/0x5bf8706fdac8bb1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8bb16 expref: 10 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574013.751951:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000021220d68, rc 0) 00000100:00100000:1.0:1788574013.752013:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b663c7bb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+10:7421:x1875455681500160:12345-0@lo:101: Request processed in 145us (1189us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574013.752020:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788574013.752096:0:7421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009a62ed24 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:7421:1875455681500160:0@lo:101: 00010000:00010000:0.0:1788574013.752113:0:7421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: 00000000a40cbdcf/0x5bf8706fdac8bb16 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x5bf8706fdac8bb1d expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574013.752148:0:7421:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: 00000000a40cbdcf/0x5bf8706fdac8bb16 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x5bf8706fdac8bb1d expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574013.752299:0:7421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000668d677f pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:7421:1875455681500288:0@lo:501: 00000100:00100000:0.0:1788574013.752339:0:7421:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574013.753131:0:7421:0:(client.c:2716:ptlrpc_set_wait()) set 000000004af33ae5 going to sleep for 11 seconds 00000100:00100000:3.0:1788574013.753437:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681500288 00000100:00100000:3.0:1788574013.753444:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681500288 00000100:00100000:3.0:1788574013.753484:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788574013.753491:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000003b35f9a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+10:7421:x1875455681500288:12345-0@lo:501: 00000100:00100000:3.0:1788574013.753620:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000003b35f9a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+10:7421:x1875455681500288:12345-0@lo:501: Request processed in 129us (1291us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788574013.753628:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788574013.753914:0:7421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000668d677f pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:7421:1875455681500288:0@lo:501: 10000000:01000000:0.0:1788574013.753934:0:7421:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.151@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788574013.753957:0:7421:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.151@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788574013.753962:0:7421:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: 00000000a40cbdcf/0x5bf8706fdac8bb16 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x5bf8706fdac8bb1d expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574013.753972:0:7421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: 00000000a40cbdcf/0x5bf8706fdac8bb16 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x5bf8706fdac8bb1d expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574013.753977:0:7421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.151@tcp lock: 00000000a40cbdcf/0x5bf8706fdac8bb16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x5bf8706fdac8bb1d expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574013.754157:0:7421:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788574013.754402:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788574013.754408:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: 00000000a40cbdcf/0x5bf8706fdac8bb16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x5bf8706fdac8bb1d expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574013.754428:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a40cbdcf already unused, calling callback (000000002f942c2d) 10000000:00010000:1.0:1788574013.754432:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: 00000000a40cbdcf/0x5bf8706fdac8bb16 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x5bf8706fdac8bb1d expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574013.754439:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: 00000000a40cbdcf/0x5bf8706fdac8bb16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x5bf8706fdac8bb1d expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788574013.754445:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: 00000000a40cbdcf/0x5bf8706fdac8bb16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x5bf8706fdac8bb1d expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788574013.754451:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788574013.754481:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: 00000000a40cbdcf/0x5bf8706fdac8bb16 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x5bf8706fdac8bb1d expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574013.754488:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788574013.754545:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000aa24c528 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69505170-06bc-41d1-9626-ab1a3c7f32a0:3619:1875455681500416:0@lo:103: 00000100:00100000:2.0:1788574013.754593:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788574013.754665:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: 00000000a40cbdcf/0x5bf8706fdac8bb16 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x5bf8706fdac8bb1d expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574013.754673:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: 00000000a40cbdcf/0x5bf8706fdac8bb16 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x5bf8706fdac8bb1d expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574013.754691:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574013.754693:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574013.754695:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574013.754736:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681500416 00000100:00100000:3.0:1788574013.754742:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681500416 00000100:00100000:3.0:1788574013.754791:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788574013.754798:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bc1fe8c2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69505170-06bc-41d1-9626-ab1a3c7f32a0+10:3619:x1875455681500416:12345-0@lo:103: 00010000:00010000:3.0:1788574013.754829:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574013.754842:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000021220d68/0x5bf8706fdac8bb1d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5bf8706fdac8bb16 expref: 10 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574013.754856:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788574013.754897:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bc1fe8c2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69505170-06bc-41d1-9626-ab1a3c7f32a0+9:3619:x1875455681500416:12345-0@lo:103: Request processed in 101us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574013.754904:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788574013.755031:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000aa24c528 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69505170-06bc-41d1-9626-ab1a3c7f32a0:3619:1875455681500416:0@lo:103: 10000000:01000000:0.0:1788574013.755141:0:7421:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c85fa390800 10000000:01000000:0.0:1788574013.755148:0:7421:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788574013.755153:0:7421:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9c85e56999c0 10000000:01000000:0.0:1788574013.755156:0:7421:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1788574013.755159:0:7421:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9c85e56999c0 from 1 10000000:01000000:0.0:1788574013.755162:0:7421:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788574013.755185:0:7421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: 000000002e6bf012/0x5bf8706fdac8bb24 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574013.755641:0:7421:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: 000000002e6bf012/0x5bf8706fdac8bb24 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574013.755661:0:7421:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: 000000002e6bf012/0x5bf8706fdac8bb24 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574013.755678:0:7421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000668d677f pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:7421:1875455681500544:0@lo:101: 00000100:00100000:0.0:1788574013.755714:0:7421:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574013.755771:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681500544 00000100:00100000:3.0:1788574013.755777:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681500544 00000100:00100000:0.0:1788574013.755823:0:7421:0:(client.c:2716:ptlrpc_set_wait()) set 000000005903dab6 going to sleep for 11 seconds 00000100:00100000:3.0:1788574013.755828:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788574013.755835:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f096ae12 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+9:7421:x1875455681500544:12345-0@lo:101: 00010000:00010000:3.0:1788574013.755844:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574013.755856:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008bb15287/0x5bf8706fdac8bb2b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8bb24 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574013.755877:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008bb15287/0x5bf8706fdac8bb2b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8bb24 expref: 10 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574013.755886:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008bb15287/0x5bf8706fdac8bb2b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8bb24 expref: 10 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574013.755892:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008bb15287, rc 0) 00000100:00100000:3.0:1788574013.755930:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f096ae12 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+10:7421:x1875455681500544:12345-0@lo:101: Request processed in 97us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574013.755936:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788574013.755954:0:7421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000668d677f pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:7421:1875455681500544:0@lo:101: 00010000:00010000:0.0:1788574013.755966:0:7421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: 000000002e6bf012/0x5bf8706fdac8bb24 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bb2b expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574013.755979:0:7421:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: 000000002e6bf012/0x5bf8706fdac8bb24 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8bb2b expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788574013.755996:0:7421:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788574013.756015:0:7421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: 000000002e6bf012/0x5bf8706fdac8bb24 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bb2b expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574013.756022:0:7421:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: 000000002e6bf012/0x5bf8706fdac8bb24 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bb2b expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788574013.756030:0:7421:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9c85fa390800 10000000:01000000:0.0:1788574013.756033:0:7421:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788574013.756037:0:7421:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9c85fa390800 from 1 10000000:01000000:0.0:1788574013.756039:0:7421:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788574013.756810:0:7421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: 00000000a7ccca15/0x5bf8706fdac8bb32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574013.756832:0:7421:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: 00000000a7ccca15/0x5bf8706fdac8bb32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574013.756840:0:7421:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: 00000000a7ccca15/0x5bf8706fdac8bb32 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574013.756854:0:7421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000668d677f pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:7421:1875455681500672:0@lo:101: 00000100:00100000:0.0:1788574013.756891:0:7421:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574013.756922:0:7421:0:(client.c:2716:ptlrpc_set_wait()) set 000000005903dab6 going to sleep for 11 seconds 00000100:00100000:2.0:1788574013.756998:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681500672 00000100:00100000:2.0:1788574013.757004:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681500672 00000100:00100000:2.0:1788574013.757041:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788574013.757046:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000043543209 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+10:7421:x1875455681500672:12345-0@lo:101: 00010000:00010000:2.0:1788574013.757055:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574013.757064:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000349890ea/0x5bf8706fdac8bb39 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8bb32 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574013.757082:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000349890ea/0x5bf8706fdac8bb39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8bb32 expref: 11 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574013.757090:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000349890ea/0x5bf8706fdac8bb39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8bb32 expref: 11 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574013.757097:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000349890ea, rc 0) 00000100:00100000:2.0:1788574013.757134:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000043543209 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+11:7421:x1875455681500672:12345-0@lo:101: Request processed in 89us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574013.757140:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788574013.757531:0:7421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000668d677f pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:7421:1875455681500672:0@lo:101: 00010000:00010000:1.0:1788574013.757548:0:7421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: 00000000a7ccca15/0x5bf8706fdac8bb32 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bb39 expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574013.757555:0:7421:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: 00000000a7ccca15/0x5bf8706fdac8bb32 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8bb39 expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788574013.757578:0:7421:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788574013.757588:0:7421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: 00000000a7ccca15/0x5bf8706fdac8bb32 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bb39 expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574013.757594:0:7421:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: 00000000a7ccca15/0x5bf8706fdac8bb32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bb39 expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788574013.757602:0:7421:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1788574013.757606:0:7421:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788574013.757611:0:7421:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9c85fa390800 10000000:01000000:1.0:1788574013.757614:0:7421:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788574013.757618:0:7421:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:1.0:1788574013.757620:0:7421:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1788574013.757639:0:7421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: 0000000055846700/0x5bf8706fdac8bb40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574013.757646:0:7421:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: 0000000055846700/0x5bf8706fdac8bb40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574013.757660:0:7421:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: 0000000055846700/0x5bf8706fdac8bb40 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574013.757674:0:7421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000d2321f2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:7421:1875455681500800:0@lo:101: 00000100:00100000:1.0:1788574013.757706:0:7421:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574013.757736:0:7421:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c1a318dc going to sleep for 11 seconds 00000100:00100000:3.0:1788574013.757782:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681500800 00000100:00100000:3.0:1788574013.757787:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681500800 00000100:00100000:3.0:1788574013.757823:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788574013.757837:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000b578582 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+11:7421:x1875455681500800:12345-0@lo:101: 00010000:00010000:3.0:1788574013.757845:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574013.757853:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a0e0e36b/0x5bf8706fdac8bb47 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8bb40 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574013.757868:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a0e0e36b/0x5bf8706fdac8bb47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8bb40 expref: 12 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574013.757876:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a0e0e36b/0x5bf8706fdac8bb47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8bb40 expref: 12 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574013.757883:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a0e0e36b, rc 0) 00000100:00100000:3.0:1788574013.757919:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000b578582 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+12:7421:x1875455681500800:12345-0@lo:101: Request processed in 84us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574013.757925:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788574013.757984:0:7421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000d2321f2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:7421:1875455681500800:0@lo:101: 00010000:00010000:1.0:1788574013.757993:0:7421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: 0000000055846700/0x5bf8706fdac8bb40 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bb47 expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574013.758006:0:7421:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: 0000000055846700/0x5bf8706fdac8bb40 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8bb47 expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574013.758080:0:7421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000d2321f2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:7421:1875455681500928:0@lo:501: 00000100:00100000:1.0:1788574013.758099:0:7421:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574013.758121:0:7421:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c1a318dc going to sleep for 11 seconds 00000100:00100000:0.0:1788574013.758167:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681500928 00000100:00100000:0.0:1788574013.758171:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681500928 00000100:00100000:0.0:1788574013.758409:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788574013.758416:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003dc4411c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+12:7421:x1875455681500928:12345-0@lo:501: 00000100:00100000:0.0:1788574013.758528:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003dc4411c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+12:7421:x1875455681500928:12345-0@lo:501: Request processed in 109us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574013.758536:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788574013.758609:0:7421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000d2321f2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:7421:1875455681500928:0@lo:501: 00000100:00100000:1.0:1788574013.758636:0:7421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000d2321f2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:7421:1875455681501056:0@lo:503: 00000100:00100000:1.0:1788574013.758685:0:7421:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574013.758714:0:7421:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c1a318dc going to sleep for 11 seconds 00000100:00100000:3.0:1788574013.758739:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681501056 00000100:00100000:3.0:1788574013.758743:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681501056 00000100:00100000:3.0:1788574013.758776:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788574013.758783:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000246faf7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+12:7421:x1875455681501056:12345-0@lo:503: 00000100:00100000:3.0:1788574013.758872:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000246faf7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+12:7421:x1875455681501056:12345-0@lo:503: Request processed in 89us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574013.758878:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788574013.758897:0:7421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000d2321f2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:7421:1875455681501056:0@lo:503: 00000040:00080000:1.0:1788574013.759162:0:7421:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788574013.759645:0:7421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000d2321f2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:7421:1875455681501184:0@lo:502: 00000100:00100000:1.0:1788574013.759701:0:7421:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574013.759726:0:7421:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c1a318dc going to sleep for 11 seconds 00000100:00100000:0.0:1788574013.759951:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681501184 00000100:00100000:0.0:1788574013.759957:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681501184 00000100:00100000:0.0:1788574013.759995:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788574013.760002:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002b2fc3bf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+12:7421:x1875455681501184:12345-0@lo:502: 00000100:00100000:0.0:1788574013.760110:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002b2fc3bf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+12:7421:x1875455681501184:12345-0@lo:502: Request processed in 109us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574013.760117:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788574013.760677:0:7421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000d2321f2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:7421:1875455681501184:0@lo:502: 00000040:00080000:1.0:1788574013.760945:0:7421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788574013.760976:0:7421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:1.0:1788574013.760990:0:7421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:1.0:1788574013.761004:0:7421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:1.0:1788574013.761522:0:7421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:1.0:1788574013.761549:0:7421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:1.0:1788574013.761565:0:7421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:1.0:1788574013.761580:0:7421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:1.0:1788574013.761593:0:7421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:1.0:1788574013.761623:0:7421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:1.0:1788574013.761667:0:7421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:1.0:1788574013.761682:0:7421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:1.0:1788574013.761695:0:7421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:1.0:1788574013.761707:0:7421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:1.0:1788574013.761720:0:7421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:1.0:1788574013.761734:0:7421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:1.0:1788574013.761747:0:7421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:1.0:1788574013.761759:0:7421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:1.0:1788574013.761772:0:7421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:1.0:1788574013.761783:0:7421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:1.0:1788574013.761796:0:7421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:1.0:1788574013.761809:0:7421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:1.0:1788574013.761822:0:7421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:1.0:1788574013.761854:0:7421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000d2321f2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:7421:1875455681501312:0@lo:502: 00000100:00100000:1.0:1788574013.761915:0:7421:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574013.762013:0:7421:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c1a318dc going to sleep for 11 seconds 00000100:00100000:3.0:1788574013.762059:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681501312 00000100:00100000:3.0:1788574013.762066:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681501312 00000100:00100000:3.0:1788574013.762113:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788574013.762120:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001dc614ae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+12:7421:x1875455681501312:12345-0@lo:502: 00000100:00100000:3.0:1788574013.762398:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001dc614ae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+12:7421:x1875455681501312:12345-0@lo:502: Request processed in 277us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574013.762415:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788574013.762481:0:7421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000d2321f2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:7421:1875455681501312:0@lo:502: 00000040:00080000:1.0:1788574013.762526:0:7421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:1.0:1788574013.762535:0:7421:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:2.0:1788574013.763002:0:7434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788574013.763015:0:7434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574013.763017:0:7434:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1788574013.763023:0:7434:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:2.0:1788574013.763032:0:7434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788574013.763045:0:7434:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (000000007f898732) 00000020:00000080:2.0:1788574013.763065:0:7434:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:2.0:1788574013.763073:0:7434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788574013.763167:0:7434:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788574013.763175:0:7434:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5bf8706fdac8bb55 00000020:00000080:2.0:1788574013.764683:0:7434:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1788574013.764691:0:7434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788574013.764696:0:7434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574013.764698:0:7434:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1788574013.764701:0:7434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788574013.764705:0:7434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574013.764706:0:7434:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:2.0:1788574013.764709:0:7434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788574013.764718:0:7434:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (0000000034078cfe) 00000020:00000080:2.0:1788574013.764798:0:7434:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:2.0:1788574013.764805:0:7434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788574013.764807:0:7434:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:2.0:1788574013.764809:0:7434:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:2.0:1788574013.764815:0:7434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788574013.764877:0:7434:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000b8e99646 from lustre-MDT0001, refs=2 00000020:00000080:2.0:1788574013.764900:0:7434:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (00000000562e0cd0) 00000020:00000080:2.0:1788574013.764911:0:7434:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:2.0:1788574013.764986:0:7434:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788574013.764993:0:7434:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5bf8706fdac8bb6a 00000020:00000080:2.0:1788574013.765102:0:7434:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:2.0:1788574013.765109:0:7434:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788574013.765114:0:7434:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x5bf8706fdac8bb71 00080000:01000000:2.0:1788574013.765121:0:7434:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788574013.765124:0:7434:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5bf8706fdac8bb78 00080000:10000000:2.0:1788574013.766136:0:7434:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:2.0:1788574013.766319:0:7434:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:0.0:1788574013.877023:0:7434:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:0.0:1788574013.877410:0:7434:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:0.0:1788574013.882852:0:7434:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:0.0:1788574013.883283:0:7434:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788574013.902966:0:7434:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1788574013.902982:0:7434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788574013.902989:0:7434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574013.902991:0:7434:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1788574013.902995:0:7434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788574013.903001:0:7434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574013.903002:0:7434:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1788574013.903005:0:7434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788574013.903011:0:7434:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.151@tcp to nid 0x20000c0a8cc97 (192.168.204.151@tcp) 00000020:00000080:3.0:1788574013.903050:0:7434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788574013.903065:0:7434:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (0000000021bb6e35) 00000020:00000080:3.0:1788574013.903087:0:7434:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1788574013.903103:0:7434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788574013.904678:0:7434:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1788574013.904690:0:7434:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788574013.904702:0:7434:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5bf8706fdac8bb86 00010000:00080000:3.0:1788574013.904751:0:7434:0:(ldlm_lib.c:102:import_set_conn()) imp 000000006a023ef8@lustre-MDT0000-osp-MDT0001: add connection 192.168.204.151@tcp at head 00010000:00010000:3.0:1788574013.911166:0:7434:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:3.0:1788574013.924851:0:7434:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788574013.924869:0:7434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1788574013.924914:0:7434:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788574013.924999:0:7434:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5bf8706fdac8bb8d 00000100:00080000:3.0:1788574013.925014:0:7434:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788574013.925021:0:7434:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 000000006a023ef8 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:3.0:1788574013.925057:0:7434:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000001c9e4f3c x1875455681501440/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788574013.925088:0:7434:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:3.0:1788574013.925182:0:7434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788574013.925214:0:7434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574013.925215:0:7434:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:3.0:1788574013.925220:0:7434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788574013.925223:0:7434:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1788574013.925225:0:7434:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788574013.925226:0:7434:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788574013.925227:0:7434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788574013.925229:0:7434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574013.925231:0:7434:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788574013.925233:0:7434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788574013.925237:0:7434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574013.925238:0:7434:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:3.0:1788574013.925242:0:7434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788574013.925255:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788574013.925268:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000d2321f2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875455681501568:0@lo:400: 00000004:01000000:3.0:1788574013.925272:0:7434:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788574013.925284:0:7434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788574013.925287:0:7434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574013.925288:0:7434:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:3.0:1788574013.925290:0:7434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788574013.925292:0:7434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574013.925293:0:7434:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788574013.925296:0:7434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788574013.925297:0:7434:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788574013.925323:0:7434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788574013.925326:0:7434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574013.925326:0:7434:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788574013.925330:0:7434:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000100:00100000:1.0:1788574013.925349:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574013.925408:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681501568 00000100:00100000:1.0:1788574013.925413:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681501568 00000100:00100000:1.0:1788574013.925463:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788574013.925467:0:6492:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788574013.925470:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004b5125b7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875455681501568:12345-0@lo:400: 00000100:00100000:3.0:1788574013.925474:0:6492:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1788574013.925521:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004b5125b7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875455681501568:12345-0@lo:400: Request processed in 52us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574013.925528:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788574013.925569:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000000d2321f2 x1875455681501568/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574029 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574013.925582:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000d2321f2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875455681501568:0@lo:400: 00000020:01000000:1.0:1788574013.925615:0:7421:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:1.0:1788574013.925643:0:7421:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1788574013.925675:0:7421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: 0000000055846700/0x5bf8706fdac8bb40 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bb47 expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574013.925686:0:7421:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: 0000000055846700/0x5bf8706fdac8bb40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bb47 expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788574013.925693:0:7421:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c85fa390800 from 1 10000000:01000000:1.0:1788574013.925696:0:7421:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788574013.925719:0:7421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: 00000000a40cbdcf/0x5bf8706fdac8bb94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574013.925725:0:7421:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: 00000000a40cbdcf/0x5bf8706fdac8bb94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574013.925735:0:7421:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: 00000000a40cbdcf/0x5bf8706fdac8bb94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574013.925748:0:7421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000d2321f2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:7421:1875455681501696:0@lo:101: 00000100:00100000:1.0:1788574013.925777:0:7421:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574013.925800:0:7421:0:(client.c:2716:ptlrpc_set_wait()) set 00000000227f3a7f going to sleep for 11 seconds 00000100:00100000:1.0:1788574013.925816:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681501696 00000100:00100000:1.0:1788574013.925820:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681501696 00000100:00100000:1.0:1788574013.925850:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788574013.925857:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000001488c98 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+12:7421:x1875455681501696:12345-0@lo:101: 00010000:00010000:1.0:1788574013.925872:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574013.925883:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000077047f3f/0x5bf8706fdac8bb9b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8bb94 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574013.925906:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000077047f3f/0x5bf8706fdac8bb9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8bb94 expref: 13 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574013.925916:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000077047f3f/0x5bf8706fdac8bb9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8bb94 expref: 13 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574013.925924:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000077047f3f, rc 0) 00000100:00100000:1.0:1788574013.925969:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000001488c98 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+13:7421:x1875455681501696:12345-0@lo:101: Request processed in 113us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574013.925980:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788574013.925994:0:7421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000d2321f2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:7421:1875455681501696:0@lo:101: 00010000:00010000:2.0:1788574013.926014:0:7421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: 00000000a40cbdcf/0x5bf8706fdac8bb94 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bb9b expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574013.926022:0:7421:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: 00000000a40cbdcf/0x5bf8706fdac8bb94 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8bb9b expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574013.926596:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001c9e4f3c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1875455681501440:0@lo:38: 00000100:00100000:0.0:1788574013.926637:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574013.926750:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681501440 00000100:00100000:1.0:1788574013.926756:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681501440 00000100:00100000:1.0:1788574013.926817:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788574013.926823:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e4db824e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3616:x1875455681501440:12345-0@lo:38: 00010000:00080000:1.0:1788574013.926844:0:6497:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 153 last 0 00000020:00000080:1.0:1788574013.926877:0:6497:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5bf8706fdac8bba2 00000004:00100000:1.0:1788574013.926892:0:6497:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1788574013.926900:0:6497:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:2.0:1788574013.927661:0:7421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008ecca1b3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:7421:1875455681501824:0@lo:256: 00000100:00100000:2.0:1788574013.927719:0:7421:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574013.927751:0:7421:0:(client.c:2716:ptlrpc_set_wait()) set 0000000062c1ddc4 going to sleep for 11 seconds 00000100:00100000:1.0:1788574013.927811:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681501824 00000100:00100000:1.0:1788574013.927816:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681501824 00000100:00100000:1.0:1788574013.928344:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788574013.928354:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f6e51085 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+13:7421:x1875455681501824:12345-0@lo:256: 20000000:01000000:1.0:1788574013.928374:0:6486:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788574013.928394:0:6486:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788574013.928402:0:6486:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1788574013.928612:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f6e51085 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+13:7421:x1875455681501824:12345-0@lo:256: Request processed in 259us (892us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574013.928620:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788574013.928834:0:7421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008ecca1b3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:7421:1875455681501824:0@lo:256: 10000000:01000000:2.0:1788574013.930640:0:7421:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788574013.930676:0:7421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: 00000000a40cbdcf/0x5bf8706fdac8bb94 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bb9b expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574013.930688:0:7421:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: 00000000a40cbdcf/0x5bf8706fdac8bb94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bb9b expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788574013.930697:0:7421:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c85fa390800 from 1 10000000:01000000:2.0:1788574013.930700:0:7421:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788574013.930740:0:7421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: 000000005d1084fd/0x5bf8706fdac8bba9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574013.930747:0:7421:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: 000000005d1084fd/0x5bf8706fdac8bba9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574013.930756:0:7421:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: 000000005d1084fd/0x5bf8706fdac8bba9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574013.930773:0:7421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008ecca1b3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:7421:1875455681501952:0@lo:101: 00000100:00100000:2.0:1788574013.930846:0:7421:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574013.930889:0:7421:0:(client.c:2716:ptlrpc_set_wait()) set 0000000062c1ddc4 going to sleep for 11 seconds 00000100:00100000:1.0:1788574013.931252:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681501952 00000100:00100000:1.0:1788574013.931261:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681501952 00000100:00100000:1.0:1788574013.932207:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788574013.932219:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000051023857 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+13:7421:x1875455681501952:12345-0@lo:101: 00010000:00010000:1.0:1788574013.932234:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574013.932249:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000008011b35/0x5bf8706fdac8bbb0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8bba9 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574013.932273:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000008011b35/0x5bf8706fdac8bbb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8bba9 expref: 14 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574013.932283:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000008011b35/0x5bf8706fdac8bbb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8bba9 expref: 14 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574013.932797:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000008011b35, rc 0) 00000100:00100000:1.0:1788574013.932878:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000051023857 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+14:7421:x1875455681501952:12345-0@lo:101: Request processed in 661us (2032us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574013.932886:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788574013.933017:0:7421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008ecca1b3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:7421:1875455681501952:0@lo:101: 00010000:00010000:3.0:1788574013.933037:0:7421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: 000000005d1084fd/0x5bf8706fdac8bba9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bbb0 expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574013.933047:0:7421:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: 000000005d1084fd/0x5bf8706fdac8bba9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8bbb0 expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574013.933252:0:7421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000089a6d2e9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:7421:1875455681502080:0@lo:501: 00000100:00100000:3.0:1788574013.933304:0:7421:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574013.933337:0:7421:0:(client.c:2716:ptlrpc_set_wait()) set 00000000806157f2 going to sleep for 11 seconds 00000100:00100000:1.0:1788574013.933398:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681502080 00000100:00100000:1.0:1788574013.933404:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681502080 00000100:00100000:1.0:1788574013.933433:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788574013.933439:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000234233c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+14:7421:x1875455681502080:12345-0@lo:501: 00000100:00100000:1.0:1788574013.933545:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000234233c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+14:7421:x1875455681502080:12345-0@lo:501: Request processed in 105us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574013.933552:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788574013.933750:0:7421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000089a6d2e9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:7421:1875455681502080:0@lo:501: 00000100:00100000:3.0:1788574013.933788:0:7421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000089a6d2e9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:7421:1875455681502208:0@lo:503: 00000100:00100000:3.0:1788574013.933826:0:7421:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574013.933894:0:7421:0:(client.c:2716:ptlrpc_set_wait()) set 00000000806157f2 going to sleep for 11 seconds 00000100:00080000:3.0:1788574013.934314:0:6497:0:(import.c:65:import_set_state_nolock()) 00000000a4bdbd3d : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788574013.934363:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e4db824e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3616:x1875455681501440:12345-0@lo:38: Request processed in 7540us (7725us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574013.934376:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788574013.934672:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681502208 00000100:00100000:1.0:1788574013.934678:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681502208 00000100:00100000:1.0:1788574013.934748:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788574013.934756:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004c5a5013 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+14:7421:x1875455681502208:12345-0@lo:503: 00000040:00080000:1.0:1788574013.934796:0:6487:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788574013.934804:0:3616:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788574013.934812:0:3616:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1788574013.934819:0:3616:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1788574013.934825:0:3616:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788574013.934827:0:3616:0:(import.c:65:import_set_state_nolock()) 000000006a023ef8 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788574013.934838:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001c9e4f3c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1875455681501440:0@lo:38: 00000100:00100000:1.0:1788574013.934839:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004c5a5013 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+14:7421:x1875455681502208:12345-0@lo:503: Request processed in 85us (1013us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574013.934845:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788574013.934908:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001226e7dc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681502336:0@lo:41: 00000100:00100000:1.0:1788574013.934951:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574013.935352:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681502336 00000100:00100000:0.0:1788574013.935358:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681502336 00000100:00100000:0.0:1788574013.935385:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788574013.935390:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000086d233ee pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3617:x1875455681502336:12345-0@lo:41: 00000004:00000024:0.0:1788574013.935413:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:0.0:1788574013.935452:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000086d233ee pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3617:x1875455681502336:12345-0@lo:41: Request processed in 62us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574013.935458:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788574013.935595:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001226e7dc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681502336:0@lo:41: 00000100:00100000:3.0:1788574013.935740:0:7421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000089a6d2e9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:7421:1875455681502208:0@lo:503: 00000040:00080000:3.0:1788574013.936045:0:7421:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788574013.936099:0:7421:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:3.0:1788574013.936319:0:7421:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788574013.937371:0:7440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:3.0:1788574013.937553:0:7421:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1788574013.937575:0:7421:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788574013.937596:0:7421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: 000000005d1084fd/0x5bf8706fdac8bba9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bbb0 expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574013.937607:0:7421:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: 000000005d1084fd/0x5bf8706fdac8bba9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bbb0 expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788574013.937673:0:7421:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788574013.937677:0:7421:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c85fa390800 10000000:01000000:3.0:1788574013.937679:0:7421:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c85fa390800 10000000:01000000:3.0:1788574013.937691:0:7421:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788574013.937696:0:7421:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c85fa390800 from 1 10000000:01000000:3.0:1788574013.937698:0:7421:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788574013.937727:0:7421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: 0000000055f39e69/0x5bf8706fdac8bbb7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574013.937735:0:7421:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: 0000000055f39e69/0x5bf8706fdac8bbb7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574013.937743:0:7421:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: 0000000055f39e69/0x5bf8706fdac8bbb7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574013.937827:0:7421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000089a6d2e9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:7421:1875455681502464:0@lo:101: 00000100:00100000:3.0:1788574013.937885:0:7421:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574013.937920:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681502464 00000100:00100000:1.0:1788574013.937927:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681502464 00000100:00100000:3.0:1788574013.937929:0:7421:0:(client.c:2716:ptlrpc_set_wait()) set 000000002ee39d1f going to sleep for 11 seconds 00000100:00100000:1.0:1788574013.937969:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788574013.937976:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000002b41686 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+14:7421:x1875455681502464:12345-0@lo:101: 00010000:00010000:1.0:1788574013.937987:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574013.937998:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002f86ba1f/0x5bf8706fdac8bbbe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8bbb7 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574013.938019:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002f86ba1f/0x5bf8706fdac8bbbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8bbb7 expref: 15 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574013.938029:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002f86ba1f/0x5bf8706fdac8bbbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8bbb7 expref: 15 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574013.938037:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002f86ba1f, rc 0) 00000100:00100000:1.0:1788574013.938079:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000002b41686 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+15:7421:x1875455681502464:12345-0@lo:101: Request processed in 104us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574013.938091:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788574013.938523:0:7421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000089a6d2e9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:7421:1875455681502464:0@lo:101: 00010000:00010000:3.0:1788574013.938537:0:7421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: 0000000055f39e69/0x5bf8706fdac8bbb7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bbbe expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574013.938545:0:7421:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: 0000000055f39e69/0x5bf8706fdac8bbb7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8bbbe expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574013.938663:0:7421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000089a6d2e9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:7421:1875455681502592:0@lo:501: 00000100:00100000:3.0:1788574013.938705:0:7421:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574013.938778:0:7421:0:(client.c:2716:ptlrpc_set_wait()) set 000000002ee39d1f going to sleep for 11 seconds 00000100:00100000:1.0:1788574013.938959:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681502592 00000100:00100000:1.0:1788574013.938964:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681502592 00000100:00100000:1.0:1788574013.939039:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788574013.939046:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d90144ee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+15:7421:x1875455681502592:12345-0@lo:501: 00000100:00100000:1.0:1788574013.939157:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d90144ee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+15:7421:x1875455681502592:12345-0@lo:501: Request processed in 113us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574013.939165:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788574013.939277:0:7421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000089a6d2e9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:7421:1875455681502592:0@lo:501: 00000100:00100000:3.0:1788574013.939315:0:7421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000089a6d2e9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:7421:1875455681502720:0@lo:503: 00000100:00100000:3.0:1788574013.939355:0:7421:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574013.939428:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681502720 00000100:00100000:2.0:1788574013.939434:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681502720 00000100:00100000:2.0:1788574013.939469:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788574013.939475:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dac38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+15:7421:x1875455681502720:12345-0@lo:503: 00000100:00100000:3.0:1788574013.939507:0:7421:0:(client.c:2716:ptlrpc_set_wait()) set 000000002ee39d1f going to sleep for 11 seconds 00000100:00100000:2.0:1788574013.939572:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dac38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+15:7421:x1875455681502720:12345-0@lo:503: Request processed in 97us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574013.939579:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788574013.939719:0:7421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000089a6d2e9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:7421:1875455681502720:0@lo:503: 00000040:00080000:3.0:1788574013.939984:0:7421:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788574013.940063:0:7421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000089a6d2e9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:7421:1875455681502848:0@lo:502: 00000100:00100000:3.0:1788574013.940099:0:7421:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574013.940121:0:7421:0:(client.c:2716:ptlrpc_set_wait()) set 000000002ee39d1f going to sleep for 11 seconds 00000100:00100000:1.0:1788574013.940137:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681502848 00000100:00100000:1.0:1788574013.940141:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681502848 00000100:00100000:1.0:1788574013.940171:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788574013.940177:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000058ff391b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+15:7421:x1875455681502848:12345-0@lo:502: 00000100:00100000:1.0:1788574013.940534:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000058ff391b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+15:7421:x1875455681502848:12345-0@lo:502: Request processed in 356us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574013.940541:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788574013.940562:0:7421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000089a6d2e9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:7421:1875455681502848:0@lo:502: 00000040:00080000:3.0:1788574013.940906:0:7421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1788574013.941053:0:7421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1788574013.941074:0:7421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1788574013.941089:0:7421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1788574013.941176:0:7421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1788574013.941227:0:7421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1788574013.941246:0:7421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1788574013.941259:0:7421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1788574013.941271:0:7421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1788574013.941283:0:7421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1788574013.941297:0:7421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1788574013.941311:0:7421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1788574013.941337:0:7421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1788574013.941353:0:7421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1788574013.941367:0:7421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1788574013.941395:0:7421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1788574013.941411:0:7421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1788574013.941425:0:7421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1788574013.941438:0:7421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1788574013.941450:0:7421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1788574013.941462:0:7421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1788574013.941474:0:7421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1788574013.941488:0:7421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1788574013.941501:0:7421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1788574013.941524:0:7421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1788574013.941535:0:7421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1788574013.941546:0:7421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1788574013.941558:0:7421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:3.0:1788574013.941598:0:7421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000089a6d2e9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:7421:1875455681502976:0@lo:502: 00000100:00100000:3.0:1788574013.941660:0:7421:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574013.941697:0:7421:0:(client.c:2716:ptlrpc_set_wait()) set 000000002ee39d1f going to sleep for 11 seconds 00000100:00100000:1.0:1788574013.941796:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681502976 00000100:00100000:1.0:1788574013.941803:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681502976 00000100:00100000:1.0:1788574013.941842:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788574013.941849:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fffb05fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+15:7421:x1875455681502976:12345-0@lo:502: 00000100:00100000:1.0:1788574013.941957:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fffb05fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+15:7421:x1875455681502976:12345-0@lo:502: Request processed in 109us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574013.941964:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788574013.942625:0:7421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000089a6d2e9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:7421:1875455681502976:0@lo:502: 00000040:00080000:3.0:1788574013.942703:0:7421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1788574013.942713:0:7421:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1788574013.943311:0:7441:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:0.0:1788574013.943466:0:7441:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (00000000ab0e0d79) 00000020:00000080:0.0:1788574013.943487:0:7441:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1788574013.943597:0:7441:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000b8e99646 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1788574013.943601:0:7441:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000b8e99646 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1788574013.943604:0:7441:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000b8e99646 3 00010000:00080000:0.0:1788574013.943633:0:7441:0:(ldlm_lib.c:102:import_set_conn()) imp 000000007aca37be@lustre-MDT0000-lwp-MDT0001: add connection 192.168.204.151@tcp at head 00010000:00010000:1.0:1788574013.948725:0:7441:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:1.0:1788574013.949308:0:7441:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:1.0:1788574013.949388:0:7441:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788574013.949401:0:7441:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x5bf8706fdac8bbcc 00000100:00080000:1.0:1788574013.949412:0:7441:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788574013.950529:0:7441:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 000000007aca37be using connection 192.168.204.151@tcp/0@lo 00000100:00100000:1.0:1788574013.950572:0:7441:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000000a93ad2a x1875455681503104/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788574013.950641:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000a93ad2a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875455681503104:0@lo:38: 00000100:00080000:1.0:1788574013.950730:0:7441:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788574013.950734:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574013.950872:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681503104 00000100:00100000:3.0:1788574013.950881:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681503104 00000100:00100000:3.0:1788574013.950927:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788574013.950935:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fd5676f5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3616:x1875455681503104:12345-0@lo:38: 00010000:00080000:3.0:1788574013.950959:0:6493:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 153 last 0 00000020:00000080:3.0:1788574013.950999:0:6493:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x5bf8706fdac8bbd3 00000004:00100000:3.0:1788574013.951015:0:6493:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788574013.951043:0:6493:0:(import.c:65:import_set_state_nolock()) 000000002d1b850a : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788574013.951105:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fd5676f5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875455681503104:12345-0@lo:38: Request processed in 171us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574013.951113:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788574013.951297:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000000a93ad2a x1875455681503104/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788574023 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574013.951308:0:3616:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788574013.951316:0:3616:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000040:00080000:1.0:1788574013.951337:0:7441:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000100:00080000:2.0:1788574013.951393:0:3616:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788574013.951398:0:3616:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788574013.951400:0:3616:0:(import.c:65:import_set_state_nolock()) 000000007aca37be lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788574013.951405:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000a93ad2a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875455681503104:0@lo:38: 40000000:00080000:2.0:1788574013.951457:0:7443:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000020:01000000:3.0:1788574013.951573:0:7421:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:3.0:1788574013.951608:0:7421:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788574013.951631:0:7421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: 0000000055f39e69/0x5bf8706fdac8bbb7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bbbe expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574013.951642:0:7421:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: 0000000055f39e69/0x5bf8706fdac8bbb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bbbe expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788574013.951710:0:7421:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788574013.951712:0:7421:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788574013.951713:0:7421:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788574013.951714:0:7421:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788574013.951715:0:7421:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788574013.951717:0:7421:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788574013.951718:0:7421:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788574013.951719:0:7421:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788574013.951721:0:7421:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788574013.951722:0:7421:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788574013.951723:0:7421:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788574013.951727:0:7421:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:3.0:1788574013.951730:0:7421:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788574013.951731:0:7421:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788574013.951732:0:7421:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788574013.951733:0:7421:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788574013.951734:0:7421:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788574013.951735:0:7421:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788574013.951736:0:7421:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788574013.951737:0:7421:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788574013.951738:0:7421:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788574013.951739:0:7421:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788574013.951740:0:7421:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788574013.951768:0:7421:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1788574013.951781:0:7421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000089a6d2e9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:7421:1875455681503232:0@lo:253: 00000100:00100000:3.0:1788574013.951824:0:7421:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574013.951865:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681503232 00000100:00100000:3.0:1788574013.951870:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681503232 00000100:00100000:3.0:1788574013.951907:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788574013.951913:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002af2e359 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+15:7421:x1875455681503232:12345-0@lo:253: 20000000:01000000:3.0:1788574013.951935:0:6486:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788574013.951948:0:6486:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1788574013.952072:0:7421:0:(client.c:2716:ptlrpc_set_wait()) set 00000000806157f2 going to sleep for 11 seconds 00000001:00100000:1.0:1788574013.954513:0:6471:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1788574013.954688:0:6486:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788574013.954717:0:6486:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:1.0:1788574013.954921:0:6508:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788574013.954926:0:6508:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788574013.954963:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000004139a730/0x5bf8706fdac8bbda lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574013.954983:0:6508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000005c30a402/0x5bf8706fdac8bafa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8baf3 expref: 15 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574013.954990:0:6508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000077047f3f/0x5bf8706fdac8bb9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8bb94 expref: 15 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574013.954997:0:6508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000004139a730/0x5bf8706fdac8bbda lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574013.955034:0:6508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000077047f3f/0x5bf8706fdac8bb9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5bf8706fdac8bb94 expref: 15 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574013.955048:0:6508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000077047f3f/0x5bf8706fdac8bb9b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5bf8706fdac8bb94 expref: 15 pid: 6485 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574013.955060:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000175c29fd pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6508:1875455681503360:0@lo:104: 00000100:00100000:3.0:1788574013.955076:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002af2e359 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+15:7421:x1875455681503232:12345-0@lo:253: Request processed in 3160us (3251us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574013.955088:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788574013.955115:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788574013.955159:0:6508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000005c30a402/0x5bf8706fdac8bafa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5bf8706fdac8baf3 expref: 14 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574013.955177:0:6508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000005c30a402/0x5bf8706fdac8bafa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5bf8706fdac8baf3 expref: 14 pid: 6486 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574013.955186:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000d2321f2 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6508:1875455681503488:0@lo:104: 00000100:00100000:1.0:1788574013.955250:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574013.955269:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set 00000000098bd87b going to sleep for 11 seconds 00000100:00100000:1.0:1788574013.955287:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681503360 00000100:00100000:1.0:1788574013.955293:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681503360 00000100:00100000:3.0:1788574013.955314:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681503488 00000100:00100000:3.0:1788574013.955321:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681503488 00000100:00100000:1.0:1788574013.955330:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788574013.955341:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000a93ad2a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:69505170-06bc-41d1-9626-ab1a3c7f32a0+4:6508:x1875455681503360:12345-0@lo:104: 00010000:00010000:1.0:1788574013.955353:0:6475:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: 00000000a40cbdcf/0x5bf8706fdac8bb94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8bb9b expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574013.955402:0:6475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788574013.955406:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000a93ad2a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:69505170-06bc-41d1-9626-ab1a3c7f32a0+4:6508:x1875455681503360:12345-0@lo:104: Request processed in 70us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574013.955414:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1788574013.955429:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1788574013.955433:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1788574013.955437:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: 00000000a40cbdcf/0x5bf8706fdac8bb94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8bb9b expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574013.955442:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aa24c528 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:69505170-06bc-41d1-9626-ab1a3c7f32a0+3:6508:x1875455681503488:12345-0@lo:104: 00010000:00010000:1.0:1788574013.955455:0:6475:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: 000000003d9e234f/0x5bf8706fdac8baf3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8bafa expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574013.955464:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a40cbdcf already unused, calling callback (000000002f942c2d) 10000000:00010000:3.0:1788574013.955470:0:6480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: 00000000a40cbdcf/0x5bf8706fdac8bb94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5bf8706fdac8bb9b expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574013.955479:0:6480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: 00000000a40cbdcf/0x5bf8706fdac8bb94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5bf8706fdac8bb9b expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788574013.955485:0:6480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: 00000000a40cbdcf/0x5bf8706fdac8bb94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5bf8706fdac8bb9b expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574013.955489:0:6475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 10000000:01000000:3.0:1788574013.955491:0:6480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:1.0:1788574013.955496:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aa24c528 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:69505170-06bc-41d1-9626-ab1a3c7f32a0+3:6508:x1875455681503488:12345-0@lo:104: Request processed in 56us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574013.955503:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1788574013.955520:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788574013.955526:0:6480:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: 00000000a40cbdcf/0x5bf8706fdac8bb94 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bb9b expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574013.955536:0:6480:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788574013.955556:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: 00000000a40cbdcf/0x5bf8706fdac8bb94 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bb9b expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574013.955564:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: 00000000a40cbdcf/0x5bf8706fdac8bb94 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bb9b expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574013.955578:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574013.955586:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574013.955588:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574013.955602:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007c7e6789 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:69505170-06bc-41d1-9626-ab1a3c7f32a0:3618:1875455681503616:0@lo:103: 00010000:00010000:1.0:1788574013.955680:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574013.955685:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: 000000003d9e234f/0x5bf8706fdac8baf3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8bafa expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574013.955691:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003d9e234f already unused, calling callback (000000002f942c2d) 10000000:00010000:1.0:1788574013.955693:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: 000000003d9e234f/0x5bf8706fdac8baf3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5bf8706fdac8bafa expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574013.955698:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: 000000003d9e234f/0x5bf8706fdac8baf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5bf8706fdac8bafa expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788574013.955703:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: 000000003d9e234f/0x5bf8706fdac8baf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5bf8706fdac8bafa expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788574013.955707:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788574013.955721:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: 000000003d9e234f/0x5bf8706fdac8baf3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bafa expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574013.955726:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788574013.955738:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: 000000003d9e234f/0x5bf8706fdac8baf3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bafa expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574013.955743:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: 000000003d9e234f/0x5bf8706fdac8baf3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bafa expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574013.955754:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574013.955756:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574013.955758:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574013.955766:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009a62ed24 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69505170-06bc-41d1-9626-ab1a3c7f32a0:3619:1875455681503744:0@lo:103: 00000100:00100000:0.0:1788574013.955910:0:7421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000089a6d2e9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:7421:1875455681503232:0@lo:253: 10000000:01000000:0.0:1788574013.955923:0:7421:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1788574013.955926:0:7421:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788574013.955928:0:7421:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788574013.955935:0:7421:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788574013.955936:0:7421:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788574013.955937:0:7421:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788574013.955938:0:7421:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788574013.955939:0:7421:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788574013.955941:0:7421:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788574013.955942:0:7421:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788574013.955943:0:7421:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788574013.955944:0:7421:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788574013.955960:0:7421:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1788574013.958249:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574013.958358:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681503744 00000100:00100000:1.0:1788574013.958376:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681503744 00010000:00010000:1.0:1788574013.958411:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000005c30a402/0x5bf8706fdac8bafa lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8baf3 expref: 15 pid: 6486 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574013.958455:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788574013.958463:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b86e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:69505170-06bc-41d1-9626-ab1a3c7f32a0+15:3619:x1875455681503744:12345-0@lo:103: 00010000:00010000:1.0:1788574013.958477:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574013.958482:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000005c30a402/0x5bf8706fdac8bafa lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8baf3 expref: 15 pid: 6486 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574013.958493:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000005c30a402/0x5bf8706fdac8bafa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5bf8706fdac8baf3 expref: 15 pid: 6486 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574013.958514:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788574013.958557:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b86e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:69505170-06bc-41d1-9626-ab1a3c7f32a0+15:3619:x1875455681503744:12345-0@lo:103: Request processed in 95us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574013.958565:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788574013.958601:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009a62ed24 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69505170-06bc-41d1-9626-ab1a3c7f32a0:3619:1875455681503744:0@lo:103: 00010000:00010000:1.0:1788574013.958620:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574013.958622:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574013.959000:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574013.959054:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681503616 00000100:00100000:3.0:1788574013.959060:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681503616 00010000:00010000:3.0:1788574013.959077:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000077047f3f/0x5bf8706fdac8bb9b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8bb94 expref: 15 pid: 6485 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574013.959101:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788574013.959107:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dc688aac pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:69505170-06bc-41d1-9626-ab1a3c7f32a0+15:3618:x1875455681503616:12345-0@lo:103: 00010000:00010000:3.0:1788574013.959116:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574013.959120:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000077047f3f/0x5bf8706fdac8bb9b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8bb94 expref: 15 pid: 6485 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574013.959131:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000077047f3f/0x5bf8706fdac8bb9b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5bf8706fdac8bb94 expref: 15 pid: 6485 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574013.959146:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000004139a730/0x5bf8706fdac8bbda lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574013.959156:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004139a730/0x5bf8706fdac8bbda lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788574013.959172:0:6477:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004246164s 00010000:00010000:3.0:1788574013.959176:0:6477:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000004139a730/0x5bf8706fdac8bbda lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574013.959183:0:6477:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000004139a730/0x5bf8706fdac8bbda lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574013.960416:0:6477:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000004139a730/0x5bf8706fdac8bbda lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574013.960423:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000004139a730/0x5bf8706fdac8bbda lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574013.960428:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004139a730 already unused, calling callback (0000000000887628) 00010000:00010000:3.0:1788574013.960432:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000004139a730/0x5bf8706fdac8bbda lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574013.960440:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000004139a730/0x5bf8706fdac8bbda lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574013.960449:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000004139a730/0x5bf8706fdac8bbda lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574013.960819:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788574013.961361:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dc688aac pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:69505170-06bc-41d1-9626-ab1a3c7f32a0+15:3618:x1875455681503616:12345-0@lo:103: Request processed in 2251us (2358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574013.961373:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788574013.961552:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007c7e6789 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:69505170-06bc-41d1-9626-ab1a3c7f32a0:3618:1875455681503616:0@lo:103: 00010000:00010000:3.0:1788574013.961589:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000077047f3f/0x5bf8706fdac8bb9b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5bf8706fdac8bb94 expref: 14 pid: 6485 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574013.961603:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000175c29fd pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6508:1875455681503360:0@lo:104: 00010000:00010000:3.0:1788574013.961614:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005c30a402/0x5bf8706fdac8bafa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5bf8706fdac8baf3 expref: 13 pid: 6486 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574013.961621:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000d2321f2 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6508:1875455681503488:0@lo:104: 00010000:00010000:3.0:1788574013.962938:0:6508:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000004139a730/0x5bf8706fdac8bbda lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574013.962951:0:6508:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000004139a730/0x5bf8706fdac8bbda lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574013.962957:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000004139a730/0x5bf8706fdac8bbda lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574013.962962:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004139a730/0x5bf8706fdac8bbda lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:0.0:1788574013.962969:0:7421:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:0.0:1788574013.963158:0:7421:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1788574013.963462:0:7421:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:0.0:1788574013.963619:0:7421:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1788574013.963850:0:7421:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:0.0:1788574013.964036:0:7421:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:0.0:1788574013.965343:0:7421:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:0.0:1788574013.965779:0:7421:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:0.0:1788574013.966030:0:7421:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:0.0:1788574013.967628:0:7421:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:0.0:1788574013.967962:0:7421:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:0.0:1788574013.968155:0:7421:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:3.0:1788574013.979329:0:7421:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:2.0:1788574013.979603:0:7447:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:2.0:1788574013.979608:0:7447:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:2.0:1788574013.980724:0:7448:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:2.0:1788574013.980776:0:7448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c1f14611 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7448:1875455681503872:0@lo:700: 00000100:00100000:2.0:1788574013.980838:0:7448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574013.980895:0:7448:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c225a935 going to sleep for 11 seconds 00000040:01000000:3.0:1788574013.980970:0:7421:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:0.0:1788574013.981089:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681503872 00000100:00100000:0.0:1788574013.981098:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681503872 00000100:00100000:0.0:1788574013.981348:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788574013.981360:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fab459cb pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7448:x1875455681503872:12345-0@lo:700: 00000100:00100000:2.0:1788574013.982029:0:7449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000946f8223 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7449:1875455681504000:0@lo:1000: 00000100:00100000:2.0:1788574013.982090:0:7449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:01000000:3.0:1788574013.982601:0:7421:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:3.0:1788574013.982808:0:7421:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788574013.983267:0:7421:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788574013.983276:0:7421:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:3.0:1788574013.983412:0:7421:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788574013.984162:0:7449:0:(client.c:2716:ptlrpc_set_wait()) set 00000000abdb3d0a going to sleep for 11 seconds 00000100:00100000:0.0:1788574013.984795:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681504000 00000100:00100000:0.0:1788574013.984806:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681504000 00000100:00100000:0.0:1788574013.984942:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788574013.984951:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eea7969c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7449:x1875455681504000:12345-0@lo:1000: 00000100:00100000:0.0:1788574013.985069:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eea7969c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7449:x1875455681504000:12345-0@lo:1000: Request processed in 119us (2979us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574013.985083:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788574013.985144:0:7449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000946f8223 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7449:1875455681504000:0@lo:1000: 00000040:00080000:2.0:1788574013.985312:0:7421:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788574013.985869:0:7421:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788574013.985902:0:7421:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:01000000:0.0:1788574013.986092:0:7449:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:2.0:1788574013.986131:0:7421:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788574013.986132:0:7449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000eb0bc85f pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7449:1875455681504128:0@lo:700: 00000100:00100000:0.0:1788574013.986208:0:7449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00080000:10000000:2.0:1788574013.986481:0:7421:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1788574013.987443:0:7421:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1788574013.987581:0:7421:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1788574013.987718:0:7421:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1788574013.987928:0:7421:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1788574013.988071:0:7421:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1788574013.988434:0:7421:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1788574013.988585:0:7421:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00000100:00100000:0.0:1788574013.989137:0:7449:0:(client.c:2716:ptlrpc_set_wait()) set 00000000521c0d6b going to sleep for 11 seconds 00100000:10000000:2.0:1788574013.989143:0:7421:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1788574013.989514:0:7421:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1788574013.989660:0:7421:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1788574013.989827:0:7421:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00000100:00100000:3.0:1788574013.989934:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681504128 00000100:00100000:3.0:1788574013.989944:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681504128 00100000:10000000:2.0:1788574013.989968:0:7421:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00000100:00100000:3.0:1788574013.990021:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788574013.990030:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003ae7febd pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7449:x1875455681504128:12345-0@lo:700: 00100000:10000000:2.0:1788574013.990119:0:7421:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00000100:00100000:3.0:1788574013.990144:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003ae7febd pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7449:x1875455681504128:12345-0@lo:700: Request processed in 115us (3935us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574013.990152:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00100000:10000000:2.0:1788574013.990294:0:7421:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1788574013.990434:0:7421:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1788574013.990579:0:7421:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1788574013.990901:0:7421:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1788574013.991047:0:7421:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00000100:00100000:0.0:1788574013.991066:0:7449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000eb0bc85f pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7449:1875455681504128:0@lo:700: 00000100:00100000:0.0:1788574013.991152:0:7449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000eb0bc85f pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7449:1875455681504256:0@lo:900: 00100000:10000000:2.0:1788574013.991239:0:7421:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00000100:00100000:0.0:1788574013.991245:0:7449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574013.991291:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681504256 00000100:00100000:0.0:1788574013.991297:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681504256 00000100:00100000:0.0:1788574013.991335:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788574013.991342:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ee228586 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7449:x1875455681504256:12345-0@lo:900: 00000100:00100000:0.0:1788574013.991383:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ee228586 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7449:x1875455681504256:12345-0@lo:900: Request processed in 43us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574013.991391:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00100000:10000000:2.0:1788574013.991415:0:7421:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00000100:00100000:0.0:1788574013.991416:0:7449:0:(client.c:2716:ptlrpc_set_wait()) set 00000000521c0d6b going to sleep for 11 seconds 00010000:00080000:0.0:1788574013.991442:0:7449:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000eb0bc85f x1875455681504256/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788574029 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574013.991453:0:7449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000eb0bc85f pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7449:1875455681504256:0@lo:900: 00000100:00100000:0.0:1788574013.991541:0:7449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000eb0bc85f pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7449:1875455681504384:0@lo:1000: 00000100:00100000:0.0:1788574013.991573:0:7449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00100000:10000000:2.0:1788574013.991580:0:7421:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00000100:00100000:0.0:1788574013.991595:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681504384 00000100:00100000:0.0:1788574013.991598:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681504384 00000100:00100000:0.0:1788574013.991619:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788574013.991632:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b561a72c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7449:x1875455681504384:12345-0@lo:1000: 00000100:00100000:0.0:1788574013.991701:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b561a72c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7449:x1875455681504384:12345-0@lo:1000: Request processed in 70us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574013.991706:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788574013.991735:0:7449:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c13c70c8 going to sleep for 11 seconds 00000100:00100000:0.0:1788574013.991745:0:7449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000eb0bc85f pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7449:1875455681504384:0@lo:1000: 00000004:00080000:0.0:1788574013.991783:0:7449:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000521c0d6b with version 0 00000020:00100000:0.0:1788574013.991796:0:7449:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788574013.991800:0:7449:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000eb0bc85f x1875455681504640/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788574013.991810:0:7449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000eb0bc85f pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7449:1875455681504640:0@lo:1000: 00000100:00100000:0.0:1788574013.991831:0:7449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574013.991847:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681504640 00000100:00100000:0.0:1788574013.991849:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681504640 00000100:00100000:0.0:1788574013.994097:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788574013.994112:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004e5bc5ab pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7449:x1875455681504640:12345-0@lo:1000: 00100000:10000000:2.0:1788574013.994599:0:7421:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00000100:00100000:0.0:1788574013.994704:0:7449:0:(client.c:2716:ptlrpc_set_wait()) set 00000000dc37b3eb going to sleep for 11 seconds 00100000:10000000:2.0:1788574013.994980:0:7421:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 40000000:02000000:1.0:1788574013.995337:0:6499:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00000001:00080000:0.0:1788574014.000088:0:6471:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000100:00100000:0.0:1788574014.000236:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004e5bc5ab pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7449:x1875455681504640:12345-0@lo:1000: Request processed in 6124us (8400us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788574014.000250:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:0.0:1788574014.000310:0:7449:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:0.0:1788574014.000315:0:7449:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788574014.000330:0:7449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000eb0bc85f pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7449:1875455681504640:0@lo:1000: 00100000:10000000:2.0:1788574014.000412:0:7421:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00000100:00100000:0.0:1788574014.001086:0:7449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000eb0bc85f pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7449:1875455681504768:0@lo:1000: 00000100:00100000:0.0:1788574014.001140:0:7449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574014.001222:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681504768 00000100:00100000:0.0:1788574014.001228:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681504768 00000100:00100000:0.0:1788574014.001267:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788574014.001274:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000078b56053 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7449:x1875455681504768:12345-0@lo:1000: 00000100:00100000:0.0:1788574014.001342:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000078b56053 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7449:x1875455681504768:12345-0@lo:1000: Request processed in 69us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574014.001349:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788574014.001383:0:7449:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a95cc90f going to sleep for 11 seconds 00000100:00100000:0.0:1788574014.001399:0:7449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000eb0bc85f pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7449:1875455681504768:0@lo:1000: 00000040:00080000:0.0:1788574014.002036:0:7449:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:3.0:1788574014.002211:0:7449:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 000000002fa87b73 with version 1 00000004:00080000:0.0:1788574014.002279:0:7437:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000b0d6c751 version 1 rpc_version 1 00000020:00100000:0.0:1788574014.002302:0:7437:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788574014.002309:0:7437:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000eb0bc85f x1875455681505024/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788574014.002326:0:7437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000eb0bc85f pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7437:1875455681505024:0@lo:1000: 00000100:00100000:0.0:1788574014.002365:0:7437:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574014.002385:0:7437:0:(client.c:2716:ptlrpc_set_wait()) set 00000000521c0d6b going to sleep for 11 seconds 00000100:00100000:0.0:1788574014.002902:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681505024 00000100:00100000:0.0:1788574014.002910:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681505024 00000100:00100000:0.0:1788574014.003084:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788574014.003094:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006c66aad0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7437:x1875455681505024:12345-0@lo:1000: 00100000:10000000:2.0:1788574014.003129:0:7421:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1788574014.003314:0:7421:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1788574014.003467:0:7421:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1788574014.003831:0:7421:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1788574014.003950:0:7421:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00000040:00080000:3.0:1788574014.004275:0:7449:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788574014.004337:0:7449:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 1, retries 0 00100000:10000000:2.0:1788574014.004469:0:7421:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1788574014.004910:0:7421:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1788574014.005091:0:7421:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1788574014.005918:0:7421:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:1.0:1788574014.006352:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fab459cb pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7448:x1875455681503872:12345-0@lo:700: Request processed in 24988us (25507us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574014.006371:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788574014.006376:0:7448:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000c1f14611 x1875455681503872/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788574029 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574014.006393:0:7448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c1f14611 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7448:1875455681503872:0@lo:700: 40000000:02000000:2.0:1788574014.006407:0:7448:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00000001:00080000:1.0:1788574014.013643:0:6471:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000001:00080000:1.0:1788574014.014963:0:7421:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788574014.015018:0:7421:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb4d281857988 00100000:10000000:1.0:1788574014.015028:0:7421:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000100:00100000:0.0:1788574014.015406:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006c66aad0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7437:x1875455681505024:12345-0@lo:1000: Request processed in 12311us (13036us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788574014.015420:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:0.0:1788574014.015477:0:7437:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:0.0:1788574014.015481:0:7437:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1788574014.015500:0:7437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000eb0bc85f pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7437:1875455681505024:0@lo:1000: 00000020:01000004:3.0:1788574014.016594:0:7421:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788574014.016639:0:7421:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.151@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788574014.016767:0:7421:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1788574014.016791:0:7421:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:3.0:1788574014.017760:0:7421:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788574014.017960:0:7421:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=41009432 00000040:00080000:0.0:1788574014.041677:0:7448:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788574014.052793:0:7448:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788574014.052906:0:7448:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 1, retries 0 00000004:00080000:1.0:1788574014.052911:0:7448:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:2.0:1788574014.099544:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574015.125484:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788574015.635342:0:6490:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788574015.635351:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c85fa390800 from 4 10000000:01000000:3.0:1788574015.635356:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788574015.635417:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: 00000000ac844b1f/0x5bf8706fdac8bbe1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574015.635429:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: 00000000ac844b1f/0x5bf8706fdac8bbe1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574015.635440:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: 00000000ac844b1f/0x5bf8706fdac8bbe1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574015.635464:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007c7e6789 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681505152:0@lo:101: 00000100:00100000:3.0:1788574015.635537:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574015.635601:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e42fc980 going to sleep for 11 seconds 00000100:00100000:2.0:1788574015.635892:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681505152 00000100:00100000:2.0:1788574015.635902:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681505152 00000100:00100000:2.0:1788574015.635970:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788574015.635978:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005039e8ef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+13:6490:x1875455681505152:12345-0@lo:101: 00010000:00010000:2.0:1788574015.635991:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574015.636022:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000067a7aaae/0x5bf8706fdac8bbe8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8bbe1 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574015.636045:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000067a7aaae/0x5bf8706fdac8bbe8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8bbe1 expref: 14 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574015.636056:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000067a7aaae/0x5bf8706fdac8bbe8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8bbe1 expref: 14 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574015.636065:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000067a7aaae, rc 0) 00000100:00100000:2.0:1788574015.636119:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005039e8ef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+14:6490:x1875455681505152:12345-0@lo:101: Request processed in 142us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574015.636126:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788574015.636603:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007c7e6789 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681505152:0@lo:101: 00010000:00010000:3.0:1788574015.636632:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: 00000000ac844b1f/0x5bf8706fdac8bbe1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bbe8 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574015.636641:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: 00000000ac844b1f/0x5bf8706fdac8bbe1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8bbe8 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574015.636700:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007c7e6789 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681505280:0@lo:256: 00000100:00100000:3.0:1788574015.636738:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574015.636775:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e42fc980 going to sleep for 11 seconds 00000100:00100000:1.0:1788574015.636818:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681505280 00000100:00100000:1.0:1788574015.636824:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681505280 00000100:00100000:1.0:1788574015.636863:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788574015.636869:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e8680d61 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+14:6490:x1875455681505280:12345-0@lo:256: 20000000:01000000:1.0:1788574015.636885:0:6486:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788574015.636902:0:6486:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788574015.636906:0:6486:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1788574015.636992:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e8680d61 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+14:6490:x1875455681505280:12345-0@lo:256: Request processed in 123us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574015.636999:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788574015.637034:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007c7e6789 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681505280:0@lo:256: 10000000:01000000:1.0:1788574015.637073:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788574015.637078:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: 00000000ac844b1f/0x5bf8706fdac8bbe1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bbe8 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574015.637085:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: 00000000ac844b1f/0x5bf8706fdac8bbe1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bbe8 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788574015.637094:0:6490:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788574015.637097:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c85c2bfb800 from 21 10000000:01000000:1.0:1788574015.637099:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788574015.637115:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: 000000004139a730/0x5bf8706fdac8bbef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574015.637123:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: 000000004139a730/0x5bf8706fdac8bbef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574015.637150:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: 000000004139a730/0x5bf8706fdac8bbef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574015.637164:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009a62ed24 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681505408:0@lo:101: 00000100:00100000:1.0:1788574015.637220:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574015.637234:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set 000000006a333f2d going to sleep for 11 seconds 00000100:00100000:1.0:1788574015.637245:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681505408 00000100:00100000:1.0:1788574015.637248:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681505408 00000100:00100000:1.0:1788574015.637265:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788574015.637270:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f2b1f299 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+14:6490:x1875455681505408:12345-0@lo:101: 00010000:00010000:1.0:1788574015.637278:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574015.637286:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005c30a402/0x5bf8706fdac8bbf6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8bbef expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574015.637301:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005c30a402/0x5bf8706fdac8bbf6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8bbef expref: 15 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574015.637308:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005c30a402/0x5bf8706fdac8bbf6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8bbef expref: 15 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574015.637314:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005c30a402, rc 0) 00000100:00100000:1.0:1788574015.637341:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f2b1f299 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+15:6490:x1875455681505408:12345-0@lo:101: Request processed in 71us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574015.637347:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788574015.637372:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009a62ed24 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681505408:0@lo:101: 00010000:00010000:1.0:1788574015.637381:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: 000000004139a730/0x5bf8706fdac8bbef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bbf6 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574015.637558:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: 000000004139a730/0x5bf8706fdac8bbef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8bbf6 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574015.637625:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009a62ed24 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681505536:0@lo:501: 00000100:00100000:1.0:1788574015.637653:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574015.637666:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set 000000006a333f2d going to sleep for 11 seconds 00000100:00100000:1.0:1788574015.637677:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681505536 00000100:00100000:1.0:1788574015.637681:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681505536 00000100:00100000:1.0:1788574015.637697:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788574015.637702:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000080ccfbae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+15:6490:x1875455681505536:12345-0@lo:501: 00000100:00100000:1.0:1788574015.637809:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000080ccfbae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+15:6490:x1875455681505536:12345-0@lo:501: Request processed in 106us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574015.637816:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788574015.637843:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009a62ed24 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681505536:0@lo:501: 00000100:00100000:1.0:1788574015.637869:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009a62ed24 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681505664:0@lo:503: 00000100:00100000:1.0:1788574015.637906:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574015.637917:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set 000000006a333f2d going to sleep for 11 seconds 00000100:00100000:1.0:1788574015.637927:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681505664 00000100:00100000:1.0:1788574015.637930:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681505664 00000100:00100000:1.0:1788574015.637946:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788574015.637950:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b50aaea6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+15:6490:x1875455681505664:12345-0@lo:503: 00000100:00100000:1.0:1788574015.638018:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b50aaea6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+15:6490:x1875455681505664:12345-0@lo:503: Request processed in 68us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574015.638025:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788574015.638063:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009a62ed24 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681505664:0@lo:503: 00000100:00100000:3.0:1788574015.638940:0:7524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000505aa89d pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:7524:1875455681505792:0@lo:502: 00000100:00100000:3.0:1788574015.639001:0:7524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574015.639041:0:7524:0:(client.c:2716:ptlrpc_set_wait()) set 000000006d10d1a1 going to sleep for 11 seconds 00000100:00100000:1.0:1788574015.639119:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681505792 00000100:00100000:1.0:1788574015.639124:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681505792 00000100:00100000:1.0:1788574015.639516:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788574015.639525:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cae2cba1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+15:7524:x1875455681505792:12345-0@lo:502: 00000100:00100000:1.0:1788574015.639641:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cae2cba1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+15:7524:x1875455681505792:12345-0@lo:502: Request processed in 118us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574015.639649:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788574015.640385:0:7524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000505aa89d pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:7524:1875455681505792:0@lo:502: 00000100:00100000:3.0:1788574015.640458:0:7524:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000505aa89d pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:7524:1875455681505920:0@lo:502: 00000100:00100000:3.0:1788574015.640504:0:7524:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574015.646721:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681505920 00000100:00100000:2.0:1788574015.646735:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681505920 00000100:00100000:2.0:1788574015.646796:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788574015.646805:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a72d89ae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+15:7524:x1875455681505920:12345-0@lo:502: 00000100:00100000:2.0:1788574015.646971:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a72d89ae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+15:7524:x1875455681505920:12345-0@lo:502: Request processed in 167us (6466us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574015.646979:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788574015.647080:0:7524:0:(client.c:2716:ptlrpc_set_wait()) set 0000000088da07aa going to sleep for 11 seconds 00000100:00100000:2.0:1788574015.647105:0:7524:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000505aa89d pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:7524:1875455681505920:0@lo:502: 00000040:00080000:2.0:1788574015.647297:0:7524:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1788574015.648335:0:6490:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1788574015.648365:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788574015.648375:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: 000000004139a730/0x5bf8706fdac8bbef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bbf6 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574015.648386:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: 000000004139a730/0x5bf8706fdac8bbef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bbf6 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788574015.649027:0:6490:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788574015.649030:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c85c2bfb800 from 4 10000000:01000000:1.0:1788574015.649034:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788574015.649072:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: 0000000077047f3f/0x5bf8706fdac8bbfd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574015.649079:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: 0000000077047f3f/0x5bf8706fdac8bbfd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574015.649088:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: 0000000077047f3f/0x5bf8706fdac8bbfd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574015.649107:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009a62ed24 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681506048:0@lo:101: 00000100:00100000:1.0:1788574015.649366:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574015.650052:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set 000000006325b38c going to sleep for 11 seconds 00000100:00100000:1.0:1788574015.650077:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681506048 00000100:00100000:1.0:1788574015.650084:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681506048 00000100:00100000:2.0:1788574015.652569:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788574015.652590:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008c3d8353 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+15:6490:x1875455681506048:12345-0@lo:101: 00010000:00010000:2.0:1788574015.652609:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574015.652639:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003c4af46d/0x5bf8706fdac8bc04 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8bbfd expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574015.652689:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003c4af46d/0x5bf8706fdac8bc04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8bbfd expref: 16 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574015.652701:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003c4af46d/0x5bf8706fdac8bc04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8bbfd expref: 16 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574015.652709:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003c4af46d, rc 0) 00000100:00100000:2.0:1788574015.652790:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008c3d8353 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+16:6490:x1875455681506048:12345-0@lo:101: Request processed in 208us (3424us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574015.652797:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788574015.652861:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009a62ed24 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681506048:0@lo:101: 00010000:00010000:2.0:1788574015.652877:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: 0000000077047f3f/0x5bf8706fdac8bbfd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bc04 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574015.652887:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: 0000000077047f3f/0x5bf8706fdac8bbfd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8bc04 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574015.653015:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c1f14611 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681506176:0@lo:256: 00000100:00100000:2.0:1788574015.653059:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574015.653096:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set 000000006aeeeb5b going to sleep for 11 seconds 00000100:00100000:1.0:1788574015.653310:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681506176 00000100:00100000:1.0:1788574015.653318:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681506176 00000100:00100000:2.0:1788574015.656693:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788574015.656938:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009cd1a7cb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+16:6490:x1875455681506176:12345-0@lo:256: 20000000:01000000:2.0:1788574015.658069:0:6485:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788574015.658091:0:6485:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788574015.658095:0:6485:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1788574015.658644:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009cd1a7cb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+16:6490:x1875455681506176:12345-0@lo:256: Request processed in 1937us (5583us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574015.658664:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788574015.658770:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c1f14611 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681506176:0@lo:256: 10000000:01000000:1.0:1788574015.658825:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788574015.658834:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: 0000000077047f3f/0x5bf8706fdac8bbfd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bc04 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574015.658844:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: 0000000077047f3f/0x5bf8706fdac8bbfd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bc04 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788574015.658855:0:6490:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788574015.658857:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1788574015.658860:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788574015.658891:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: 00000000a40cbdcf/0x5bf8706fdac8bc0b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574015.658898:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: 00000000a40cbdcf/0x5bf8706fdac8bc0b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574015.658905:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: 00000000a40cbdcf/0x5bf8706fdac8bc0b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574015.658924:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fe4a125e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681506304:0@lo:101: 00000100:00100000:1.0:1788574015.660584:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574015.660643:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set 000000009fc844c9 going to sleep for 11 seconds 00000100:00100000:1.0:1788574015.660667:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681506304 00000100:00100000:1.0:1788574015.660675:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681506304 00000100:00100000:1.0:1788574015.660720:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788574015.660736:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ae21b123 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+16:6490:x1875455681506304:12345-0@lo:101: 00010000:00010000:1.0:1788574015.660750:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574015.660764:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000021220d68/0x5bf8706fdac8bc12 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8bc0b expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574015.660792:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000021220d68/0x5bf8706fdac8bc12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8bc0b expref: 17 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574015.660803:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000021220d68/0x5bf8706fdac8bc12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8bc0b expref: 17 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574015.660811:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000021220d68, rc 0) 00000100:00100000:1.0:1788574015.660847:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ae21b123 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+17:6490:x1875455681506304:12345-0@lo:101: Request processed in 112us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574015.660853:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788574015.660886:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fe4a125e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681506304:0@lo:101: 00010000:00010000:1.0:1788574015.660900:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: 00000000a40cbdcf/0x5bf8706fdac8bc0b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bc12 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574015.660908:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: 00000000a40cbdcf/0x5bf8706fdac8bc0b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8bc12 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574015.662239:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fe4a125e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681506432:0@lo:501: 00000100:00100000:1.0:1788574015.662295:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574015.662329:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set 000000009fc844c9 going to sleep for 11 seconds 00000100:00100000:1.0:1788574015.662349:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681506432 00000100:00100000:1.0:1788574015.662353:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681506432 00000100:00100000:1.0:1788574015.662385:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788574015.662491:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c310b593 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+17:6490:x1875455681506432:12345-0@lo:501: 00000100:00100000:1.0:1788574015.662630:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c310b593 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+17:6490:x1875455681506432:12345-0@lo:501: Request processed in 143us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574015.662638:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788574015.662680:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fe4a125e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681506432:0@lo:501: 00000100:00100000:1.0:1788574015.662711:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fe4a125e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681506560:0@lo:503: 00000100:00100000:1.0:1788574015.662748:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574015.662760:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set 000000009fc844c9 going to sleep for 11 seconds 00000100:00100000:1.0:1788574015.662771:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681506560 00000100:00100000:1.0:1788574015.662774:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681506560 00000100:00100000:1.0:1788574015.662790:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788574015.662795:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000064b57f28 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+17:6490:x1875455681506560:12345-0@lo:503: 00000100:00100000:1.0:1788574015.662867:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000064b57f28 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+17:6490:x1875455681506560:12345-0@lo:503: Request processed in 71us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574015.662873:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788574015.662911:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fe4a125e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681506560:0@lo:503: 00000100:00100000:2.0:1788574015.669274:0:7525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005fc87c3a pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:7525:1875455681506688:0@lo:502: 00000100:00100000:2.0:1788574015.669376:0:7525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574015.670063:0:7525:0:(client.c:2716:ptlrpc_set_wait()) set 000000002b3ef6a0 going to sleep for 11 seconds 00000100:00100000:3.0:1788574015.670387:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681506688 00000100:00100000:3.0:1788574015.670397:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681506688 00000100:00100000:3.0:1788574015.670458:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788574015.670467:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a027bcd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+17:7525:x1875455681506688:12345-0@lo:502: 00000100:00100000:3.0:1788574015.670847:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a027bcd7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+17:7525:x1875455681506688:12345-0@lo:502: Request processed in 381us (1472us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574015.670857:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788574015.671045:0:7525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005fc87c3a pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:7525:1875455681506688:0@lo:502: 00000020:01000000:2.0:1788574015.671077:0:7525:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788574015.671089:0:7525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574015.671092:0:7525:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1788574015.671096:0:7525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788574015.671100:0:7525:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.151@tcp to nid 0x20000c0a8cc97 (192.168.204.151@tcp) 00000020:00000080:2.0:1788574015.671123:0:7525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788574015.671148:0:7525:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (0000000065daaf3a) 00000020:00000080:2.0:1788574015.671172:0:7525:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:2.0:1788574015.671179:0:7525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788574015.671467:0:7525:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1788574015.671473:0:7525:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788574015.671480:0:7525:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5bf8706fdac8bc20 00010000:00080000:3.0:1788574015.671507:0:7525:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000cfa91add@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.151@tcp at head 00010000:00010000:3.0:1788574015.677442:0:7525:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:0.0:1788574015.701910:0:7525:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788574015.701927:0:7525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1788574015.701980:0:7525:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788574015.702002:0:7525:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5bf8706fdac8bc27 00000100:00080000:0.0:1788574015.702011:0:7525:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788574015.702017:0:7525:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 00000000cfa91add using connection 192.168.204.151@tcp/0@lo 00000100:00100000:0.0:1788574015.702051:0:7525:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000eb0bc85f x1875455681506816/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788574015.702106:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000eb0bc85f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875455681506816:0@lo:38: 00000100:00100000:2.0:1788574015.702217:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574015.702325:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681506816 00000100:00100000:3.0:1788574015.702334:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681506816 00000100:00100000:3.0:1788574015.702365:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788574015.702371:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005fc87c3a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3616:x1875455681506816:12345-0@lo:38: 00010000:00080000:3.0:1788574015.702404:0:6498:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 155 last 0 00000020:00000080:3.0:1788574015.702450:0:6498:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5bf8706fdac8bc2e 00000004:00100000:3.0:1788574015.702464:0:6498:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1788574015.702471:0:6498:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:0.0:1788574015.702762:0:7525:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:0.0:1788574015.702807:0:7525:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:0.0:1788574015.702954:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000095d6fc08 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875455681506944:0@lo:400: 00000100:00100000:0.0:1788574015.702995:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574015.706362:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681506944 00000100:00100000:0.0:1788574015.706378:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681506944 00000100:00100000:0.0:1788574015.707123:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788574015.707144:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fcb5446c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875455681506944:12345-0@lo:400: 00000100:00100000:0.0:1788574015.707263:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fcb5446c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875455681506944:12345-0@lo:400: Request processed in 131us (4267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574015.707271:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788574015.708424:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000516df31f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681507072:0@lo:400: 00000100:00100000:3.0:1788574015.708495:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574015.708548:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788574015.708555:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000024e2485c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875455681507200:0@lo:400: 00000100:00100000:3.0:1788574015.708596:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574015.710884:0:6497:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:3.0:1788574015.710897:0:6497:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:2.0:1788574015.711349:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681507200 00000100:00100000:2.0:1788574015.711358:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681507200 00000100:00100000:2.0:1788574015.711510:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788574015.711519:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002fcf8ef0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875455681507200:12345-0@lo:400: 00000100:00100000:2.0:1788574015.711588:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002fcf8ef0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875455681507200:12345-0@lo:400: Request processed in 72us (2992us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574015.711595:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788574015.712380:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000024e2485c x1875455681507200/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574031 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574015.712409:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000024e2485c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875455681507200:0@lo:400: 00000100:00100000:3.0:1788574015.714610:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681507072 00000100:00100000:3.0:1788574015.714633:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681507072 00000100:00100000:2.0:1788574015.714834:0:7533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788574015.714843:0:7533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e80e6e51 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681507072:12345-0@lo:400: 00000100:00100000:2.0:1788574015.714941:0:7533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e80e6e51 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681507072:12345-0@lo:400: Request processed in 100us (6447us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574015.715026:0:7533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788574015.715091:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000516df31f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681507072:0@lo:400: 00000100:00080000:3.0:1788574015.716689:0:6498:0:(import.c:65:import_set_state_nolock()) 00000000d62c6333 : changing import state from RECOVER to FULL 00010000:00080000:0.0:1788574015.718090:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000095d6fc08 x1875455681506944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574031 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574015.718112:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000095d6fc08 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875455681506944:0@lo:400: 00000100:00080000:2.0:1788574015.720068:0:7531:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@00000000ada4e3ba x1875455681507328/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574015.720084:0:7531:0:(client.c:2716:ptlrpc_set_wait()) set 00000000173b3b12 going to sleep for 0 seconds 00000100:00100000:3.0:1788574015.720567:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005fc87c3a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3616:x1875455681506816:12345-0@lo:38: Request processed in 18192us (18347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574015.720579:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788574015.720681:0:3616:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788574015.720690:0:3616:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788574015.720698:0:3616:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1788574015.720703:0:3616:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788574015.720706:0:3616:0:(import.c:65:import_set_state_nolock()) 00000000cfa91add lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1788574015.720724:0:3616:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000173b3b12): req@00000000ada4e3ba x1875455681507328/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574015.720740:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000eb0bc85f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875455681506816:0@lo:38: 00000100:00100000:2.0:1788574015.720819:0:7531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574015.720853:0:7531:0:(client.c:2716:ptlrpc_set_wait()) set 00000000173b3b12 going to sleep for 11 seconds 00000100:00100000:3.0:1788574015.720897:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681507328 00000100:00100000:3.0:1788574015.720904:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681507328 00000100:00100000:3.0:1788574015.720953:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788574015.720962:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001a0020d5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7531:x1875455681507328:12345-0@lo:1000: 00000100:00100000:3.0:1788574015.721045:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001a0020d5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7531:x1875455681507328:12345-0@lo:1000: Request processed in 85us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574015.721052:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788574015.721102:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e602b1fe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681507456:0@lo:41: 00000100:00100000:3.0:1788574015.721132:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574015.721376:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681507456 00000100:00100000:3.0:1788574015.721381:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681507456 00000100:00100000:3.0:1788574015.722029:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788574015.722039:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b1a2773c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3619:x1875455681507456:12345-0@lo:41: 00000004:00000024:3.0:1788574015.722069:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1788574015.722115:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b1a2773c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3619:x1875455681507456:12345-0@lo:41: Request processed in 79us (982us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574015.722132:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788574015.722278:0:7531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ada4e3ba pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7531:1875455681507328:0@lo:1000: 00000040:01000000:2.0:1788574015.722311:0:7531:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1788574015.722341:0:7531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ada4e3ba pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7531:1875455681507584:0@lo:1000: 00000100:00100000:2.0:1788574015.722374:0:7531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574015.722396:0:7533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681507584 00000100:00100000:2.0:1788574015.722401:0:7533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681507584 00000100:00100000:3.0:1788574015.722496:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e602b1fe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681507456:0@lo:41: 00000020:01000000:0.0:1788574015.724761:0:7525:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788574015.724772:0:7525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788574015.724774:0:7525:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1788574015.724778:0:7525:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788574015.724790:0:7525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788574015.724792:0:7525:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788574015.724795:0:7525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788574015.724796:0:7525:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788574015.724839:0:7525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000eb0bc85f pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:7525:1875455681507712:0@lo:502: 00000100:00100000:0.0:1788574015.724936:0:7525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574015.725112:0:7525:0:(client.c:2716:ptlrpc_set_wait()) set 000000009fc2ff3e going to sleep for 11 seconds 00000100:00100000:3.0:1788574015.725307:0:7531:0:(client.c:2716:ptlrpc_set_wait()) set 00000000173b3b12 going to sleep for 11 seconds 00000100:00100000:1.0:1788574015.725384:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681507712 00000100:00100000:1.0:1788574015.725392:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681507712 00000100:00100000:1.0:1788574015.725553:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788574015.725564:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002510cb5f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+17:7525:x1875455681507712:12345-0@lo:502: 00000100:00100000:1.0:1788574015.725720:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002510cb5f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+17:7525:x1875455681507712:12345-0@lo:502: Request processed in 159us (785us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574015.725728:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788574015.725809:0:7525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000eb0bc85f pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:7525:1875455681507712:0@lo:502: 00000020:01000000:0.0:1788574015.725836:0:7525:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788574015.725852:0:7525:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788574015.725854:0:7525:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788574015.725857:0:7525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000100:00100000:2.0:1788574015.726172:0:7533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788574015.726182:0:7533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008632cd1f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7531:x1875455681507584:12345-0@lo:1000: 00000100:00100000:2.0:1788574015.726325:0:7533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008632cd1f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7531:x1875455681507584:12345-0@lo:1000: Request processed in 146us (3951us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574015.726332:0:7533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788574015.728176:0:7531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ada4e3ba pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7531:1875455681507584:0@lo:1000: 00000100:00100000:3.0:1788574015.728276:0:7531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e602b1fe pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7531:1875455681507840:0@lo:700: 00000100:00100000:3.0:1788574015.728324:0:7531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574015.728353:0:7531:0:(client.c:2716:ptlrpc_set_wait()) set 000000001f6c5f1f going to sleep for 11 seconds 00000100:00100000:0.0:1788574015.728608:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681507840 00000100:00100000:0.0:1788574015.728625:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681507840 00000100:00100000:0.0:1788574015.728669:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788574015.728676:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001aa43ae0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7531:x1875455681507840:12345-0@lo:700: 00000100:00100000:0.0:1788574015.728735:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001aa43ae0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7531:x1875455681507840:12345-0@lo:700: Request processed in 59us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574015.728741:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788574015.730505:0:7531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e602b1fe pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7531:1875455681507840:0@lo:700: 00000100:00100000:3.0:1788574015.730757:0:7531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e602b1fe pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7531:1875455681507968:0@lo:1000: 00000100:00100000:3.0:1788574015.730812:0:7531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574015.730846:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681507968 00000100:00100000:3.0:1788574015.730852:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681507968 00000100:00100000:3.0:1788574015.730910:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788574015.730919:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000065f7ea8d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7531:x1875455681507968:12345-0@lo:1000: 00000100:00100000:3.0:1788574015.731067:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000065f7ea8d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7531:x1875455681507968:12345-0@lo:1000: Request processed in 149us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574015.731074:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788574015.731098:0:7531:0:(client.c:2716:ptlrpc_set_wait()) set 0000000009c82bac going to sleep for 11 seconds 00000100:00100000:3.0:1788574015.731112:0:7531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e602b1fe pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7531:1875455681507968:0@lo:1000: 00000004:00080000:3.0:1788574015.731257:0:7531:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 000000001f6c5f1f with version 0 00000020:00100000:3.0:1788574015.731273:0:7531:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1788574015.731278:0:7531:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000e602b1fe x1875455681508224/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788574015.731291:0:7531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e602b1fe pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7531:1875455681508224:0@lo:1000: 00000100:00100000:3.0:1788574015.731322:0:7531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574015.731336:0:7531:0:(client.c:2716:ptlrpc_set_wait()) set 000000001d3ede3f going to sleep for 11 seconds 00000100:00100000:2.0:1788574015.731471:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681508224 00000100:00100000:2.0:1788574015.731476:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681508224 00000100:00100000:2.0:1788574015.731511:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788574015.731518:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000700381f3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7531:x1875455681508224:12345-0@lo:1000: 00000020:01000000:1.0:1788574015.732285:0:6490:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1788574015.732318:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788574015.732327:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: 00000000a40cbdcf/0x5bf8706fdac8bc0b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bc12 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574015.732344:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: 00000000a40cbdcf/0x5bf8706fdac8bc0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bc12 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788574015.732354:0:6490:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788574015.732357:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9c85e56999c0 from 1 10000000:01000000:1.0:1788574015.732360:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788574015.732385:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: 00000000d49959d4/0x5bf8706fdac8bc35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574015.732393:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: 00000000d49959d4/0x5bf8706fdac8bc35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574015.732401:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: 00000000d49959d4/0x5bf8706fdac8bc35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574015.732416:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fe4a125e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681508352:0@lo:101: 00000100:00100000:1.0:1788574015.732458:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574015.732494:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set 00000000092db5e1 going to sleep for 11 seconds 00000100:00100000:1.0:1788574015.732511:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681508352 00000100:00100000:1.0:1788574015.732515:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681508352 00000100:00100000:1.0:1788574015.732547:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788574015.732553:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cd30779a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+17:6490:x1875455681508352:12345-0@lo:101: 00010000:00010000:1.0:1788574015.732563:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574015.732574:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000013803438/0x5bf8706fdac8bc3c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8bc35 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574015.732597:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000013803438/0x5bf8706fdac8bc3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8bc35 expref: 18 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574015.732755:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000013803438/0x5bf8706fdac8bc3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8bc35 expref: 18 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574015.732764:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000013803438, rc 0) 00000100:00100000:1.0:1788574015.732797:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cd30779a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+18:6490:x1875455681508352:12345-0@lo:101: Request processed in 244us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574015.732803:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788574015.732843:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fe4a125e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681508352:0@lo:101: 00010000:00010000:1.0:1788574015.732856:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: 00000000d49959d4/0x5bf8706fdac8bc35 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bc3c expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574015.732864:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: 00000000d49959d4/0x5bf8706fdac8bc35 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8bc3c expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574015.732915:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fe4a125e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681508480:0@lo:501: 00000100:00100000:1.0:1788574015.732938:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574015.732952:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set 00000000092db5e1 going to sleep for 11 seconds 00000100:00100000:1.0:1788574015.732964:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681508480 00000100:00100000:1.0:1788574015.732967:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681508480 00000100:00100000:1.0:1788574015.732988:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788574015.732994:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e0951c8a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+18:6490:x1875455681508480:12345-0@lo:501: 00000100:00100000:1.0:1788574015.733056:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e0951c8a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+18:6490:x1875455681508480:12345-0@lo:501: Request processed in 63us (118us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788574015.733063:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788574015.733092:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fe4a125e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681508480:0@lo:501: 10000000:01000000:1.0:1788574015.733113:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788574015.733125:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: 00000000d49959d4/0x5bf8706fdac8bc35 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bc3c expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574015.733131:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: 00000000d49959d4/0x5bf8706fdac8bc35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bc3c expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788574015.737568:0:7422:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:0.0:1788574015.737583:0:7422:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1788574015.737772:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000700381f3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7531:x1875455681508224:12345-0@lo:1000: Request processed in 6251us (6445us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788574015.737785:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000004:00080000:3.0:1788574015.737917:0:7531:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:3.0:1788574015.737923:0:7531:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1788574015.737938:0:7531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e602b1fe pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7531:1875455681508224:0@lo:1000: 00000100:00100000:3.0:1788574015.738039:0:7531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e602b1fe pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7531:1875455681508608:0@lo:1000: 00000100:00100000:3.0:1788574015.738082:0:7531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574015.738118:0:7531:0:(client.c:2716:ptlrpc_set_wait()) set 0000000011084ef6 going to sleep for 11 seconds 00000100:00100000:0.0:1788574015.738326:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681508608 00000100:00100000:0.0:1788574015.738334:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681508608 00000100:00100000:0.0:1788574015.738374:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788574015.738382:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002443c902 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7531:x1875455681508608:12345-0@lo:1000: 00000100:00100000:0.0:1788574015.738456:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002443c902 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7531:x1875455681508608:12345-0@lo:1000: Request processed in 76us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574015.738463:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788574015.738637:0:7531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e602b1fe pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7531:1875455681508608:0@lo:1000: 00000040:00080000:2.0:1788574015.738658:0:7531:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:2.0:1788574015.738692:0:7531:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000d3997bac with version 1 00000040:00080000:2.0:1788574015.741235:0:7531:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788574015.741316:0:7531:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788574015.741320:0:7531:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000004:00080000:0.0:1788574015.741491:0:7526:0:(osp_trans.c:1336:osp_get_next_request()) ou 0000000080fe9f76 version 1 rpc_version 1 00000020:00100000:0.0:1788574015.741545:0:7526:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788574015.741555:0:7526:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000eb0bc85f x1875455681508864/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788574015.741582:0:7526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000eb0bc85f pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7526:1875455681508864:0@lo:1000: 00000100:00100000:0.0:1788574015.741665:0:7526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574015.741700:0:7526:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a88aa305 going to sleep for 11 seconds 00000100:00100000:3.0:1788574015.741770:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681508864 00000100:00100000:3.0:1788574015.741778:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681508864 00000100:00100000:3.0:1788574015.741829:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788574015.741837:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001226e7dc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7526:x1875455681508864:12345-0@lo:1000: 00000001:00080000:0.0:1788574015.743574:0:7422:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:3.0:1788574015.743732:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001226e7dc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7526:x1875455681508864:12345-0@lo:1000: Request processed in 1894us (2064us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788574015.743744:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:0.0:1788574015.743825:0:7526:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:0.0:1788574015.743829:0:7526:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1788574015.743845:0:7526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000eb0bc85f pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7526:1875455681508864:0@lo:1000: 00010000:00010000:1.0:1788574016.147922:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574017.171396:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574018.195403:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788574018.234613:0:7700:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg451-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788574019.219448:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574019.220582:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788574019.220608:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000eb0bc85f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681508992:0@lo:41: 00000100:00100000:0.0:1788574019.220741:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574019.221451:0:7533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681508992 00000100:00100000:3.0:1788574019.221462:0:7533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681508992 00000100:00100000:3.0:1788574019.221723:0:7533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788574019.221732:0:7533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000668d677f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681508992:12345-0@lo:41: 00000004:00000024:3.0:1788574019.221767:0:7533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:3.0:1788574019.221843:0:7533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000668d677f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681508992:12345-0@lo:41: Request processed in 112us (1102us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574019.221851:0:7533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788574019.221991:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000eb0bc85f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681508992:0@lo:41: 00000020:00000004:0.0:1788574019.238726:0:7752:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788574019.238952:0:7752:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788574020.243693:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574020.755803:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788574020.755836:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e602b1fe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681509120:0@lo:41: 00000100:00100000:0.0:1788574020.755920:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574020.756108:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f5b49498 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875455681509376:0@lo:400: 00000100:00100000:1.0:1788574020.756143:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574020.756166:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788574020.756171:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007e6c50b7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681509504:0@lo:400: 00000100:00100000:1.0:1788574020.756215:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574020.756256:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681509376 00000100:00100000:1.0:1788574020.756263:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681509376 00000100:00100000:1.0:1788574020.756307:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788574020.756315:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009a62ed24 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875455681509376:12345-0@lo:400: 00000100:00100000:1.0:1788574020.756368:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009a62ed24 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875455681509376:12345-0@lo:400: Request processed in 54us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574020.756375:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788574020.756399:0:7533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681509120 00000100:00100000:1.0:1788574020.756402:0:7533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681509120 00000100:00100000:1.0:1788574020.756422:0:7533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681509504 00000100:00100000:1.0:1788574020.756425:0:7533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681509504 00000100:00100000:1.0:1788574020.756437:0:7533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788574020.756442:0:7533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e41198da pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681509120:12345-0@lo:41: 00000004:00000024:1.0:1788574020.756489:0:7533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1788574020.756536:0:7533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e41198da pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681509120:12345-0@lo:41: Request processed in 94us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574020.756543:0:7533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788574020.756555:0:7533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788574020.756561:0:7533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000d2321f2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681509504:12345-0@lo:400: 00000100:00100000:1.0:1788574020.756586:0:7533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000d2321f2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681509504:12345-0@lo:400: Request processed in 26us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574020.756591:0:7533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788574020.756625:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007e6c50b7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681509504:0@lo:400: 00010000:00080000:1.0:1788574020.756637:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000f5b49498 x1875455681509376/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574036 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574020.756648:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f5b49498 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875455681509376:0@lo:400: 00000100:00100000:0.0:1788574020.756726:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fe4a125e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:69505170-06bc-41d1-9626-ab1a3c7f32a0:3618:1875455681509248:0@lo:400: 00000100:00100000:0.0:1788574020.756757:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574020.756802:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e602b1fe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681509120:0@lo:41: 00000100:00100000:0.0:1788574020.756815:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788574020.756821:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b09b8f20 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875455681509632:0@lo:400: 00000100:00100000:0.0:1788574020.756842:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574020.757157:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681509632 00000100:00100000:3.0:1788574020.757162:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681509632 00000100:00100000:3.0:1788574020.757223:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788574020.757238:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b781de6a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875455681509632:12345-0@lo:400: 00000100:00100000:3.0:1788574020.757276:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b781de6a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875455681509632:12345-0@lo:400: Request processed in 39us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574020.757283:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788574020.757356:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000b09b8f20 x1875455681509632/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574036 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574020.757371:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b09b8f20 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875455681509632:0@lo:400: 00000100:00100000:1.0:1788574020.757436:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681509248 00000100:00100000:1.0:1788574020.757440:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681509248 00000100:00100000:1.0:1788574020.757474:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788574020.757480:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e7a6c476 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+18:3618:x1875455681509248:12345-0@lo:400: 00000100:00100000:1.0:1788574020.757530:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e7a6c476 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+18:3618:x1875455681509248:12345-0@lo:400: Request processed in 50us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574020.757536:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788574020.757695:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fe4a125e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:69505170-06bc-41d1-9626-ab1a3c7f32a0:3618:1875455681509248:0@lo:400: 00010000:00010000:1.0:1788574021.267323:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788574022.017921:0:7853:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788574022.018434:0:7853:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788574022.292653:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788574023.103181:0:7901:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffedb606940 20000000:00000080:2.0:1788574023.103460:0:7901:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c85fac82000 uarg=0000000000000000 20000000:01000000:2.0:1788574023.103524:0:7901:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1788574023.103531:0:7901:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1788574023.103538:0:7901:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1788574023.103696:0:7901:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1788574023.103709:0:7901:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1788574023.108421:0:7901:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788574023.108716:0:7901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788574023.108753:0:7901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1788574023.108780:0:7901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1788574023.108798:0:7901:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788574023.108814:0:7901:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000300d0dba/0x5bf8706fdac8bc43 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574023.108832:0:7901:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000ef766547/0x5bf8706fdac8bac2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8babb expref: 17 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574023.108839:0:7901:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000008011b35/0x5bf8706fdac8bbb0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8bba9 expref: 17 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574023.108847:0:7901:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000300d0dba/0x5bf8706fdac8bc43 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574023.108883:0:7901:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000008011b35/0x5bf8706fdac8bbb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5bf8706fdac8bba9 expref: 17 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574023.108909:0:7901:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000008011b35/0x5bf8706fdac8bbb0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5bf8706fdac8bba9 expref: 17 pid: 6485 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574023.108922:0:7901:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d561b1b7 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7901:1875455681509760:0@lo:104: 00000100:00100000:2.0:1788574023.109165:0:7901:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788574023.109308:0:7901:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000ef766547/0x5bf8706fdac8bac2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5bf8706fdac8babb expref: 17 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574023.109318:0:7901:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000ef766547/0x5bf8706fdac8bac2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5bf8706fdac8babb expref: 17 pid: 6485 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574023.109326:0:7901:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000448564f0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7901:1875455681509888:0@lo:104: 00000100:00100000:2.0:1788574023.109349:0:7901:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c3f106d5 going to sleep for 11 seconds 00000100:00100000:3.0:1788574023.109560:0:6475:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788574023.109580:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574023.109611:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681509760 00000100:00100000:3.0:1788574023.109618:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681509760 00000100:00100000:3.0:1788574023.109655:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681509888 00000100:00100000:3.0:1788574023.109658:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681509888 00000100:00100000:3.0:1788574023.109670:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788574023.109677:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009fc4ecbc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:69505170-06bc-41d1-9626-ab1a3c7f32a0+4:7901:x1875455681509760:12345-0@lo:104: 00010000:00010000:3.0:1788574023.109688:0:6475:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: 000000005d1084fd/0x5bf8706fdac8bba9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8bbb0 expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574023.109753:0:6475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788574023.109758:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009fc4ecbc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:69505170-06bc-41d1-9626-ab1a3c7f32a0+4:7901:x1875455681509760:12345-0@lo:104: Request processed in 82us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574023.109766:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788574023.109801:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788574023.109807:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000095d6fc08 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:69505170-06bc-41d1-9626-ab1a3c7f32a0+3:7901:x1875455681509888:12345-0@lo:104: 00010000:00010000:3.0:1788574023.109814:0:6475:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: 000000002cbc2156/0x5bf8706fdac8babb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8bac2 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574023.109847:0:6475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788574023.109860:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000095d6fc08 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:69505170-06bc-41d1-9626-ab1a3c7f32a0+3:7901:x1875455681509888:12345-0@lo:104: Request processed in 55us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574023.109866:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:3.0:1788574023.109882:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788574023.109886:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: 000000005d1084fd/0x5bf8706fdac8bba9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8bbb0 expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574023.109904:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005d1084fd already unused, calling callback (000000002f942c2d) 10000000:00010000:3.0:1788574023.109907:0:6480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: 000000005d1084fd/0x5bf8706fdac8bba9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5bf8706fdac8bbb0 expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574023.109914:0:6480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: 000000005d1084fd/0x5bf8706fdac8bba9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5bf8706fdac8bbb0 expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788574023.109920:0:6480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: 000000005d1084fd/0x5bf8706fdac8bba9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5bf8706fdac8bbb0 expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788574023.109925:0:6480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788574023.109952:0:6480:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: 000000005d1084fd/0x5bf8706fdac8bba9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bbb0 expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574023.109967:0:6480:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788574023.110181:0:7901:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d561b1b7 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7901:1875455681509760:0@lo:104: 00000100:00100000:0.0:1788574023.110215:0:7901:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000448564f0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7901:1875455681509888:0@lo:104: 00010000:00010000:0.0:1788574023.110234:0:7901:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000300d0dba/0x5bf8706fdac8bc43 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574023.110423:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000516df31f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:69505170-06bc-41d1-9626-ab1a3c7f32a0:3618:1875455681510016:0@lo:103: 00000100:00100000:0.0:1788574023.110458:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788574023.110515:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: 000000005d1084fd/0x5bf8706fdac8bba9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bbb0 expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574023.110523:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: 000000005d1084fd/0x5bf8706fdac8bba9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bbb0 expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574023.110537:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788574023.110539:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: 000000002cbc2156/0x5bf8706fdac8babb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8bac2 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574023.110558:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002cbc2156 already unused, calling callback (000000002f942c2d) 10000000:00010000:3.0:1788574023.110560:0:6480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: 000000002cbc2156/0x5bf8706fdac8babb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5bf8706fdac8bac2 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574023.110565:0:6480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: 000000002cbc2156/0x5bf8706fdac8babb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5bf8706fdac8bac2 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788574023.110569:0:6480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: 000000002cbc2156/0x5bf8706fdac8babb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5bf8706fdac8bac2 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788574023.110573:0:6480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788574023.110602:0:6480:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: 000000002cbc2156/0x5bf8706fdac8babb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bac2 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574023.110609:0:6480:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788574023.110623:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: 000000002cbc2156/0x5bf8706fdac8babb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bac2 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574023.110629:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: 000000002cbc2156/0x5bf8706fdac8babb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bac2 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574023.110641:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574023.110643:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574023.110645:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574023.111853:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574023.111882:0:7433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681510016 00000100:00100000:1.0:1788574023.111891:0:7433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681510016 00010000:00010000:1.0:1788574023.111936:0:7433:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000008011b35/0x5bf8706fdac8bbb0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8bba9 expref: 18 pid: 6485 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574023.112005:0:7433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788574023.112013:0:7433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001d14bbb4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:69505170-06bc-41d1-9626-ab1a3c7f32a0+18:3618:x1875455681510016:12345-0@lo:103: 00010000:00010000:1.0:1788574023.112036:0:7433:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574023.112042:0:7433:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000008011b35/0x5bf8706fdac8bbb0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8bba9 expref: 18 pid: 6485 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574023.112052:0:7433:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000008011b35/0x5bf8706fdac8bbb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5bf8706fdac8bba9 expref: 18 pid: 6485 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574023.112067:0:7433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000008011b35/0x5bf8706fdac8bbb0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5bf8706fdac8bba9 expref: 18 pid: 6485 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574023.112081:0:7433:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788574023.112581:0:7433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001d14bbb4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:69505170-06bc-41d1-9626-ab1a3c7f32a0+17:3618:x1875455681510016:12345-0@lo:103: Request processed in 567us (2120us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574023.115508:0:7433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788574023.115567:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000024e2485c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69505170-06bc-41d1-9626-ab1a3c7f32a0:3619:1875455681510144:0@lo:103: 00000100:00100000:1.0:1788574023.115654:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574023.115828:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681510144 00000100:00100000:3.0:1788574023.115838:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681510144 00010000:00010000:3.0:1788574023.115871:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000ef766547/0x5bf8706fdac8bac2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8babb expref: 17 pid: 6485 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574023.115917:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788574023.115934:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f5b49498 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69505170-06bc-41d1-9626-ab1a3c7f32a0+17:3619:x1875455681510144:12345-0@lo:103: 00010000:00010000:3.0:1788574023.115947:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574023.115952:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000ef766547/0x5bf8706fdac8bac2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8babb expref: 17 pid: 6485 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574023.115982:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000ef766547/0x5bf8706fdac8bac2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5bf8706fdac8babb expref: 17 pid: 6485 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574023.116000:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ef766547/0x5bf8706fdac8bac2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5bf8706fdac8babb expref: 17 pid: 6485 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574023.116014:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000300d0dba/0x5bf8706fdac8bc43 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574023.116032:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000300d0dba/0x5bf8706fdac8bc43 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574023.116048:0:6479:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000300d0dba/0x5bf8706fdac8bc43 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574023.116054:0:6479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000300d0dba/0x5bf8706fdac8bc43 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574023.116059:0:6479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000300d0dba/0x5bf8706fdac8bc43 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574023.116065:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000300d0dba/0x5bf8706fdac8bc43 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574023.116070:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000300d0dba already unused, calling callback (0000000000887628) 00010000:00010000:3.0:1788574023.116074:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000300d0dba/0x5bf8706fdac8bc43 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574023.116087:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000300d0dba/0x5bf8706fdac8bc43 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574023.116112:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000300d0dba/0x5bf8706fdac8bc43 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574023.116124:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788574023.116163:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f5b49498 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69505170-06bc-41d1-9626-ab1a3c7f32a0+16:3619:x1875455681510144:12345-0@lo:103: Request processed in 231us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574023.116170:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788574023.117250:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000024e2485c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69505170-06bc-41d1-9626-ab1a3c7f32a0:3619:1875455681510144:0@lo:103: 00010000:00010000:1.0:1788574023.117293:0:7901:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000300d0dba/0x5bf8706fdac8bc43 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574023.117303:0:7901:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000300d0dba/0x5bf8706fdac8bc43 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574023.117309:0:7901:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000300d0dba/0x5bf8706fdac8bc43 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7901 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574023.122742:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000516df31f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:69505170-06bc-41d1-9626-ab1a3c7f32a0:3618:1875455681510016:0@lo:103: 00010000:00010000:2.0:1788574023.320433:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574024.339386:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788574024.339414:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007e6c50b7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681510272:0@lo:41: 00010000:00010000:1.0:1788574024.339440:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574024.339491:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574024.339666:0:7533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681510272 00000100:00100000:1.0:1788574024.339675:0:7533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681510272 00000100:00100000:1.0:1788574024.339728:0:7533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788574024.339745:0:7533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000505aa89d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681510272:12345-0@lo:41: 00000004:00000024:1.0:1788574024.339788:0:7533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:1.0:1788574024.339841:0:7533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000505aa89d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681510272:12345-0@lo:41: Request processed in 96us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574024.339847:0:7533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788574024.339888:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007e6c50b7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681510272:0@lo:41: 10000000:01000000:1.0:1788574024.787346:0:6490:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788574024.787355:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c85fa390800 from 1 10000000:01000000:1.0:1788574024.787361:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788574024.787412:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: 00000000e3889995/0x5bf8706fdac8bc4a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574024.787425:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: 00000000e3889995/0x5bf8706fdac8bc4a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574024.787434:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: 00000000e3889995/0x5bf8706fdac8bc4a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574024.787470:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007e6c50b7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681510400:0@lo:101: 00000100:00100000:1.0:1788574024.787542:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574024.787664:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set 000000004d097e9f going to sleep for 11 seconds 00000100:00100000:2.0:1788574024.789638:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681510400 00000100:00100000:2.0:1788574024.789652:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681510400 00000100:00100000:2.0:1788574024.789729:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788574024.789738:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f9b078e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+16:6490:x1875455681510400:12345-0@lo:101: 00010000:00010000:2.0:1788574024.789755:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574024.789773:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000066d8bbf5/0x5bf8706fdac8bc51 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8bc4a expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574024.789799:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000066d8bbf5/0x5bf8706fdac8bc51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8bc4a expref: 17 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574024.789809:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000066d8bbf5/0x5bf8706fdac8bc51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8bc4a expref: 17 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574024.789817:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000066d8bbf5, rc 0) 00000100:00100000:2.0:1788574024.789903:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f9b078e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+17:6490:x1875455681510400:12345-0@lo:101: Request processed in 167us (2361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574024.789911:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788574024.790210:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007e6c50b7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681510400:0@lo:101: 00010000:00010000:3.0:1788574024.790231:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: 00000000e3889995/0x5bf8706fdac8bc4a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bc51 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574024.790242:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: 00000000e3889995/0x5bf8706fdac8bc4a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8bc51 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574024.790319:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007c7e6789 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681510528:0@lo:501: 00000100:00100000:3.0:1788574024.790360:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574024.790399:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cf88c705 going to sleep for 11 seconds 00000100:00100000:0.0:1788574024.790625:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681510528 00000100:00100000:0.0:1788574024.790631:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681510528 00000100:00100000:0.0:1788574024.791110:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788574024.791119:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008699f79f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+17:6490:x1875455681510528:12345-0@lo:501: 00000100:00100000:0.0:1788574024.791665:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008699f79f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+17:6490:x1875455681510528:12345-0@lo:501: Request processed in 547us (1305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574024.791674:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788574024.792379:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007c7e6789 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681510528:0@lo:501: 00000100:00100000:3.0:1788574024.792432:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007c7e6789 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681510656:0@lo:503: 00000100:00100000:3.0:1788574024.792501:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574024.792546:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cf88c705 going to sleep for 11 seconds 00000100:00100000:1.0:1788574024.792621:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681510656 00000100:00100000:1.0:1788574024.792629:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681510656 00000100:00100000:1.0:1788574024.792679:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788574024.792693:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b779ad54 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+17:6490:x1875455681510656:12345-0@lo:503: 00000100:00100000:1.0:1788574024.792797:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b779ad54 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+17:6490:x1875455681510656:12345-0@lo:503: Request processed in 105us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574024.792805:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788574024.792940:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007c7e6789 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681510656:0@lo:503: 00000100:00100000:2.0:1788574024.805258:0:7969:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009ed4f468 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:7969:1875455681510784:0@lo:502: 00000100:00100000:2.0:1788574024.805351:0:7969:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574024.805394:0:7969:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d13ba35d going to sleep for 11 seconds 00000100:00100000:0.0:1788574024.805483:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681510784 00000100:00100000:0.0:1788574024.805491:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681510784 00000100:00100000:0.0:1788574024.805544:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788574024.805552:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c1ccf925 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+17:7969:x1875455681510784:12345-0@lo:502: 00000100:00100000:0.0:1788574024.805680:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c1ccf925 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+17:7969:x1875455681510784:12345-0@lo:502: Request processed in 128us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574024.805688:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788574024.805785:0:7969:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009ed4f468 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:7969:1875455681510784:0@lo:502: 00000020:01000000:2.0:1788574024.805813:0:7969:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788574024.805823:0:7969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574024.805825:0:7969:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788574024.805832:0:7969:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c85fa390800 00000020:00000080:2.0:1788574024.805835:0:7969:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788574024.805876:0:7969:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85de938000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:7969:1875455681510912:0@lo:502: 00000100:00100000:2.0:1788574024.805909:0:7969:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574024.805956:0:7969:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85d145d540 going to sleep for 11 seconds 00000100:00100000:3.0:1788574024.806126:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681510912 00000100:00100000:3.0:1788574024.806131:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681510912 00000100:00100000:3.0:1788574024.806167:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788574024.806174:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5674450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+17:7969:x1875455681510912:12345-0@lo:502: 00000100:00100000:3.0:1788574024.806280:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5674450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+17:7969:x1875455681510912:12345-0@lo:502: Request processed in 106us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574024.806287:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788574024.806415:0:7969:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85de938000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:7969:1875455681510912:0@lo:502: 00000020:01000000:2.0:1788574024.806435:0:7969:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788574024.806451:0:7969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574024.806453:0:7969:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788574024.806456:0:7969:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1788574024.806623:0:6490:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788574024.806644:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788574024.806653:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85faea2000/0x5bf8706fdac8bc4a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bc51 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574024.806665:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c85faea2000/0x5bf8706fdac8bc4a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bc51 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788574024.806674:0:6490:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788574024.806677:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c85c2bfb800 from 1 10000000:01000000:3.0:1788574024.806679:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788574024.806706:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85c152ee00/0x5bf8706fdac8bc58 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574024.806713:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c85c152ee00/0x5bf8706fdac8bc58 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574024.806722:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c85c152ee00/0x5bf8706fdac8bc58 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574024.806735:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fa0e6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681511040:0@lo:101: 00000100:00100000:3.0:1788574024.806775:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574024.806808:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c8a2d480 going to sleep for 11 seconds 00000100:00100000:2.0:1788574024.806855:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681511040 00000100:00100000:2.0:1788574024.806860:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681511040 00000100:00100000:2.0:1788574024.806890:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788574024.806897:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5674050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+17:6490:x1875455681511040:12345-0@lo:101: 00010000:00010000:2.0:1788574024.806906:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574024.806919:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c860217e200/0x5bf8706fdac8bc5f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8bc58 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574024.806951:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c860217e200/0x5bf8706fdac8bc5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8bc58 expref: 18 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574024.806961:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c860217e200/0x5bf8706fdac8bc5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8bc58 expref: 18 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574024.806969:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c860217e200, rc 0) 00000100:00100000:2.0:1788574024.807018:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5674050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+18:6490:x1875455681511040:12345-0@lo:101: Request processed in 121us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574024.807024:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788574024.807234:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fa0e6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681511040:0@lo:101: 00010000:00010000:3.0:1788574024.807246:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c85c152ee00/0x5bf8706fdac8bc58 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bc5f expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574024.807255:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c85c152ee00/0x5bf8706fdac8bc58 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8bc5f expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574024.807303:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fa0e6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681511168:0@lo:501: 00000100:00100000:3.0:1788574024.807328:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574024.807339:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c8a2d480 going to sleep for 11 seconds 00000100:00100000:0.0:1788574024.807401:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681511168 00000100:00100000:0.0:1788574024.807406:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681511168 00000100:00100000:0.0:1788574024.807459:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788574024.807466:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5676050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+18:6490:x1875455681511168:12345-0@lo:501: 00000100:00100000:0.0:1788574024.807567:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5676050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+18:6490:x1875455681511168:12345-0@lo:501: Request processed in 101us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574024.807574:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788574024.807943:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fa0e6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681511168:0@lo:501: 00000100:00100000:3.0:1788574024.807977:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fa0e6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681511296:0@lo:503: 00000100:00100000:3.0:1788574024.808030:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574024.808064:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c8a2d480 going to sleep for 11 seconds 00000100:00100000:0.0:1788574024.808241:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681511296 00000100:00100000:0.0:1788574024.808247:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681511296 00000100:00100000:0.0:1788574024.808279:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788574024.808287:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5677850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+18:6490:x1875455681511296:12345-0@lo:503: 00000100:00100000:0.0:1788574024.808362:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5677850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+18:6490:x1875455681511296:12345-0@lo:503: Request processed in 76us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574024.808369:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788574024.808743:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fa0e6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681511296:0@lo:503: 00000100:00100000:3.0:1788574024.810293:0:7970:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fa0e6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:7970:1875455681511424:0@lo:502: 00000100:00100000:3.0:1788574024.810367:0:7970:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574024.810406:0:7970:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c8a2d600 going to sleep for 11 seconds 00000100:00100000:0.0:1788574024.810483:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681511424 00000100:00100000:0.0:1788574024.810490:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681511424 00000100:00100000:0.0:1788574024.810535:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788574024.810544:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5675050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+18:7970:x1875455681511424:12345-0@lo:502: 00000100:00100000:0.0:1788574024.810657:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5675050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+18:7970:x1875455681511424:12345-0@lo:502: Request processed in 114us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574024.810664:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788574024.811956:0:7970:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fa0e6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:7970:1875455681511424:0@lo:502: 00000020:01000000:2.0:1788574024.811999:0:7970:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788574024.812011:0:7970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574024.812022:0:7970:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788574024.812030:0:7970:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c85c2bfb800 00000020:00000080:2.0:1788574024.812041:0:7970:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788574024.812087:0:7970:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85de938000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:7970:1875455681511552:0@lo:502: 00000100:00100000:2.0:1788574024.812404:0:7970:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574024.812457:0:7970:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85d145dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788574024.815133:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681511552 00000100:00100000:0.0:1788574024.815149:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681511552 00000100:00100000:0.0:1788574024.815254:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788574024.815266:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5675c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+18:7970:x1875455681511552:12345-0@lo:502: 00000100:00100000:0.0:1788574024.815434:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5675c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+18:7970:x1875455681511552:12345-0@lo:502: Request processed in 171us (3029us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574024.815453:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788574024.821404:0:7970:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85de938000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:7970:1875455681511552:0@lo:502: 00000020:01000000:3.0:1788574024.821469:0:7970:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788574024.821480:0:7970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574024.821483:0:7970:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788574024.821488:0:7970:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1788574024.821702:0:6490:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788574024.821739:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788574024.821751:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85c152ee00/0x5bf8706fdac8bc58 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bc5f expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574024.821763:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c85c152ee00/0x5bf8706fdac8bc58 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bc5f expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574025.365219:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574025.885320:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85de9bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875455681511808:0@lo:400: 00000100:00100000:0.0:1788574025.885428:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574025.885496:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788574025.885503:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85de9bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:69505170-06bc-41d1-9626-ab1a3c7f32a0:3618:1875455681511680:0@lo:400: 00000100:00100000:0.0:1788574025.885535:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574025.885556:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85de9bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681512192:0@lo:400: 00000100:00100000:0.0:1788574025.885577:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574025.885606:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85de9bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681511936:0@lo:400: 00000100:00100000:0.0:1788574025.885628:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574025.885661:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788574025.885666:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85de9bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875455681512064:0@lo:400: 00000100:00100000:0.0:1788574025.885686:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574025.885729:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681511808 00000100:00100000:0.0:1788574025.885738:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681511808 00000100:00100000:0.0:1788574025.885782:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681512064 00000100:00100000:0.0:1788574025.885785:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681512064 00000100:00100000:0.0:1788574025.885807:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788574025.885816:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875455681511808:12345-0@lo:400: 00000100:00100000:0.0:1788574025.885869:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875455681511808:12345-0@lo:400: Request processed in 53us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574025.885877:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788574025.885895:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788574025.885901:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875455681512064:12345-0@lo:400: 00000100:00100000:0.0:1788574025.885947:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875455681512064:12345-0@lo:400: Request processed in 45us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574025.885953:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788574025.886105:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788574025.886125:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fa0e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681512320:0@lo:41: 00000100:00100000:3.0:1788574025.886154:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574025.886210:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681511680 00000100:00100000:3.0:1788574025.886215:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681511680 00000100:00100000:3.0:1788574025.886246:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788574025.886252:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5675450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+18:3618:x1875455681511680:12345-0@lo:400: 00000100:00100000:3.0:1788574025.886281:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5675450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+18:3618:x1875455681511680:12345-0@lo:400: Request processed in 29us (746us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574025.886286:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788574025.886311:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681512192 00000100:00100000:3.0:1788574025.886314:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681512192 00000100:00100000:3.0:1788574025.886328:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681511936 00000100:00100000:3.0:1788574025.886330:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681511936 00000100:00100000:3.0:1788574025.886340:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681512320 00000100:00100000:3.0:1788574025.886342:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681512320 00000100:00100000:3.0:1788574025.886352:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788574025.886357:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3618:x1875455681512192:12345-0@lo:400: 00000100:00100000:3.0:1788574025.886384:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3618:x1875455681512192:12345-0@lo:400: Request processed in 26us (806us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574025.886390:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788574025.886398:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788574025.886403:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681511936:12345-0@lo:400: 00000100:00100000:3.0:1788574025.886438:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681511936:12345-0@lo:400: Request processed in 34us (809us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574025.886443:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788574025.886454:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788574025.886460:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa0e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681512320:12345-0@lo:41: 00000004:00000024:3.0:1788574025.886481:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1788574025.886521:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa0e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681512320:12345-0@lo:41: Request processed in 61us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574025.886526:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788574025.886570:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fa0e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681512320:0@lo:41: 00010000:00080000:0.0:1788574025.886807:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c85de9bdc00 x1875455681512064/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574041 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574025.886830:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85de9bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875455681512064:0@lo:400: 00000100:00100000:0.0:1788574025.886843:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85de9bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681511936:0@lo:400: 00000100:00100000:0.0:1788574025.886871:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85de9bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:69505170-06bc-41d1-9626-ab1a3c7f32a0:3618:1875455681511680:0@lo:400: 00000100:00100000:0.0:1788574025.886880:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85de9bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681512192:0@lo:400: 00010000:00080000:0.0:1788574025.886890:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c85de9bc380 x1875455681511808/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574041 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574025.886899:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85de9bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875455681511808:0@lo:400: 00010000:00010000:0.0:1788574026.389580:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574027.416084:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574028.438417:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574029.459506:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85e56c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681512448:0@lo:41: 00000100:00100000:2.0:1788574029.459582:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574029.459719:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681512448 00000100:00100000:1.0:1788574029.459728:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681512448 00000100:00100000:1.0:1788574029.459782:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788574029.459796:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de938000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681512448:12345-0@lo:41: 00000004:00000024:1.0:1788574029.459831:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:1.0:1788574029.459878:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de938000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681512448:12345-0@lo:41: Request processed in 83us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574029.459885:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788574029.459975:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85e56c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681512448:0@lo:41: 00010000:00010000:0.0:1788574029.460219:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574030.483366:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574030.995448:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788574030.995473:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fa0e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681512576:0@lo:41: 00000100:00100000:2.0:1788574030.995541:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574030.997387:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85de93aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875455681512832:0@lo:400: 00000100:00100000:2.0:1788574030.997448:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574030.997484:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788574030.997491:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85de93b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:69505170-06bc-41d1-9626-ab1a3c7f32a0:3618:1875455681512704:0@lo:400: 00000100:00100000:2.0:1788574030.997520:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574030.997561:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681512832 00000100:00100000:2.0:1788574030.997567:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681512832 00000100:00100000:2.0:1788574030.997612:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788574030.997622:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de93a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875455681512832:12345-0@lo:400: 00000100:00100000:2.0:1788574030.997686:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de93a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875455681512832:12345-0@lo:400: Request processed in 65us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574030.997694:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788574030.997717:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681512704 00000100:00100000:2.0:1788574030.997720:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681512704 00000100:00100000:2.0:1788574030.997743:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788574030.997750:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5676850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+18:3618:x1875455681512704:12345-0@lo:400: 00000100:00100000:2.0:1788574030.997778:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5676850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+18:3618:x1875455681512704:12345-0@lo:400: Request processed in 29us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574030.997784:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788574030.997816:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85de939880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681512960:0@lo:400: 00000100:00100000:2.0:1788574030.997843:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574030.997860:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788574030.997865:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85de939500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875455681513088:0@lo:400: 00000100:00100000:2.0:1788574030.997961:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574030.997988:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681513088 00000100:00100000:2.0:1788574030.997991:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681513088 00000100:00100000:2.0:1788574030.998013:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788574030.998018:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de938e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875455681513088:12345-0@lo:400: 00000100:00100000:2.0:1788574030.998051:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de938e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875455681513088:12345-0@lo:400: Request processed in 32us (89us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574030.998057:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788574030.998091:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85de93b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:69505170-06bc-41d1-9626-ab1a3c7f32a0:3618:1875455681512704:0@lo:400: 00010000:00080000:2.0:1788574030.998105:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c85de93aa00 x1875455681512832/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574046 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574030.998116:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85de93aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875455681512832:0@lo:400: 00010000:00080000:2.0:1788574030.998148:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c85de939500 x1875455681513088/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574046 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574030.998157:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85de939500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875455681513088:0@lo:400: 00000100:00100000:3.0:1788574030.998245:0:7533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681512576 00000100:00100000:3.0:1788574030.998250:0:7533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681512576 00000100:00100000:3.0:1788574030.998282:0:7533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681512960 00000100:00100000:3.0:1788574030.998285:0:7533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681512960 00000100:00100000:3.0:1788574030.998296:0:7533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788574030.998302:0:7533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de938a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681512576:12345-0@lo:41: 00000004:00000024:3.0:1788574030.998339:0:7533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1788574030.998380:0:7533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de938a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681512576:12345-0@lo:41: Request processed in 78us (2838us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574030.998386:0:7533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788574030.998398:0:7533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788574030.998404:0:7533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de93ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681512960:12345-0@lo:400: 00000100:00100000:3.0:1788574030.998432:0:7533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de93ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681512960:12345-0@lo:400: Request processed in 29us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574030.998437:0:7533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788574030.998469:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85de939880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681512960:0@lo:400: 00000100:00100000:3.0:1788574030.998484:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fa0e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681512576:0@lo:41: 00010000:00010000:1.0:1788574031.509463:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788574032.475054:0:8402:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788574032.475059:0:8402:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:0.0:1788574032.475061:0:8402:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1788574032.475230:0:8402:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9c85fad3f000 00000020:01000004:0.0:1788574032.475246:0:8402:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1788574032.475259:0:8402:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788574032.475285:0:8402:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9c85faf4b380) 00000020:00000080:0.0:1788574032.475312:0:8402:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788574032.523058:0:8402:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1788574032.523308:0:8402:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00010000:00010000:0.0:1788574032.536453:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:01000000:2.0:1788574032.580475:0:8402:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788574032.580859:0:8402:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788574032.580871:0:8402:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788574032.580882:0:8402:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x5bf8706fdac8bc6d 00000020:01000004:2.0:1788574032.580889:0:8402:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1788574032.580909:0:8402:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.151@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788574032.580913:0:8402:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.151@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788574032.580919:0:8402:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788574032.580924:0:8402:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788574032.580936:0:8402:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9c8600d5b380) 00000020:00000080:2.0:1788574032.580949:0:8402:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:2.0:1788574032.595004:0:8402:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788574032.595212:0:8402:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788574032.595219:0:8402:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788574032.596503:0:8402:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788574032.596515:0:8402:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1788574032.597109:0:8402:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1788574032.597117:0:8402:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1788574032.604325:0:8402:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788574032.604608:0:8402:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1788574032.604617:0:8402:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788574032.605564:0:8402:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788574032.605581:0:8402:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1788574032.642408:0:8402:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788574032.642737:0:8402:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788574032.642745:0:8402:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1788574032.644628:0:8402:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788574032.644642:0:8402:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1788574032.647572:0:8402:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788574032.647590:0:8402:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1788574032.655664:0:8402:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788574032.657044:0:8402:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1788574032.657056:0:8402:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1788574032.660831:0:8402:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1788574032.660855:0:8402:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788574032.731747:0:8402:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788574032.736105:0:8402:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1788574032.736114:0:8402:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1788574032.741895:0:8402:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1788574032.741912:0:8402:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1788574032.754344:0:8402:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1788574032.755925:0:8402:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1788574032.755940:0:8402:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.151@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1788574032.803309:0:8402:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.151@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788574032.803361:0:8402:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.151@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1788574032.803366:0:8402:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788574032.803368:0:8402:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788574032.803369:0:8402:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788574032.803370:0:8402:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788574032.803371:0:8402:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788574032.803373:0:8402:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788574032.803374:0:8402:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788574032.803376:0:8402:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788574032.803377:0:8402:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788574032.803379:0:8402:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788574032.803380:0:8402:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788574032.803384:0:8402:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1788574032.803386:0:8402:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788574032.803388:0:8402:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788574032.803389:0:8402:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788574032.803390:0:8402:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788574032.803391:0:8402:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788574032.803392:0:8402:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788574032.803393:0:8402:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788574032.803394:0:8402:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788574032.803395:0:8402:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788574032.803396:0:8402:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788574032.803397:0:8402:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788574032.803425:0:8402:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788574032.803444:0:8402:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fa0e4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:8402:1875455681513216:0@lo:253: 00000100:00100000:3.0:1788574032.803532:0:8402:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574032.803595:0:8402:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8601842240 going to sleep for 11 seconds 00000100:00100000:0.0:1788574032.803615:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681513216 00000100:00100000:0.0:1788574032.803624:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681513216 00000100:00100000:0.0:1788574032.803679:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788574032.803703:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5677050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+18:8402:x1875455681513216:12345-0@lo:253: 20000000:01000000:0.0:1788574032.803747:0:6485:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788574032.803752:0:6485:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1788574032.803757:0:6485:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1788574032.803760:0:6485:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1788574032.803969:0:6485:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788574032.804120:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1788574032.804139:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1788574032.804157:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1788574032.804163:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1788574032.804177:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1788574032.804231:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1788574032.804386:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1788574032.804412:0:6485:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.151@tcp 20000000:01000000:1.0:1788574032.804414:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.151@tcp (null) (null) (null) 00000040:00080000:1.0:1788574032.804642:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1788574032.804653:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788574032.804688:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1788574032.804696:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.204.151@tcp (null) (null) 00000040:00080000:1.0:1788574032.804711:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1788574032.804718:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1788574032.804731:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1788574032.804749:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1788574032.804830:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:1.0:1788574032.804840:0:6485:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.151@tcp 20000000:01000000:1.0:1788574032.804842:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.151@tcp (null) (null) (null) 00000040:00080000:1.0:1788574032.804856:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:1.0:1788574032.804861:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788574032.804873:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:1.0:1788574032.804879:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.204.151@tcp (null) (null) 00000040:00080000:1.0:1788574032.804892:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:1.0:1788574032.804897:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1788574032.804910:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:1.0:1788574032.804925:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:1.0:1788574032.805329:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:1.0:1788574032.805341:0:6485:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.151@tcp 20000000:01000000:1.0:1788574032.805342:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.151@tcp (null) (null) (null) 00000040:00080000:1.0:1788574032.805356:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:1.0:1788574032.805361:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788574032.805372:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:1.0:1788574032.805376:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.204.151@tcp (null) (null) 00000040:00080000:1.0:1788574032.805387:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:1.0:1788574032.805393:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1788574032.805416:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:1.0:1788574032.805595:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:1.0:1788574032.805614:0:6485:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788574032.805618:0:6485:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788574032.805621:0:6485:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788574032.805667:0:6485:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788574032.805670:0:6485:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788574032.806431:0:8421:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 18 1->4: lustre sys.timeout 20000000:01000000:3.0:1788574032.806642:0:8421:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 18 2->4: lustre sys.timeout 00000040:00080000:3.0:1788574032.806660:0:8421:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1788574032.812521:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1788574032.812564:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1788574032.812580:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:1.0:1788574032.812593:0:6485:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788574032.812596:0:6485:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788574032.814723:0:8422:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1788574032.821347:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1788574032.821392:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1788574032.821410:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:1.0:1788574032.821423:0:6485:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788574032.821426:0:6485:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788574032.825136:0:8423:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 19 1->4: lustre sys.timeout 20000000:01000000:3.0:1788574032.825225:0:8423:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 19 2->4: lustre sys.timeout 00000040:00080000:3.0:1788574032.825247:0:8423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1788574032.825980:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:1.0:1788574032.826010:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:1.0:1788574032.826026:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:1.0:1788574032.826038:0:6485:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1788574032.826041:0:6485:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788574032.826575:0:8424:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 20 1->4: lustre sys.timeout 20000000:01000000:3.0:1788574032.826606:0:8424:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 20 2->4: lustre sys.timeout 00000040:00080000:3.0:1788574032.826621:0:8424:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:1.0:1788574032.826768:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:1.0:1788574032.826786:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:1.0:1788574032.826800:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 10000000:01000000:1.0:1788574032.826813:0:6485:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788574032.826833:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c85faea2400/0x5bf8706fdac8bc7b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574032.826853:0:6485:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c85c152f600/0x5bf8706fdac8bb47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8bb40 expref: 18 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574032.826861:0:6485:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c860204bc00/0x5bf8706fdac8bbbe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8bbb7 expref: 18 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574032.826877:0:6485:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c860204a200/0x5bf8706fdac8bbf6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8bbef expref: 18 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574032.826884:0:6485:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c860204a800/0x5bf8706fdac8bc12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8bc0b expref: 18 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574032.826892:0:6485:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c860204ba00/0x5bf8706fdac8bc3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8bc35 expref: 18 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574032.826900:0:6485:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c85faea2400/0x5bf8706fdac8bc7b lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574032.826946:0:6485:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c860204ba00/0x5bf8706fdac8bc3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5bf8706fdac8bc35 expref: 18 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574032.826961:0:6485:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c860204ba00/0x5bf8706fdac8bc3c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5bf8706fdac8bc35 expref: 18 pid: 6485 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574032.826977:0:6485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85e56c0700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6485:1875455681513344:0@lo:104: 00000100:00100000:1.0:1788574032.827047:0:6485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788574032.827108:0:6485:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c860204a800/0x5bf8706fdac8bc12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5bf8706fdac8bc0b expref: 18 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574032.827116:0:6485:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c860204a800/0x5bf8706fdac8bc12 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5bf8706fdac8bc0b expref: 18 pid: 6486 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574032.827125:0:6485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85e56c0e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6485:1875455681513472:0@lo:104: 00000100:00100000:1.0:1788574032.827147:0:6485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788574032.827181:0:6485:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c860204a200/0x5bf8706fdac8bbf6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5bf8706fdac8bbef expref: 18 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574032.827223:0:6485:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c860204a200/0x5bf8706fdac8bbf6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5bf8706fdac8bbef expref: 18 pid: 6486 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574032.827232:0:6485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85e56c1180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6485:1875455681513600:0@lo:104: 00000100:00100000:1.0:1788574032.827269:0:6485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788574032.827301:0:6485:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c860204bc00/0x5bf8706fdac8bbbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5bf8706fdac8bbb7 expref: 18 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574032.827309:0:6485:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c860204bc00/0x5bf8706fdac8bbbe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5bf8706fdac8bbb7 expref: 18 pid: 6487 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574032.827317:0:6485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85e56c3480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6485:1875455681513728:0@lo:104: 00000100:00100000:1.0:1788574032.827337:0:6485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788574032.827352:0:6485:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c85c152f600/0x5bf8706fdac8bb47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5bf8706fdac8bb40 expref: 18 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574032.827360:0:6485:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c85c152f600/0x5bf8706fdac8bb47 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5bf8706fdac8bb40 expref: 18 pid: 6486 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574032.827368:0:6485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85e56c2d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6485:1875455681513856:0@lo:104: 00000100:00100000:1.0:1788574032.827384:0:6485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574032.827393:0:6485:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85d0174780 going to sleep for 11 seconds 00000100:00100000:2.0:1788574032.827485:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681513344 00000100:00100000:2.0:1788574032.827494:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681513344 00000100:00100000:2.0:1788574032.827541:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681513472 00000100:00100000:2.0:1788574032.827545:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681513472 00000100:00100000:2.0:1788574032.827555:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681513600 00000100:00100000:2.0:1788574032.827557:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681513600 00000100:00100000:2.0:1788574032.827565:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681513728 00000100:00100000:2.0:1788574032.827568:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681513728 00000100:00100000:2.0:1788574032.827588:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681513856 00000100:00100000:2.0:1788574032.827591:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681513856 00000100:00100000:2.0:1788574032.827603:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788574032.827611:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e56c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:69505170-06bc-41d1-9626-ab1a3c7f32a0+7:6485:x1875455681513344:12345-0@lo:104: 00010000:00010000:2.0:1788574032.827623:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff9c860204b800/0x5bf8706fdac8bc35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8bc3c expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574032.827685:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788574032.827691:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e56c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:69505170-06bc-41d1-9626-ab1a3c7f32a0+7:6485:x1875455681513344:12345-0@lo:104: Request processed in 81us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574032.827697:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788574032.827714:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788574032.827719:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e56c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:69505170-06bc-41d1-9626-ab1a3c7f32a0+6:6485:x1875455681513472:12345-0@lo:104: 00010000:00010000:2.0:1788574032.827726:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff9c860204b400/0x5bf8706fdac8bc0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8bc12 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574032.827756:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788574032.827761:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e56c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:69505170-06bc-41d1-9626-ab1a3c7f32a0+6:6485:x1875455681513472:12345-0@lo:104: Request processed in 43us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574032.827767:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788574032.827779:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788574032.827784:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e56c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:69505170-06bc-41d1-9626-ab1a3c7f32a0+5:6485:x1875455681513600:12345-0@lo:104: 00010000:00010000:2.0:1788574032.827792:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff9c860204b000/0x5bf8706fdac8bbef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8bbf6 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574032.827824:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788574032.827829:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e56c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:69505170-06bc-41d1-9626-ab1a3c7f32a0+5:6485:x1875455681513600:12345-0@lo:104: Request processed in 46us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574032.827845:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788574032.827859:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788574032.827865:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e56c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:69505170-06bc-41d1-9626-ab1a3c7f32a0+4:6485:x1875455681513728:12345-0@lo:104: 00010000:00010000:2.0:1788574032.827872:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff9c85c152e600/0x5bf8706fdac8bbb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8bbbe expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574032.827899:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788574032.827904:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e56c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:69505170-06bc-41d1-9626-ab1a3c7f32a0+4:6485:x1875455681513728:12345-0@lo:104: Request processed in 40us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574032.827909:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788574032.827920:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788574032.827926:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e56c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:69505170-06bc-41d1-9626-ab1a3c7f32a0+3:6485:x1875455681513856:12345-0@lo:104: 00010000:00010000:2.0:1788574032.827933:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff9c860204a000/0x5bf8706fdac8bb40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8bb47 expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574032.827956:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1788574032.827961:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e56c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:69505170-06bc-41d1-9626-ab1a3c7f32a0+3:6485:x1875455681513856:12345-0@lo:104: Request processed in 36us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574032.827967:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1788574032.827982:0:7444:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788574032.827988:0:7444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c860204b800/0x5bf8706fdac8bc35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8bc3c expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574032.827995:0:7444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c860204b800 already unused, calling callback (ffffffffc1472c20) 10000000:00010000:2.0:1788574032.827999:0:7444:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c860204b800/0x5bf8706fdac8bc35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x5bf8706fdac8bc3c expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574032.828018:0:7444:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c860204b800/0x5bf8706fdac8bc35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x5bf8706fdac8bc3c expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788574032.828026:0:7444:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c860204b800/0x5bf8706fdac8bc35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x5bf8706fdac8bc3c expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788574032.828031:0:7444:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788574032.828063:0:7444:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9c860204b800/0x5bf8706fdac8bc35 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bc3c expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574032.828070:0:7444:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788574032.828089:0:7444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c860204b800/0x5bf8706fdac8bc35 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bc3c expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574032.828097:0:7444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c860204b800/0x5bf8706fdac8bc35 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bc3c expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574032.828112:0:7444:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788574032.828115:0:7444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c860204b400/0x5bf8706fdac8bc0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8bc12 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574032.828120:0:7444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c860204b400 already unused, calling callback (ffffffffc1472c20) 10000000:00010000:2.0:1788574032.828123:0:7444:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c860204b400/0x5bf8706fdac8bc0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5bf8706fdac8bc12 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574032.828130:0:7444:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c860204b400/0x5bf8706fdac8bc0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5bf8706fdac8bc12 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788574032.828137:0:7444:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c860204b400/0x5bf8706fdac8bc0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5bf8706fdac8bc12 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788574032.828148:0:7444:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788574032.828162:0:7444:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9c860204b400/0x5bf8706fdac8bc0b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bc12 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574032.828167:0:7444:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788574032.828172:0:7444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c860204b400/0x5bf8706fdac8bc0b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bc12 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574032.828178:0:7444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c860204b400/0x5bf8706fdac8bc0b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bc12 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574032.828211:0:7444:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788574032.828215:0:7444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c860204b000/0x5bf8706fdac8bbef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8bbf6 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574032.828221:0:7444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c860204b000 already unused, calling callback (ffffffffc1472c20) 10000000:00010000:2.0:1788574032.828223:0:7444:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c860204b000/0x5bf8706fdac8bbef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5bf8706fdac8bbf6 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574032.828230:0:7444:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c860204b000/0x5bf8706fdac8bbef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5bf8706fdac8bbf6 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788574032.828236:0:7444:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c860204b000/0x5bf8706fdac8bbef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5bf8706fdac8bbf6 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788574032.828241:0:7444:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788574032.828253:0:7444:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9c860204b000/0x5bf8706fdac8bbef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bbf6 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574032.828259:0:7444:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788574032.828295:0:7444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c860204b000/0x5bf8706fdac8bbef lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bbf6 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574032.828303:0:7444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c860204b000/0x5bf8706fdac8bbef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bbf6 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574032.828314:0:7444:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788574032.828317:0:7444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c85c152e600/0x5bf8706fdac8bbb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8bbbe expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574032.828322:0:7444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85c152e600 already unused, calling callback (ffffffffc1472c20) 10000000:00010000:2.0:1788574032.828325:0:7444:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c85c152e600/0x5bf8706fdac8bbb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5bf8706fdac8bbbe expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574032.828332:0:7444:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c85c152e600/0x5bf8706fdac8bbb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5bf8706fdac8bbbe expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788574032.828338:0:7444:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c85c152e600/0x5bf8706fdac8bbb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5bf8706fdac8bbbe expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788574032.828344:0:7444:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788574032.828358:0:7444:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9c85c152e600/0x5bf8706fdac8bbb7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bbbe expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574032.828363:0:7444:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788574032.828368:0:7444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c85c152e600/0x5bf8706fdac8bbb7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bbbe expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574032.828374:0:7444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c85c152e600/0x5bf8706fdac8bbb7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bbbe expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574032.828383:0:7444:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788574032.828392:0:7444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c860204a000/0x5bf8706fdac8bb40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8bb47 expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574032.828398:0:7444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c860204a000 already unused, calling callback (ffffffffc1472c20) 10000000:00010000:2.0:1788574032.828401:0:7444:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c860204a000/0x5bf8706fdac8bb40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5bf8706fdac8bb47 expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574032.828408:0:7444:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c860204a000/0x5bf8706fdac8bb40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5bf8706fdac8bb47 expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788574032.828414:0:7444:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c860204a000/0x5bf8706fdac8bb40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5bf8706fdac8bb47 expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788574032.828419:0:7444:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788574032.828432:0:7444:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9c860204a000/0x5bf8706fdac8bb40 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bb47 expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574032.828438:0:7444:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788574032.828442:0:7444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c860204a000/0x5bf8706fdac8bb40 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bb47 expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574032.828448:0:7444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c860204a000/0x5bf8706fdac8bb40 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bb47 expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574032.828463:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574032.828464:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574032.828466:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574032.828490:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85de939500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:69505170-06bc-41d1-9626-ab1a3c7f32a0:3617:1875455681513984:0@lo:103: 00000100:00100000:2.0:1788574032.828526:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574032.828558:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85de938700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:69505170-06bc-41d1-9626-ab1a3c7f32a0:3617:1875455681514496:0@lo:103: 00000100:00100000:2.0:1788574032.828591:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574032.828614:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788574032.828620:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85de93aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:69505170-06bc-41d1-9626-ab1a3c7f32a0:3617:1875455681514112:0@lo:103: 00000100:00100000:2.0:1788574032.828653:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574032.828685:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85de93b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69505170-06bc-41d1-9626-ab1a3c7f32a0:3619:1875455681514240:0@lo:103: 00000100:00100000:2.0:1788574032.828709:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574032.828728:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788574032.828733:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85de93a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69505170-06bc-41d1-9626-ab1a3c7f32a0:3619:1875455681514368:0@lo:103: 00000100:00100000:2.0:1788574032.828756:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574032.828777:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681513984 00000100:00100000:2.0:1788574032.828783:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681513984 00010000:00010000:2.0:1788574032.828814:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c860204ba00/0x5bf8706fdac8bc3c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8bc35 expref: 19 pid: 6485 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574032.828830:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681514496 00000100:00100000:2.0:1788574032.828834:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681514496 00010000:00010000:2.0:1788574032.828845:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c85c152f600/0x5bf8706fdac8bb47 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8bb40 expref: 20 pid: 6486 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574032.828855:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681514112 00000100:00100000:2.0:1788574032.828858:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681514112 00010000:00010000:2.0:1788574032.828868:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c860204a800/0x5bf8706fdac8bc12 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8bc0b expref: 21 pid: 6486 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574032.828878:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681514240 00000100:00100000:2.0:1788574032.828880:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681514240 00010000:00010000:2.0:1788574032.828890:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c860204a200/0x5bf8706fdac8bbf6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8bbef expref: 22 pid: 6486 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574032.828900:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681514368 00000100:00100000:2.0:1788574032.828909:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681514368 00010000:00010000:2.0:1788574032.828922:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c860204bc00/0x5bf8706fdac8bbbe lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8bbb7 expref: 23 pid: 6487 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574032.828935:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788574032.828941:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de939c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69505170-06bc-41d1-9626-ab1a3c7f32a0+23:3617:x1875455681513984:12345-0@lo:103: 00010000:00010000:2.0:1788574032.828962:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788574032.828968:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c860204ba00/0x5bf8706fdac8bc3c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8bc35 expref: 23 pid: 6485 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574032.828979:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c860204ba00/0x5bf8706fdac8bc3c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5bf8706fdac8bc35 expref: 23 pid: 6485 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574032.828996:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788574032.829028:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de939c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69505170-06bc-41d1-9626-ab1a3c7f32a0+23:3617:x1875455681513984:12345-0@lo:103: Request processed in 87us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574032.829034:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788574032.829048:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788574032.829054:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de939880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69505170-06bc-41d1-9626-ab1a3c7f32a0+22:3617:x1875455681514496:12345-0@lo:103: 00010000:00010000:2.0:1788574032.829062:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788574032.829065:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c85c152f600/0x5bf8706fdac8bb47 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8bb40 expref: 22 pid: 6486 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574032.829074:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c85c152f600/0x5bf8706fdac8bb47 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5bf8706fdac8bb40 expref: 22 pid: 6486 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574032.829083:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788574032.829111:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de939880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69505170-06bc-41d1-9626-ab1a3c7f32a0+22:3617:x1875455681514496:12345-0@lo:103: Request processed in 57us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574032.829117:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788574032.829137:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788574032.829143:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69505170-06bc-41d1-9626-ab1a3c7f32a0+21:3617:x1875455681514112:12345-0@lo:103: 00010000:00010000:2.0:1788574032.829149:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788574032.829154:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c860204a800/0x5bf8706fdac8bc12 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8bc0b expref: 21 pid: 6486 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574032.829161:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c860204a800/0x5bf8706fdac8bc12 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5bf8706fdac8bc0b expref: 21 pid: 6486 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574032.829171:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788574032.829216:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69505170-06bc-41d1-9626-ab1a3c7f32a0+21:3617:x1875455681514112:12345-0@lo:103: Request processed in 74us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574032.829222:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788574032.829232:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788574032.829238:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69505170-06bc-41d1-9626-ab1a3c7f32a0+20:3619:x1875455681514240:12345-0@lo:103: 00010000:00010000:2.0:1788574032.829244:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788574032.829248:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c860204a200/0x5bf8706fdac8bbf6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8bbef expref: 20 pid: 6486 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574032.829256:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c860204a200/0x5bf8706fdac8bbf6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5bf8706fdac8bbef expref: 20 pid: 6486 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574032.829264:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788574032.829301:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69505170-06bc-41d1-9626-ab1a3c7f32a0+20:3619:x1875455681514240:12345-0@lo:103: Request processed in 63us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574032.829307:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788574032.829316:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788574032.829322:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e0b7a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69505170-06bc-41d1-9626-ab1a3c7f32a0+19:3619:x1875455681514368:12345-0@lo:103: 00010000:00010000:2.0:1788574032.829328:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788574032.829337:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c860204bc00/0x5bf8706fdac8bbbe lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8bbb7 expref: 19 pid: 6487 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574032.829346:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c860204bc00/0x5bf8706fdac8bbbe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5bf8706fdac8bbb7 expref: 19 pid: 6487 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574032.829357:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c85faea2400/0x5bf8706fdac8bc7b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574032.829364:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85faea2400/0x5bf8706fdac8bc7b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574032.829377:0:6479:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c85faea2400/0x5bf8706fdac8bc7b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574032.829384:0:6479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c85faea2400/0x5bf8706fdac8bc7b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574032.829391:0:6479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c85faea2400/0x5bf8706fdac8bc7b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574032.829397:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c85faea2400/0x5bf8706fdac8bc7b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574032.829403:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85faea2400 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:2.0:1788574032.829407:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c85faea2400/0x5bf8706fdac8bc7b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574032.829416:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c85faea2400/0x5bf8706fdac8bc7b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574032.829424:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c85faea2400/0x5bf8706fdac8bc7b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574032.829444:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788574032.829464:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e0b7a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69505170-06bc-41d1-9626-ab1a3c7f32a0+19:3619:x1875455681514368:12345-0@lo:103: Request processed in 143us (708us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574032.829470:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788574032.829531:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85de93a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69505170-06bc-41d1-9626-ab1a3c7f32a0:3619:1875455681514368:0@lo:103: 00000100:00100000:2.0:1788574032.829538:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85de93b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69505170-06bc-41d1-9626-ab1a3c7f32a0:3619:1875455681514240:0@lo:103: 00000100:00100000:2.0:1788574032.829558:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85de93aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:69505170-06bc-41d1-9626-ab1a3c7f32a0:3617:1875455681514112:0@lo:103: 00000100:00100000:2.0:1788574032.829564:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85de939500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:69505170-06bc-41d1-9626-ab1a3c7f32a0:3617:1875455681513984:0@lo:103: 00000100:00100000:2.0:1788574032.829570:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85de938700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:69505170-06bc-41d1-9626-ab1a3c7f32a0:3617:1875455681514496:0@lo:103: 00010000:00010000:1.0:1788574032.829932:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574032.829940:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574032.829972:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c860204ba00/0x5bf8706fdac8bc3c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5bf8706fdac8bc35 expref: 18 pid: 6485 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574032.829987:0:6485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85e56c0700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6485:1875455681513344:0@lo:104: 00010000:00010000:1.0:1788574032.830009:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c860204a800/0x5bf8706fdac8bc12 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5bf8706fdac8bc0b expref: 17 pid: 6486 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574032.830018:0:6485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85e56c0e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6485:1875455681513472:0@lo:104: 00010000:00010000:1.0:1788574032.830027:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c860204a200/0x5bf8706fdac8bbf6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5bf8706fdac8bbef expref: 16 pid: 6486 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574032.830034:0:6485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85e56c1180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6485:1875455681513600:0@lo:104: 00010000:00010000:1.0:1788574032.830042:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c860204bc00/0x5bf8706fdac8bbbe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5bf8706fdac8bbb7 expref: 15 pid: 6487 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574032.830049:0:6485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85e56c3480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6485:1875455681513728:0@lo:104: 00010000:00010000:1.0:1788574032.830057:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85c152f600/0x5bf8706fdac8bb47 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5bf8706fdac8bb40 expref: 14 pid: 6486 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574032.830065:0:6485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85e56c2d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6485:1875455681513856:0@lo:104: 00010000:00010000:1.0:1788574032.830085:0:6485:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c85faea2400/0x5bf8706fdac8bc7b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574032.830095:0:6485:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c85faea2400/0x5bf8706fdac8bc7b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574032.830101:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c85faea2400/0x5bf8706fdac8bc7b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574032.830108:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85faea2400/0x5bf8706fdac8bc7b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788574032.830120:0:6485:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1788574032.833707:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5677050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+13:8402:x1875455681513216:12345-0@lo:253: Request processed in 29995us (30163us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574032.833721:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788574032.833847:0:8402:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fa0e4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:8402:1875455681513216:0@lo:253: 10000000:01000000:3.0:1788574032.833864:0:8402:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788574032.833867:0:8402:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788574032.833869:0:8402:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788574032.833870:0:8402:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788574032.833871:0:8402:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1788574032.833873:0:8402:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788574032.833874:0:8402:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788574032.833876:0:8402:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788574032.833877:0:8402:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788574032.833879:0:8402:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788574032.833880:0:8402:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788574032.833902:0:8402:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c85fad3f000 from lustre-OST0000 10000000:01000000:3.0:1788574032.833931:0:8402:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788574032.833934:0:8402:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788574032.833942:0:8402:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9c85e56999c0 local copy 10000000:01000000:3.0:1788574032.833946:0:8402:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788574032.833985:0:8402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85c152f200/0x5bf8706fdac8bc82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574032.833996:0:8402:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.151@tcp lock: ffff9c85c152f200/0x5bf8706fdac8bc82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574032.834006:0:8402:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c85c152f200/0x5bf8706fdac8bc82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574032.834024:0:8402:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fa0e4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:8402:1875455681514624:0@lo:101: 00000100:00100000:3.0:1788574032.834062:0:8402:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574032.834104:0:8402:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8601842600 going to sleep for 11 seconds 00000100:00100000:2.0:1788574032.834153:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681514624 00000100:00100000:2.0:1788574032.834161:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681514624 00000100:00100000:2.0:1788574032.834234:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788574032.834243:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5675850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+13:8402:x1875455681514624:12345-0@lo:101: 00010000:00010000:2.0:1788574032.834256:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574032.834269:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c860217f200/0x5bf8706fdac8bc89 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8bc82 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574032.834304:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c860217f200/0x5bf8706fdac8bc89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8bc82 expref: 14 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574032.834314:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c860217f200/0x5bf8706fdac8bc89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8bc82 expref: 14 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574032.834323:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c860217f200, rc 0) 00000100:00100000:2.0:1788574032.834356:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5675850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+14:8402:x1875455681514624:12345-0@lo:101: Request processed in 114us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574032.834377:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788574032.834472:0:8402:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fa0e4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:8402:1875455681514624:0@lo:101: 00010000:00010000:1.0:1788574032.834486:0:8402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c85c152f200/0x5bf8706fdac8bc82 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x5bf8706fdac8bc89 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574032.834495:0:8402:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c85c152f200/0x5bf8706fdac8bc82 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x5bf8706fdac8bc89 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574032.834586:0:8402:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85e56c2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:8402:1875455681514752:0@lo:501: 00000100:00100000:1.0:1788574032.834614:0:8402:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574032.834637:0:8402:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85d0174240 going to sleep for 11 seconds 00000100:00100000:2.0:1788574032.834736:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681514752 00000100:00100000:2.0:1788574032.834741:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681514752 00000100:00100000:2.0:1788574032.834773:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788574032.834779:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5677450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+14:8402:x1875455681514752:12345-0@lo:501: 00000100:00100000:2.0:1788574032.834841:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5677450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+14:8402:x1875455681514752:12345-0@lo:501: Request processed in 62us (225us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788574032.834849:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788574032.834958:0:8402:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85e56c2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:8402:1875455681514752:0@lo:501: 10000000:01000000:1.0:1788574032.834972:0:8402:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.151@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788574032.834987:0:8402:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.151@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788574032.834993:0:8402:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85c152f200/0x5bf8706fdac8bc82 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x5bf8706fdac8bc89 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574032.835001:0:8402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85c152f200/0x5bf8706fdac8bc82 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x5bf8706fdac8bc89 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574032.835008:0:8402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.151@tcp lock: ffff9c85c152f200/0x5bf8706fdac8bc82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x5bf8706fdac8bc89 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574032.835030:0:8402:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788574032.835051:0:8402:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c85fad3f000 10000000:01000000:1.0:1788574032.835057:0:8402:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788574032.835068:0:8402:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788574032.835071:0:8402:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788574032.835076:0:8402:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1788574032.835078:0:8402:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788574032.835095:0:8402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85faea2a00/0x5bf8706fdac8bc90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574032.835102:0:8402:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c85faea2a00/0x5bf8706fdac8bc90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574032.835110:0:8402:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c85faea2a00/0x5bf8706fdac8bc90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574032.835122:0:8402:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85e56c2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:8402:1875455681514880:0@lo:101: 00000100:00100000:1.0:1788574032.835148:0:8402:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574032.835182:0:8402:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85d0174a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788574032.835252:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681514880 00000100:00100000:3.0:1788574032.835262:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681514880 00000100:00100000:3.0:1788574032.835306:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788574032.835313:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5674850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+14:8402:x1875455681514880:12345-0@lo:101: 00010000:00010000:3.0:1788574032.835320:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574032.835330:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85c152fe00/0x5bf8706fdac8bc97 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8bc90 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574032.835348:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85c152fe00/0x5bf8706fdac8bc97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8bc90 expref: 15 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574032.835357:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85c152fe00/0x5bf8706fdac8bc97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8bc90 expref: 15 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574032.835364:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85c152fe00, rc 0) 00000100:00100000:3.0:1788574032.835393:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5674850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+15:8402:x1875455681514880:12345-0@lo:101: Request processed in 80us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574032.835398:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00010000:2.0:1788574032.835469:0:7444:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788574032.835475:0:7444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c85c152f200/0x5bf8706fdac8bc82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x5bf8706fdac8bc89 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574032.835482:0:7444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85c152f200 already unused, calling callback (ffffffffc1472c20) 10000000:00010000:2.0:1788574032.835485:0:7444:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c85c152f200/0x5bf8706fdac8bc82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x5bf8706fdac8bc89 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574032.835494:0:7444:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c85c152f200/0x5bf8706fdac8bc82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x5bf8706fdac8bc89 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788574032.835500:0:7444:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c85c152f200/0x5bf8706fdac8bc82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x5bf8706fdac8bc89 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788574032.835505:0:7444:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788574032.835524:0:7444:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9c85c152f200/0x5bf8706fdac8bc82 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x5bf8706fdac8bc89 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574032.835531:0:7444:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788574032.835555:0:7444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c85c152f200/0x5bf8706fdac8bc82 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x5bf8706fdac8bc89 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574032.835574:0:7444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c85c152f200/0x5bf8706fdac8bc82 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x5bf8706fdac8bc89 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574032.835587:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574032.835589:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574032.835591:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574032.835599:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788574032.835610:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:69505170-06bc-41d1-9626-ab1a3c7f32a0:3617:1875455681515008:0@lo:103: 00000100:00100000:2.0:1788574032.835640:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574032.835676:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681515008 00000100:00100000:2.0:1788574032.835681:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681515008 00000100:00100000:2.0:1788574032.835711:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788574032.835719:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69505170-06bc-41d1-9626-ab1a3c7f32a0+15:3617:x1875455681515008:12345-0@lo:103: 00010000:00010000:2.0:1788574032.835728:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788574032.835739:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c860217f200/0x5bf8706fdac8bc89 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5bf8706fdac8bc82 expref: 15 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574032.835751:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788574032.835779:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69505170-06bc-41d1-9626-ab1a3c7f32a0+14:3617:x1875455681515008:12345-0@lo:103: Request processed in 61us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574032.835786:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788574032.835815:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:69505170-06bc-41d1-9626-ab1a3c7f32a0:3617:1875455681515008:0@lo:103: 00000100:00100000:1.0:1788574032.836136:0:8402:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85e56c2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:8402:1875455681514880:0@lo:101: 00010000:00010000:1.0:1788574032.836152:0:8402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c85faea2a00/0x5bf8706fdac8bc90 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bc97 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574032.836160:0:8402:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c85faea2a00/0x5bf8706fdac8bc90 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8bc97 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574032.836262:0:8402:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85e56c2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:8402:1875455681515136:0@lo:501: 00000100:00100000:1.0:1788574032.836303:0:8402:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574032.836324:0:8402:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85d0174a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788574032.836395:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681515136 00000100:00100000:3.0:1788574032.836401:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681515136 00000100:00100000:3.0:1788574032.836425:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788574032.836433:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5676c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+14:8402:x1875455681515136:12345-0@lo:501: 00000100:00100000:3.0:1788574032.836559:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5676c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+14:8402:x1875455681515136:12345-0@lo:501: Request processed in 127us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574032.836567:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788574032.836721:0:8402:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85e56c2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:8402:1875455681515136:0@lo:501: 00000100:00100000:1.0:1788574032.836749:0:8402:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85e56c2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:8402:1875455681515264:0@lo:503: 00000100:00100000:1.0:1788574032.836802:0:8402:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574032.836836:0:8402:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85d0174a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788574032.837001:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681515264 00000100:00100000:3.0:1788574032.837006:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681515264 00000100:00100000:3.0:1788574032.837040:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788574032.837046:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5674c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+14:8402:x1875455681515264:12345-0@lo:503: 00000100:00100000:3.0:1788574032.837160:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5674c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+14:8402:x1875455681515264:12345-0@lo:503: Request processed in 112us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574032.837172:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788574032.837326:0:8402:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85e56c2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:8402:1875455681515264:0@lo:503: 00000040:00080000:2.0:1788574032.837702:0:8402:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788574032.837780:0:8402:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:8402:1875455681515392:0@lo:502: 00000100:00100000:2.0:1788574032.837828:0:8402:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574032.837975:0:8402:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c53cb900 going to sleep for 11 seconds 00000100:00100000:3.0:1788574032.838101:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681515392 00000100:00100000:3.0:1788574032.838106:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681515392 00000100:00100000:0.0:1788574032.843562:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788574032.843589:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5677c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+14:8402:x1875455681515392:12345-0@lo:502: 00000100:00100000:0.0:1788574032.843790:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5677c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+14:8402:x1875455681515392:12345-0@lo:502: Request processed in 214us (5960us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574032.843798:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788574032.843937:0:8402:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:8402:1875455681515392:0@lo:502: 00000040:00080000:2.0:1788574032.844187:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788574032.844236:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1788574032.844251:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1788574032.844265:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1788574032.844280:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1788574032.844320:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1788574032.844356:0:8402:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:8402:1875455681515520:0@lo:502: 00000100:00100000:2.0:1788574032.844401:0:8402:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574032.844442:0:8402:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c53cb900 going to sleep for 11 seconds 00000100:00100000:0.0:1788574032.844602:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681515520 00000100:00100000:0.0:1788574032.844610:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681515520 00000100:00100000:0.0:1788574032.844644:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788574032.844651:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5672050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+14:8402:x1875455681515520:12345-0@lo:502: 00000100:00100000:0.0:1788574032.844740:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5672050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+14:8402:x1875455681515520:12345-0@lo:502: Request processed in 88us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574032.844747:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788574032.844896:0:8402:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:8402:1875455681515520:0@lo:502: 00000040:00080000:2.0:1788574032.844936:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1788574032.844944:0:8402:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:2.0:1788574032.845346:0:8425:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788574032.845353:0:8425:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1788574032.845360:0:8425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574032.845362:0:8425:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1788574032.845367:0:8425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788574032.845381:0:8425:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9c8600d5cd40) 00000020:00000080:2.0:1788574032.845402:0:8425:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788574032.845408:0:8425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788574032.845479:0:8425:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c85fad3f000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1788574032.845487:0:8425:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788574032.845492:0:8425:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x5bf8706fdac8bca5 00010000:00010000:2.0:1788574032.858937:0:8425:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:2.0:1788574032.859547:0:8425:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1788574032.871921:0:8425:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1788574032.878271:0:8425:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:0.0:1788574032.883722:0:8425:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:0.0:1788574032.887893:0:8425:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:0.0:1788574032.895711:0:8425:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:2.0:1788574032.897941:0:8425:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1788574032.897955:0:8425:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788574032.897977:0:8425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574032.897979:0:8425:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1788574032.897983:0:8425:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788574032.897988:0:8425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574032.897989:0:8425:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788574032.897992:0:8425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788574032.897994:0:8425:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788574032.898015:0:8425:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788574032.898018:0:8425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574032.898020:0:8425:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788574032.898023:0:8425:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1788574032.898234:0:8402:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1788574032.898262:0:8402:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788574032.898279:0:8402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85faea2a00/0x5bf8706fdac8bc90 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bc97 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574032.898303:0:8402:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c85faea2a00/0x5bf8706fdac8bc90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bc97 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788574032.898311:0:8402:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c85fad3f000 from 1 10000000:01000000:3.0:1788574032.898313:0:8402:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788574032.898348:0:8402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85c152f400/0x5bf8706fdac8bcac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574032.898356:0:8402:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c85c152f400/0x5bf8706fdac8bcac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574032.898366:0:8402:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c85c152f400/0x5bf8706fdac8bcac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574032.898389:0:8402:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fa0e7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:8402:1875455681515648:0@lo:101: 00000100:00100000:3.0:1788574032.898466:0:8402:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574032.898514:0:8402:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c1b38f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788574032.898589:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681515648 00000100:00100000:0.0:1788574032.898602:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681515648 00000100:00100000:0.0:1788574032.898645:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788574032.898653:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5673850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+14:8402:x1875455681515648:12345-0@lo:101: 00010000:00010000:0.0:1788574032.898667:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574032.898678:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85d20d7a00/0x5bf8706fdac8bcb3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8bcac expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574032.898701:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85d20d7a00/0x5bf8706fdac8bcb3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8bcac expref: 15 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574032.898711:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85d20d7a00/0x5bf8706fdac8bcb3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8bcac expref: 15 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574032.898719:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d20d7a00, rc 0) 00000100:00100000:0.0:1788574032.898755:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5673850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+15:8402:x1875455681515648:12345-0@lo:101: Request processed in 103us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574032.898761:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788574032.899376:0:8402:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fa0e7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:8402:1875455681515648:0@lo:101: 00010000:00010000:3.0:1788574032.899394:0:8402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c85c152f400/0x5bf8706fdac8bcac lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bcb3 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574032.899414:0:8402:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c85c152f400/0x5bf8706fdac8bcac lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8bcb3 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574032.899525:0:8402:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fa0e7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:8402:1875455681515776:0@lo:501: 00000100:00100000:3.0:1788574032.899564:0:8402:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574032.899594:0:8402:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c1b38f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788574032.899976:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681515776 00000100:00100000:0.0:1788574032.899983:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681515776 00000100:00100000:0.0:1788574032.900022:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788574032.900030:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5671050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+15:8402:x1875455681515776:12345-0@lo:501: 00000100:00100000:0.0:1788574032.900147:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5671050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+15:8402:x1875455681515776:12345-0@lo:501: Request processed in 117us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574032.900154:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788574032.902804:0:8402:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fa0e7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:8402:1875455681515776:0@lo:501: 00000100:00100000:2.0:1788574032.902864:0:8402:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:8402:1875455681515904:0@lo:503: 00000100:00100000:2.0:1788574032.902934:0:8402:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574032.902983:0:8402:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c53cb780 going to sleep for 11 seconds 00000100:00100000:3.0:1788574032.903128:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681515904 00000100:00100000:3.0:1788574032.903135:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681515904 00000100:00100000:3.0:1788574032.903184:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788574032.903214:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5671c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+15:8402:x1875455681515904:12345-0@lo:503: 00000100:00100000:3.0:1788574032.903335:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5671c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+15:8402:x1875455681515904:12345-0@lo:503: Request processed in 122us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574032.903342:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788574032.903447:0:8402:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:8402:1875455681515904:0@lo:503: 00000040:00080000:2.0:1788574032.903691:0:8402:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788574032.903757:0:8402:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:8402:1875455681516032:0@lo:502: 00000100:00100000:2.0:1788574032.903805:0:8402:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574032.903830:0:8402:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c8a2d840 going to sleep for 11 seconds 00000100:00100000:3.0:1788574032.904000:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681516032 00000100:00100000:3.0:1788574032.904005:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681516032 00000100:00100000:3.0:1788574032.904040:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788574032.904047:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5671450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+15:8402:x1875455681516032:12345-0@lo:502: 00000100:00100000:3.0:1788574032.904121:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5671450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+15:8402:x1875455681516032:12345-0@lo:502: Request processed in 73us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574032.904128:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788574032.904351:0:8402:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:8402:1875455681516032:0@lo:502: 00000040:00080000:2.0:1788574032.904560:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1788574032.904587:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1788574032.904610:0:8402:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:8402:1875455681516160:0@lo:502: 00000100:00100000:2.0:1788574032.904644:0:8402:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574032.904679:0:8402:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c8a2d840 going to sleep for 11 seconds 00000100:00100000:3.0:1788574032.904778:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681516160 00000100:00100000:3.0:1788574032.904784:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681516160 00000100:00100000:3.0:1788574032.904816:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788574032.904824:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5672850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+15:8402:x1875455681516160:12345-0@lo:502: 00000100:00100000:3.0:1788574032.904902:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5672850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+15:8402:x1875455681516160:12345-0@lo:502: Request processed in 79us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574032.904918:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788574032.905520:0:8402:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:8402:1875455681516160:0@lo:502: 00000040:00080000:0.0:1788574032.905585:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1788574032.905594:0:8402:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1788574032.907657:0:8429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788574032.907675:0:8429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788574032.907678:0:8429:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788574032.907685:0:8429:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c85fad3f000 00000020:00000080:0.0:1788574032.907688:0:8429:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788574032.907701:0:8429:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788574032.907703:0:8429:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788574032.907705:0:8429:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788574032.907707:0:8429:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1788574032.907809:0:8402:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788574032.907905:0:8402:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788574032.907928:0:8402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85c152f400/0x5bf8706fdac8bcac lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bcb3 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574032.907940:0:8402:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c85c152f400/0x5bf8706fdac8bcac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bcb3 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788574032.908120:0:8402:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788574032.908123:0:8402:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c85fad3f000 10000000:01000000:1.0:1788574032.908127:0:8402:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c85fad3f000 10000000:01000000:1.0:1788574032.908131:0:8402:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788574032.908137:0:8402:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c85fad3f000 from 1 10000000:01000000:1.0:1788574032.908140:0:8402:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788574032.908186:0:8402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85faea2400/0x5bf8706fdac8bcba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574032.908232:0:8402:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c85faea2400/0x5bf8706fdac8bcba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574032.908242:0:8402:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c85faea2400/0x5bf8706fdac8bcba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574032.908265:0:8402:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85e56c3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:8402:1875455681516288:0@lo:101: 00000100:00100000:1.0:1788574032.908339:0:8402:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574032.908488:0:8402:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85d0174a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788574032.908527:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681516288 00000100:00100000:2.0:1788574032.908534:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681516288 00000100:00100000:2.0:1788574032.908616:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788574032.908636:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5673050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+15:8402:x1875455681516288:12345-0@lo:101: 00010000:00010000:2.0:1788574032.908649:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574032.908661:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c860217f200/0x5bf8706fdac8bcc1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8bcba expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574032.908685:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c860217f200/0x5bf8706fdac8bcc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8bcba expref: 16 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574032.908697:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c860217f200/0x5bf8706fdac8bcc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8bcba expref: 16 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574032.908705:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c860217f200, rc 0) 00000100:00100000:2.0:1788574032.908795:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5673050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+16:8402:x1875455681516288:12345-0@lo:101: Request processed in 160us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574032.908802:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788574032.908929:0:8402:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85e56c3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:8402:1875455681516288:0@lo:101: 00010000:00010000:1.0:1788574032.908943:0:8402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c85faea2400/0x5bf8706fdac8bcba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bcc1 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574032.909102:0:8402:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c85faea2400/0x5bf8706fdac8bcba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8bcc1 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574032.909292:0:8402:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85e56c3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:8402:1875455681516416:0@lo:501: 00000100:00100000:1.0:1788574032.909326:0:8402:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574032.909392:0:8402:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85d0174a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788574032.909483:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681516416 00000100:00100000:2.0:1788574032.909488:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681516416 00000100:00100000:2.0:1788574032.909518:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788574032.909526:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5671850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+16:8402:x1875455681516416:12345-0@lo:501: 00000100:00100000:2.0:1788574032.909628:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5671850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+16:8402:x1875455681516416:12345-0@lo:501: Request processed in 103us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574032.909635:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788574032.909705:0:8402:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85e56c3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:8402:1875455681516416:0@lo:501: 00000100:00100000:1.0:1788574032.909733:0:8402:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85e56c3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:8402:1875455681516544:0@lo:503: 00000100:00100000:1.0:1788574032.909776:0:8402:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574032.909796:0:8402:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85d0174a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788574032.909845:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681516544 00000100:00100000:2.0:1788574032.909849:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681516544 00000100:00100000:2.0:1788574032.909880:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788574032.909886:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5673450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+16:8402:x1875455681516544:12345-0@lo:503: 00000100:00100000:2.0:1788574032.909980:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5673450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+16:8402:x1875455681516544:12345-0@lo:503: Request processed in 94us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574032.909997:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788574032.910584:0:8402:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85e56c3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:8402:1875455681516544:0@lo:503: 00000040:00080000:1.0:1788574032.910917:0:8402:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788574032.911011:0:8402:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85e56c3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:8402:1875455681516672:0@lo:502: 00000100:00100000:1.0:1788574032.911062:0:8402:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574032.911102:0:8402:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85d0174a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788574032.911232:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681516672 00000100:00100000:2.0:1788574032.911237:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681516672 00000100:00100000:2.0:1788574032.911271:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788574032.911279:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5670850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+16:8402:x1875455681516672:12345-0@lo:502: 00000100:00100000:2.0:1788574032.911376:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5670850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+16:8402:x1875455681516672:12345-0@lo:502: Request processed in 98us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574032.911383:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788574032.911711:0:8402:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85e56c3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:8402:1875455681516672:0@lo:502: 00000040:00080000:1.0:1788574032.912461:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1788574032.912496:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1788574032.912508:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1788574032.912519:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1788574032.912531:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1788574032.912542:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1788574032.912553:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1788574032.912564:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1788574032.912575:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1788574032.912586:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1788574032.912608:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1788574032.912619:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1788574032.912630:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1788574032.912643:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1788574032.912655:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1788574032.912668:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1788574032.912681:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1788574032.912695:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1788574032.912707:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1788574032.912718:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1788574032.912728:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1788574032.912738:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1788574032.912747:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1788574032.912760:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1788574032.912782:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:1.0:1788574032.912795:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:1.0:1788574032.912805:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:1.0:1788574032.912815:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:1.0:1788574032.912825:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:1.0:1788574032.912835:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:1.0:1788574032.912849:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:1.0:1788574032.912862:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:1.0:1788574032.912890:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:1.0:1788574032.912906:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:1.0:1788574032.912919:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:1.0:1788574032.912928:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:1.0:1788574032.912938:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:1.0:1788574032.912978:0:8402:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85e56c3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:8402:1875455681516800:0@lo:502: 00000100:00100000:1.0:1788574032.913041:0:8402:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574032.913089:0:8402:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85d0174a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788574032.913789:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681516800 00000100:00100000:3.0:1788574032.913798:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681516800 00000100:00100000:2.0:1788574032.913876:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788574032.913886:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5670c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+16:8402:x1875455681516800:12345-0@lo:502: 00000100:00100000:2.0:1788574032.914081:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5670c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+16:8402:x1875455681516800:12345-0@lo:502: Request processed in 196us (1038us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574032.914088:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788574032.914378:0:8402:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85e56c3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:8402:1875455681516800:0@lo:502: 00000040:00080000:1.0:1788574032.914920:0:8402:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:1.0:1788574032.914936:0:8402:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1788574032.915590:0:8430:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788574032.915606:0:8430:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9c85e569b380) 00000020:00000080:3.0:1788574032.915627:0:8430:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1788574032.915714:0:8430:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c85fad3f000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788574032.915717:0:8430:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c85fad3f000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788574032.915720:0:8430:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c85fad3f000 3 00010000:00080000:3.0:1788574032.915761:0:8430:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c84c2274000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.151@tcp at head 00010000:00010000:3.0:1788574032.917947:0:8430:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:3.0:1788574032.918250:0:8430:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1788574032.918304:0:8430:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788574032.918317:0:8430:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x5bf8706fdac8bccf 00000100:00080000:3.0:1788574032.918327:0:8430:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788574032.918333:0:8430:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c84c2274000 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:3.0:1788574032.918369:0:8430:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c85fa0e7800 x1875455681516928/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788574032.918397:0:8430:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788574032.918455:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fa0e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1875455681516928:0@lo:38: 00000100:00100000:0.0:1788574032.918526:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574032.918563:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85e56c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681517440:0@lo:400: 00000100:00100000:1.0:1788574032.918598:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574032.918627:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788574032.918633:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85e56c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875455681517312:0@lo:400: 00000100:00100000:1.0:1788574032.918658:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574032.918668:0:7533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681517440 00000100:00100000:0.0:1788574032.918675:0:7533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681517440 00000100:00100000:1.0:1788574032.918685:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85e56c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681517184:0@lo:400: 00000100:00100000:1.0:1788574032.918707:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574032.918713:0:7533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681517184 00000100:00100000:0.0:1788574032.918716:0:7533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681517184 00000100:00100000:1.0:1788574032.918722:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788574032.918727:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85e56c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875455681517056:0@lo:400: 00000100:00100000:0.0:1788574032.918731:0:7533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788574032.918739:0:7533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e56c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681517440:12345-0@lo:400: 00000100:00100000:1.0:1788574032.918758:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574032.918790:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788574032.918791:0:7533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e56c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681517440:12345-0@lo:400: Request processed in 52us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574032.918797:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e56c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681517184:12345-0@lo:400: 00000100:00100000:0.0:1788574032.918798:0:7533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788574032.918847:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e56c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681517184:12345-0@lo:400: Request processed in 51us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574032.918854:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788574032.918890:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85e56c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681517440:0@lo:400: 00000100:00100000:0.0:1788574032.918896:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85e56c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681517184:0@lo:400: 00000100:00100000:3.0:1788574032.919147:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681516928 00000100:00100000:3.0:1788574032.919152:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681516928 00000100:00100000:3.0:1788574032.919178:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681517312 00000100:00100000:3.0:1788574032.919182:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681517312 00000100:00100000:0.0:1788574032.919213:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681517056 00000100:00100000:0.0:1788574032.919217:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681517056 00000100:00100000:3.0:1788574032.919233:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788574032.919312:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e56c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875455681517312:12345-0@lo:400: 00000100:00100000:3.0:1788574032.919362:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e56c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875455681517312:12345-0@lo:400: Request processed in 123us (703us total) trans 0 rc 0/0 00010000:00080000:1.0:1788574032.919412:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c85e56c0e00 x1875455681517312/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574048 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574032.919422:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85e56c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875455681517312:0@lo:400: 00000100:00100000:0.0:1788574032.920457:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788574032.920472:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c2336d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875455681517056:12345-0@lo:400: 00000100:00100000:0.0:1788574032.920546:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c2336d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875455681517056:12345-0@lo:400: Request processed in 79us (1786us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574032.920553:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788574032.920577:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788574032.920582:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1875455681516928:12345-0@lo:38: 00010000:00080000:0.0:1788574032.920608:0:6492:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 172 last 0 00000020:00000080:0.0:1788574032.920641:0:6492:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x5bf8706fdac8bcd6 00000004:00100000:0.0:1788574032.920656:0:6492:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788574032.920689:0:6492:0:(import.c:65:import_set_state_nolock()) ffff9c85fad6f800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788574032.920730:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875455681516928:12345-0@lo:38: Request processed in 147us (2204us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574032.920736:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788574032.920776:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c85fa0e7800 x1875455681516928/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788574042 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574032.920786:0:3616:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788574032.920792:0:3616:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1788574032.920799:0:3616:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788574032.920803:0:3616:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788574032.920805:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c84c2274000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788574032.920811:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fa0e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1875455681516928:0@lo:38: 00000100:00100000:3.0:1788574032.921679:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1788574032.921786:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c85e56c3480 x1875455681517056/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574048 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574032.921798:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85e56c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875455681517056:0@lo:400: 00000020:01000004:3.0:1788574032.922328:0:8430:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788574032.922345:0:8430:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9c85e569cd40) 00000020:00000080:3.0:1788574032.922366:0:8430:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:3.0:1788574032.922441:0:8430:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c85fad3f000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788574032.922446:0:8430:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c85fad3f000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788574032.922448:0:8430:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c85fad3f000 3 00010000:00080000:3.0:1788574032.922477:0:8430:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c84c2270800@lustre-MDT0001-lwp-OST0000: add connection 192.168.204.151@tcp at head 00010000:00010000:3.0:1788574032.924551:0:8430:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:3.0:1788574032.924768:0:8430:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1788574032.924810:0:8430:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788574032.924823:0:8430:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x5bf8706fdac8bce4 00000100:00080000:3.0:1788574032.924833:0:8430:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788574032.924838:0:8430:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9c84c2270800 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:3.0:1788574032.924873:0:8430:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c85fa0e4e00 x1875455681517568/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788574032.924904:0:8430:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1788574032.928596:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fa0e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3616:1875455681517568:0@lo:38: 00000100:00100000:0.0:1788574032.928675:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574032.928750:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681517568 00000100:00100000:0.0:1788574032.928757:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681517568 00000100:00100000:0.0:1788574032.928789:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788574032.928796:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1875455681517568:12345-0@lo:38: 00010000:00080000:0.0:1788574032.928822:0:6492:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 172 last 0 00000020:00000080:0.0:1788574032.928856:0:6492:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x5bf8706fdac8bceb 00000004:00100000:0.0:1788574032.928871:0:6492:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788574032.928904:0:6492:0:(import.c:65:import_set_state_nolock()) ffff9c85fad69800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788574032.928968:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875455681517568:12345-0@lo:38: Request processed in 171us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574032.928976:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788574032.929014:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c85fa0e4e00 x1875455681517568/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788574042 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574032.929025:0:3616:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788574032.929033:0:3616:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1788574032.929040:0:3616:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788574032.929045:0:3616:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788574032.929047:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c84c2270800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788574032.929053:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fa0e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3616:1875455681517568:0@lo:38: 00000040:00080000:2.0:1788574032.936774:0:8430:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:1.0:1788574032.938784:0:8402:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1788574032.938826:0:8402:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788574032.938852:0:8402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85faea2400/0x5bf8706fdac8bcba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bcc1 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574032.938865:0:8402:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c85faea2400/0x5bf8706fdac8bcba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bcc1 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788574032.938913:0:8402:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788574032.938916:0:8402:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788574032.938917:0:8402:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788574032.938919:0:8402:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788574032.938920:0:8402:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788574032.938921:0:8402:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788574032.938922:0:8402:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788574032.938924:0:8402:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788574032.938925:0:8402:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788574032.938927:0:8402:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788574032.938929:0:8402:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788574032.938932:0:8402:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1788574032.938935:0:8402:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788574032.938937:0:8402:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788574032.938938:0:8402:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788574032.938939:0:8402:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788574032.938940:0:8402:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788574032.938941:0:8402:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788574032.938942:0:8402:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788574032.938944:0:8402:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788574032.938945:0:8402:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788574032.938946:0:8402:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788574032.938947:0:8402:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788574032.938972:0:8402:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788574032.938990:0:8402:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2335f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:8402:1875455681517696:0@lo:253: 00000100:00100000:1.0:1788574032.939060:0:8402:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574032.939108:0:8402:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85d01740c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788574032.939141:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681517696 00000100:00100000:1.0:1788574032.939153:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681517696 00000100:00100000:1.0:1788574032.939223:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788574032.939232:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5672c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+16:8402:x1875455681517696:12345-0@lo:253: 20000000:01000000:1.0:1788574032.939257:0:6485:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788574032.939270:0:6485:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788574032.945008:0:6485:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788574032.945028:0:6485:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1788574032.945434:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5672c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+16:8402:x1875455681517696:12345-0@lo:253: Request processed in 6199us (6370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574032.945446:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788574032.945766:0:8402:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2335f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:8402:1875455681517696:0@lo:253: 10000000:01000000:2.0:1788574032.945781:0:8402:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788574032.945785:0:8402:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788574032.945786:0:8402:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788574032.945788:0:8402:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788574032.945789:0:8402:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788574032.945790:0:8402:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788574032.945792:0:8402:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788574032.945793:0:8402:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788574032.945795:0:8402:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788574032.945796:0:8402:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788574032.945797:0:8402:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788574032.945799:0:8402:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788574032.945812:0:8402:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1788574032.946148:0:6508:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788574032.946153:0:6508:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788574032.946174:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c85c152ea00/0x5bf8706fdac8bcf2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574032.946206:0:6508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c860217ee00/0x5bf8706fdac8bbe8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8bbe1 expref: 15 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574032.946216:0:6508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c860217ec00/0x5bf8706fdac8bc04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8bbfd expref: 15 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574032.946224:0:6508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c85c152ea00/0x5bf8706fdac8bcf2 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574032.946262:0:6508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c860217ec00/0x5bf8706fdac8bc04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5bf8706fdac8bbfd expref: 15 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574032.946300:0:6508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c860217ec00/0x5bf8706fdac8bc04 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5bf8706fdac8bbfd expref: 15 pid: 6485 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574032.946315:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fa0e6680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6508:1875455681517824:0@lo:104: 00000100:00100000:3.0:1788574032.946359:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788574032.946472:0:6508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c860217ee00/0x5bf8706fdac8bbe8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5bf8706fdac8bbe1 expref: 15 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574032.946481:0:6508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c860217ee00/0x5bf8706fdac8bbe8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5bf8706fdac8bbe1 expref: 15 pid: 6485 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574032.946490:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fa0e6d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6508:1875455681517952:0@lo:104: 00000100:00100000:3.0:1788574032.946510:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c1b38840 going to sleep for 11 seconds 00000100:00100000:1.0:1788574032.955596:0:6476:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788574032.955642:0:6476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574032.955683:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681517824 00000100:00100000:1.0:1788574032.955691:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681517824 00000100:00100000:1.0:1788574032.955724:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681517952 00000100:00100000:1.0:1788574032.955727:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681517952 00000100:00100000:1.0:1788574032.955742:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788574032.955750:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa36e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:69505170-06bc-41d1-9626-ab1a3c7f32a0+4:6508:x1875455681517824:12345-0@lo:104: 00080000:10000000:3.0:1788574032.955764:0:8402:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00010000:00010000:1.0:1788574032.955768:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff9c860204ac00/0x5bf8706fdac8bbfd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8bc04 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574032.955836:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788574032.955842:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa36e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:69505170-06bc-41d1-9626-ab1a3c7f32a0+4:6508:x1875455681517824:12345-0@lo:104: Request processed in 93us (9483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574032.955849:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788574032.955884:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788574032.955889:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c2335880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:69505170-06bc-41d1-9626-ab1a3c7f32a0+3:6508:x1875455681517952:12345-0@lo:104: 00010000:00010000:1.0:1788574032.955897:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff9c85c152e000/0x5bf8706fdac8bbe1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8bbe8 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:3.0:1788574032.955932:0:8402:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00010000:00010000:1.0:1788574032.955942:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788574032.955946:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c2335880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:69505170-06bc-41d1-9626-ab1a3c7f32a0+3:6508:x1875455681517952:12345-0@lo:104: Request processed in 58us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574032.955952:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00080000:10000000:3.0:1788574032.956129:0:8402:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1788574032.956315:0:8402:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00000100:00100000:1.0:1788574032.956358:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fa0e6680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6508:1875455681517824:0@lo:104: 00000100:00100000:1.0:1788574032.956369:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fa0e6d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6508:1875455681517952:0@lo:104: 00010000:00010000:1.0:1788574032.956393:0:6508:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c85c152ea00/0x5bf8706fdac8bcf2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574032.956412:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788574032.956418:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c860204ac00/0x5bf8706fdac8bbfd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8bc04 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574032.956425:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c860204ac00 already unused, calling callback (ffffffffc1472c20) 10000000:00010000:1.0:1788574032.956429:0:6480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c860204ac00/0x5bf8706fdac8bbfd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5bf8706fdac8bc04 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574032.956438:0:6480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c860204ac00/0x5bf8706fdac8bbfd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5bf8706fdac8bc04 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788574032.956446:0:6480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c860204ac00/0x5bf8706fdac8bbfd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5bf8706fdac8bc04 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788574032.956452:0:6480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00080000:10000000:3.0:1788574032.956537:0:8402:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00010000:00010000:1.0:1788574032.956682:0:6480:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9c860204ac00/0x5bf8706fdac8bbfd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bc04 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574032.956690:0:6480:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788574032.956717:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c860204ac00/0x5bf8706fdac8bbfd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bc04 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574032.956724:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c860204ac00/0x5bf8706fdac8bbfd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bc04 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574032.956736:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788574032.956739:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c85c152e000/0x5bf8706fdac8bbe1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8bbe8 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574032.956746:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85c152e000 already unused, calling callback (ffffffffc1472c20) 10000000:00010000:1.0:1788574032.956748:0:6480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c85c152e000/0x5bf8706fdac8bbe1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5bf8706fdac8bbe8 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:3.0:1788574032.956749:0:8402:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00010000:00010000:1.0:1788574032.956755:0:6480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c85c152e000/0x5bf8706fdac8bbe1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5bf8706fdac8bbe8 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788574032.956761:0:6480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c85c152e000/0x5bf8706fdac8bbe1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5bf8706fdac8bbe8 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788574032.956766:0:6480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788574032.956785:0:6480:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9c85c152e000/0x5bf8706fdac8bbe1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bbe8 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574032.956791:0:6480:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788574032.956796:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c85c152e000/0x5bf8706fdac8bbe1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bbe8 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574032.956802:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c85c152e000/0x5bf8706fdac8bbe1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bbe8 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574032.956814:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574032.956822:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574032.956823:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574032.956830:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574032.956844:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2337100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69505170-06bc-41d1-9626-ab1a3c7f32a0:3619:1875455681518080:0@lo:103: 00000100:00100000:1.0:1788574032.956888:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574032.956940:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788574032.956945:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2335500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69505170-06bc-41d1-9626-ab1a3c7f32a0:3619:1875455681518208:0@lo:103: 00000100:00100000:3.0:1788574032.957400:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681518080 00000100:00100000:3.0:1788574032.957407:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681518080 00010000:00010000:3.0:1788574032.957431:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c860217ec00/0x5bf8706fdac8bc04 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8bbfd expref: 16 pid: 6485 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574032.957529:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788574032.957538:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c2335180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:69505170-06bc-41d1-9626-ab1a3c7f32a0+16:3619:x1875455681518080:12345-0@lo:103: 00010000:00010000:3.0:1788574032.957552:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574032.957568:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c860217ec00/0x5bf8706fdac8bc04 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8bbfd expref: 16 pid: 6485 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574032.957580:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c860217ec00/0x5bf8706fdac8bc04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5bf8706fdac8bbfd expref: 16 pid: 6485 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574032.957594:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c860217ec00/0x5bf8706fdac8bc04 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5bf8706fdac8bbfd expref: 16 pid: 6485 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574032.957606:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788574032.957645:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c2335180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:69505170-06bc-41d1-9626-ab1a3c7f32a0+15:3619:x1875455681518080:12345-0@lo:103: Request processed in 109us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574032.957652:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788574032.958792:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574032.958845:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2337100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69505170-06bc-41d1-9626-ab1a3c7f32a0:3619:1875455681518080:0@lo:103: 00000100:00100000:2.0:1788574032.958984:0:7433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681518208 00000100:00100000:2.0:1788574032.958991:0:7433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681518208 00010000:00010000:2.0:1788574032.959026:0:7433:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c860217ee00/0x5bf8706fdac8bbe8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8bbe1 expref: 15 pid: 6485 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574032.959063:0:7433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788574032.959071:0:7433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c2337b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:69505170-06bc-41d1-9626-ab1a3c7f32a0+15:3619:x1875455681518208:12345-0@lo:103: 00010000:00010000:2.0:1788574032.959083:0:7433:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788574032.959088:0:7433:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c860217ee00/0x5bf8706fdac8bbe8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8bbe1 expref: 15 pid: 6485 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574032.959100:0:7433:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c860217ee00/0x5bf8706fdac8bbe8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5bf8706fdac8bbe1 expref: 15 pid: 6485 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574032.959114:0:7433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c860217ee00/0x5bf8706fdac8bbe8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5bf8706fdac8bbe1 expref: 15 pid: 6485 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574032.959130:0:7433:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c85c152ea00/0x5bf8706fdac8bcf2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574032.959138:0:7433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85c152ea00/0x5bf8706fdac8bcf2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788574032.959155:0:7433:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.013002044s 00010000:00010000:2.0:1788574032.959159:0:7433:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c85c152ea00/0x5bf8706fdac8bcf2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574032.959166:0:7433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c85c152ea00/0x5bf8706fdac8bcf2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574032.959173:0:7433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c85c152ea00/0x5bf8706fdac8bcf2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574032.959179:0:7433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c85c152ea00/0x5bf8706fdac8bcf2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574032.959214:0:7433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85c152ea00 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:2.0:1788574032.959218:0:7433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c85c152ea00/0x5bf8706fdac8bcf2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574032.959226:0:7433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c85c152ea00/0x5bf8706fdac8bcf2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574032.959242:0:7433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c85c152ea00/0x5bf8706fdac8bcf2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574032.959254:0:7433:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788574032.959308:0:7433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c2337b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:69505170-06bc-41d1-9626-ab1a3c7f32a0+14:3619:x1875455681518208:12345-0@lo:103: Request processed in 238us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574032.959315:0:7433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:1.0:1788574032.960232:0:6508:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c85c152ea00/0x5bf8706fdac8bcf2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574032.960244:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c85c152ea00/0x5bf8706fdac8bcf2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574032.960252:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85c152ea00/0x5bf8706fdac8bcf2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574032.960304:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2335500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69505170-06bc-41d1-9626-ab1a3c7f32a0:3619:1875455681518208:0@lo:103: 00000001:00000004:3.0:1788574032.960602:0:8402:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1788574032.975548:0:8402:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1788574032.975563:0:8402:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1788574032.975600:0:8402:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788574032.975644:0:8402:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.151@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788574032.975661:0:8402:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1788574032.975683:0:8402:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1788574032.976387:0:8402:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788574032.976561:0:8402:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:2.0:1788574033.555442:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788574034.103010:0:8486:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788574034.103504:0:8486:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788574034.582425:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2335500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681518336:0@lo:41: 00000100:00100000:3.0:1788574034.582499:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788574034.582687:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574034.583390:0:7533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681518336 00000100:00100000:2.0:1788574034.583400:0:7533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681518336 00000100:00100000:2.0:1788574034.583457:0:7533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788574034.583467:0:7533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa0e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681518336:12345-0@lo:41: 00000004:00000024:2.0:1788574034.583507:0:7533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:2.0:1788574034.585600:0:7533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa0e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681518336:12345-0@lo:41: Request processed in 2125us (3093us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574034.585615:0:7533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788574034.587313:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2335500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681518336:0@lo:41: 00010000:00010000:2.0:1788574035.606696:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574036.117981:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788574036.118005:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fa0e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681518464:0@lo:41: 00000100:00100000:3.0:1788574036.118076:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574036.119982:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681518464 00000100:00100000:1.0:1788574036.119994:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681518464 00000100:00100000:1.0:1788574036.120052:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788574036.120061:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa0e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681518464:12345-0@lo:41: 00000004:00000024:1.0:1788574036.120095:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1788574036.120165:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa0e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681518464:12345-0@lo:41: Request processed in 105us (2089us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574036.120172:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788574036.120270:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fa0e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681518464:0@lo:41: 00010000:00010000:1.0:1788574036.630439:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574037.651432:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574038.172227:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788574038.172468:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788574038.172494:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fa0e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875455681518720:0@lo:400: 00000100:00100000:1.0:1788574038.172566:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574038.173402:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fa0e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:69505170-06bc-41d1-9626-ab1a3c7f32a0:3620:1875455681518592:0@lo:400: 00000100:00100000:2.0:1788574038.173454:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574038.173509:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681518592 00000100:00100000:2.0:1788574038.173525:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681518592 00000100:00100000:2.0:1788574038.173583:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788574038.173593:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5673c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+14:3620:x1875455681518592:12345-0@lo:400: 00000100:00100000:0.0:1788574038.174818:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681518720 00000100:00100000:0.0:1788574038.174828:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681518720 00000100:00100000:0.0:1788574038.174877:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788574038.174886:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c2337100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875455681518720:12345-0@lo:400: 00000100:00100000:0.0:1788574038.174963:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c2337100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875455681518720:12345-0@lo:400: Request processed in 79us (2397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574038.174971:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1788574038.175022:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c85fa0e6680 x1875455681518720/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574054 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574038.175032:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5673c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+14:3620:x1875455681518592:12345-0@lo:400: Request processed in 1438us (1572us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574038.175041:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fa0e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875455681518720:0@lo:400: 00000100:00100000:2.0:1788574038.175044:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788574038.175102:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fa0e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:69505170-06bc-41d1-9626-ab1a3c7f32a0:3620:1875455681518592:0@lo:400: 00000100:00100000:3.0:1788574038.177628:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fa0e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681519104:0@lo:400: 00000100:00100000:3.0:1788574038.177732:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574038.177771:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788574038.177778:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fa0e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3619:1875455681519232:0@lo:400: 00000100:00100000:3.0:1788574038.177810:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574038.177839:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fa0e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681518848:0@lo:400: 00000100:00100000:3.0:1788574038.177863:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574038.177881:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fa0e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1875455681519360:0@lo:400: 00000100:00100000:3.0:1788574038.177917:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574038.177933:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788574038.177939:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fa0e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875455681518976:0@lo:400: 00000100:00100000:3.0:1788574038.177960:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574038.177992:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681519232 00000100:00100000:3.0:1788574038.177999:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681519232 00000100:00100000:3.0:1788574038.178057:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681519360 00000100:00100000:3.0:1788574038.178060:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681519360 00000100:00100000:3.0:1788574038.178075:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681518976 00000100:00100000:3.0:1788574038.178078:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681518976 00000100:00100000:3.0:1788574038.178096:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788574038.178104:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa32b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875455681519232:12345-0@lo:400: 00000100:00100000:3.0:1788574038.178152:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa32b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875455681519232:12345-0@lo:400: Request processed in 50us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574038.178159:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788574038.178175:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788574038.178332:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa329180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875455681519360:12345-0@lo:400: 00000100:00100000:3.0:1788574038.178370:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa329180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875455681519360:12345-0@lo:400: Request processed in 190us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574038.178377:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788574038.178398:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788574038.178404:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa32bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875455681518976:12345-0@lo:400: 00000100:00100000:3.0:1788574038.178433:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa32bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875455681518976:12345-0@lo:400: Request processed in 30us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574038.178438:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788574038.178455:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681519104 00000100:00100000:3.0:1788574038.178458:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681519104 00000100:00100000:3.0:1788574038.178476:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681518848 00000100:00100000:3.0:1788574038.178479:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681518848 00000100:00100000:3.0:1788574038.178489:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788574038.178495:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa329880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681519104:12345-0@lo:400: 00000100:00100000:3.0:1788574038.178527:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa329880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681519104:12345-0@lo:400: Request processed in 32us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574038.178533:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788574038.178544:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788574038.178551:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa329500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681518848:12345-0@lo:400: 00000100:00100000:3.0:1788574038.178577:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa329500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681518848:12345-0@lo:400: Request processed in 27us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574038.178583:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:3.0:1788574038.178621:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c85fa0e4e00 x1875455681518976/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574054 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574038.178634:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fa0e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875455681518976:0@lo:400: 00000100:00100000:3.0:1788574038.178645:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fa0e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681518848:0@lo:400: 00010000:00080000:3.0:1788574038.178655:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c85fa0e6680 x1875455681519360/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574054 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574038.178662:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fa0e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1875455681519360:0@lo:400: 00010000:00080000:3.0:1788574038.178772:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c85fa0e5500 x1875455681519232/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574054 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574038.178782:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fa0e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3619:1875455681519232:0@lo:400: 00000100:00100000:3.0:1788574038.178794:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fa0e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681519104:0@lo:400: 00000100:00080000:3.0:1788574038.178830:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788574038.178834:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788574038.675307:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574039.700271:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574039.700452:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788574039.700475:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fa32aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681519488:0@lo:41: 00000100:00100000:2.0:1788574039.700545:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574039.700898:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681519488 00000100:00100000:1.0:1788574039.700906:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681519488 00000100:00100000:1.0:1788574039.701025:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788574039.701036:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681519488:12345-0@lo:41: 00000004:00000024:1.0:1788574039.701073:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:1.0:1788574039.701136:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681519488:12345-0@lo:41: Request processed in 102us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574039.701143:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788574039.701531:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fa32aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681519488:0@lo:41: 00000001:02000400:2.0:1788574040.176748:0:8776:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg451-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 10000000:01000000:0.0:1788574040.727210:0:6490:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788574040.727226:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c85fa390800 from 30 10000000:01000000:0.0:1788574040.727231:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788574040.727273:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7400/0x5bf8706fdac8bcf9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574040.727285:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7400/0x5bf8706fdac8bcf9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574040.727296:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7400/0x5bf8706fdac8bcf9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574040.727320:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf5c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681519616:0@lo:101: 00000100:00100000:0.0:1788574040.727390:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574040.727448:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c3597240 going to sleep for 11 seconds 00000100:00100000:3.0:1788574040.728246:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681519616 00000100:00100000:3.0:1788574040.728255:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681519616 00000100:00100000:3.0:1788574040.728312:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788574040.728322:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5672450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+14:6490:x1875455681519616:12345-0@lo:101: 00010000:00010000:3.0:1788574040.728335:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574040.728349:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85c152ea00/0x5bf8706fdac8bd00 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8bcf9 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574040.728371:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85c152ea00/0x5bf8706fdac8bd00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8bcf9 expref: 15 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574040.728382:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85c152ea00/0x5bf8706fdac8bd00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8bcf9 expref: 15 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574040.728390:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85c152ea00, rc 0) 00000100:00100000:3.0:1788574040.728440:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5672450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+15:6490:x1875455681519616:12345-0@lo:101: Request processed in 120us (1050us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574040.728446:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788574040.728495:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf5c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681519616:0@lo:101: 00010000:00010000:3.0:1788574040.728510:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7400/0x5bf8706fdac8bcf9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bd00 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574040.728529:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7400/0x5bf8706fdac8bcf9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8bd00 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574040.728593:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fa32b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681519744:0@lo:501: 00000100:00100000:3.0:1788574040.728616:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574040.728755:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85fa3da300 going to sleep for 11 seconds 00000100:00100000:0.0:1788574040.728819:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681519744 00000100:00100000:0.0:1788574040.728824:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681519744 00000100:00100000:0.0:1788574040.728856:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788574040.728863:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5670450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+15:6490:x1875455681519744:12345-0@lo:501: 00000100:00100000:0.0:1788574040.728983:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5670450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+15:6490:x1875455681519744:12345-0@lo:501: Request processed in 120us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574040.728990:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788574040.729213:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fa32b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681519744:0@lo:501: 00000100:00100000:3.0:1788574040.729245:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fa32b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681519872:0@lo:503: 00000100:00100000:3.0:1788574040.729286:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574040.729315:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85fa3da300 going to sleep for 11 seconds 00000100:00100000:0.0:1788574040.729368:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681519872 00000100:00100000:0.0:1788574040.729372:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681519872 00000100:00100000:0.0:1788574040.729399:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788574040.729405:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5670050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+15:6490:x1875455681519872:12345-0@lo:503: 00000100:00100000:0.0:1788574040.729480:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5670050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+15:6490:x1875455681519872:12345-0@lo:503: Request processed in 74us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574040.729486:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788574040.729774:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fa32b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681519872:0@lo:503: 00000100:00100000:3.0:1788574040.730378:0:8802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fa32b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:8802:1875455681520000:0@lo:502: 00000100:00100000:3.0:1788574040.730421:0:8802:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574040.730484:0:8802:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85fa3dad80 going to sleep for 11 seconds 00010000:00010000:2.0:1788574040.731749:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574040.732918:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681520000 00000100:00100000:0.0:1788574040.732940:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681520000 00000100:00100000:0.0:1788574040.733033:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788574040.733043:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e564fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+15:8802:x1875455681520000:12345-0@lo:502: 00000100:00100000:0.0:1788574040.733345:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e564fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+15:8802:x1875455681520000:12345-0@lo:502: Request processed in 302us (2920us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574040.733353:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788574040.733477:0:8802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fa32b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:8802:1875455681520000:0@lo:502: 00000100:00100000:3.0:1788574040.733537:0:8802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fa32b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:8802:1875455681520128:0@lo:502: 00000100:00100000:3.0:1788574040.733573:0:8802:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574040.733595:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681520128 00000100:00100000:3.0:1788574040.733598:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681520128 00000100:00100000:3.0:1788574040.733633:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788574040.733639:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e564e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+15:8802:x1875455681520128:12345-0@lo:502: 00000100:00100000:3.0:1788574040.733804:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e564e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+15:8802:x1875455681520128:12345-0@lo:502: Request processed in 165us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574040.733819:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788574040.733859:0:8802:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85fa3dad80 going to sleep for 11 seconds 00000100:00100000:3.0:1788574040.733869:0:8802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fa32b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:8802:1875455681520128:0@lo:502: 00000040:00080000:3.0:1788574040.733885:0:8802:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1788574040.734008:0:6490:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1788574040.734035:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788574040.734045:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7400/0x5bf8706fdac8bcf9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bd00 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574040.734056:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7400/0x5bf8706fdac8bcf9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bd00 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788574040.734067:0:6490:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788574040.734070:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c85fa390800 from 5 10000000:01000000:0.0:1788574040.734072:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788574040.734114:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7800/0x5bf8706fdac8bd07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574040.734123:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7800/0x5bf8706fdac8bd07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574040.734140:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7800/0x5bf8706fdac8bd07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574040.734155:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf5ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681520256:0@lo:101: 00000100:00100000:0.0:1788574040.734184:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574040.734356:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c53cb780 going to sleep for 11 seconds 00000100:00100000:0.0:1788574040.734370:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681520256 00000100:00100000:0.0:1788574040.734380:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681520256 00000100:00100000:0.0:1788574040.734403:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788574040.734408:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e564c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+15:6490:x1875455681520256:12345-0@lo:101: 00010000:00010000:0.0:1788574040.734417:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574040.734428:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85d20d6e00/0x5bf8706fdac8bd0e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8bd07 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574040.734447:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85d20d6e00/0x5bf8706fdac8bd0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8bd07 expref: 16 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574040.734457:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85d20d6e00/0x5bf8706fdac8bd0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8bd07 expref: 16 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574040.734466:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d20d6e00, rc 0) 00000100:00100000:0.0:1788574040.734493:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e564c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+16:6490:x1875455681520256:12345-0@lo:101: Request processed in 85us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574040.734498:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788574040.734541:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf5ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681520256:0@lo:101: 00010000:00010000:0.0:1788574040.734554:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7800/0x5bf8706fdac8bd07 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bd0e expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574040.734562:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7800/0x5bf8706fdac8bd07 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8bd0e expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574040.734606:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf5ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681520384:0@lo:256: 00000100:00100000:0.0:1788574040.734941:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574040.734966:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8601989780 going to sleep for 11 seconds 00000100:00100000:2.0:1788574040.735011:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681520384 00000100:00100000:2.0:1788574040.735016:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681520384 00000100:00100000:2.0:1788574040.735048:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788574040.735056:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e564c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+16:6490:x1875455681520384:12345-0@lo:256: 20000000:01000000:2.0:1788574040.735071:0:6487:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788574040.735099:0:6487:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788574040.735103:0:6487:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1788574040.735214:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e564c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+16:6490:x1875455681520384:12345-0@lo:256: Request processed in 135us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574040.735221:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788574040.735352:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf5ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681520384:0@lo:256: 10000000:01000000:0.0:1788574040.735402:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788574040.735410:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7800/0x5bf8706fdac8bd07 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bd0e expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574040.735418:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7800/0x5bf8706fdac8bd07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bd0e expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788574040.735425:0:6490:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1788574040.735427:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:0.0:1788574040.735430:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1788574040.735449:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7e00/0x5bf8706fdac8bd15 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574040.735456:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7e00/0x5bf8706fdac8bd15 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574040.735463:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7e00/0x5bf8706fdac8bd15 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574040.735476:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf5ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681520512:0@lo:101: 00000100:00100000:0.0:1788574040.735501:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574040.735534:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8601989780 going to sleep for 11 seconds 00000100:00100000:2.0:1788574040.735577:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681520512 00000100:00100000:2.0:1788574040.735582:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681520512 00000100:00100000:2.0:1788574040.735625:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788574040.735634:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e564e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+16:6490:x1875455681520512:12345-0@lo:101: 00010000:00010000:2.0:1788574040.735641:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574040.735659:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c860217e000/0x5bf8706fdac8bd1c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8bd15 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574040.735680:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c860217e000/0x5bf8706fdac8bd1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8bd15 expref: 17 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574040.735819:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c860217e000/0x5bf8706fdac8bd1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8bd15 expref: 17 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574040.735827:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c860217e000, rc 0) 00000100:00100000:2.0:1788574040.735855:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e564e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+17:6490:x1875455681520512:12345-0@lo:101: Request processed in 223us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574040.735861:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788574040.735920:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf5ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681520512:0@lo:101: 00010000:00010000:0.0:1788574040.735932:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7e00/0x5bf8706fdac8bd15 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bd1c expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574040.735940:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7e00/0x5bf8706fdac8bd15 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8bd1c expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574040.736008:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf5ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681520640:0@lo:501: 00000100:00100000:0.0:1788574040.736032:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574040.736051:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8601989780 going to sleep for 11 seconds 00000100:00100000:2.0:1788574040.736096:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681520640 00000100:00100000:2.0:1788574040.736100:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681520640 00000100:00100000:2.0:1788574040.736127:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788574040.736143:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e564f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+17:6490:x1875455681520640:12345-0@lo:501: 00000100:00100000:2.0:1788574040.736284:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e564f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+17:6490:x1875455681520640:12345-0@lo:501: Request processed in 150us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574040.736290:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788574040.736430:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf5ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681520640:0@lo:501: 00000100:00100000:0.0:1788574040.736459:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf5ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681520768:0@lo:503: 00000100:00100000:0.0:1788574040.736498:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574040.736527:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8601989780 going to sleep for 11 seconds 00000100:00100000:2.0:1788574040.736568:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681520768 00000100:00100000:2.0:1788574040.736572:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681520768 00000100:00100000:2.0:1788574040.736599:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788574040.736606:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e564d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+17:6490:x1875455681520768:12345-0@lo:503: 00000100:00100000:2.0:1788574040.736853:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e564d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+17:6490:x1875455681520768:12345-0@lo:503: Request processed in 247us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574040.736860:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788574040.736932:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf5ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681520768:0@lo:503: 00000100:00100000:1.0:1788574040.738604:0:8803:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2336a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:8803:1875455681520896:0@lo:502: 00000100:00100000:1.0:1788574040.740004:0:8803:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574040.740124:0:8803:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85fa3196c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788574040.744810:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681520896 00000100:00100000:2.0:1788574040.744827:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681520896 00000100:00100000:2.0:1788574040.744903:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788574040.744913:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e564dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+17:8803:x1875455681520896:12345-0@lo:502: 00000100:00100000:2.0:1788574040.745253:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e564dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+17:8803:x1875455681520896:12345-0@lo:502: Request processed in 341us (5253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574040.745262:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788574040.748496:0:8803:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2336a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:8803:1875455681520896:0@lo:502: 00000020:01000000:0.0:1788574040.752456:0:8803:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788574040.752470:0:8803:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1788574040.752479:0:8803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788574040.752482:0:8803:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788574040.752490:0:8803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788574040.752497:0:8803:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.151@tcp to nid 0x20000c0a8cc97 (192.168.204.151@tcp) 00000020:01000000:0.0:1788574040.752530:0:8803:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1788574040.752534:0:8803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788574040.752550:0:8803:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9c85faf4cd40) 00000020:00000080:0.0:1788574040.752574:0:8803:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:0.0:1788574040.752581:0:8803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788574040.752696:0:8803:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1788574040.752925:0:8803:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788574040.752938:0:8803:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5bf8706fdac8bd2a 00010000:00080000:0.0:1788574040.752977:0:8803:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c85fae37800@lustre-OST0000-osc-MDT0001: add connection 192.168.204.151@tcp at head 00010000:00010000:0.0:1788574040.753259:0:8803:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:3.0:1788574040.762882:0:8803:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1788574040.762911:0:8803:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1788574040.763128:0:8803:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788574040.763641:0:8803:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788574040.764122:0:8803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1788574040.764258:0:8803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1788574040.767527:0:8805:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788574040.767536:0:8805:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788574040.768698:0:8803:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788574040.769349:0:8803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788574040.769401:0:8803:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788574040.769425:0:8803:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5bf8706fdac8bd31 00000100:00080000:3.0:1788574040.769436:0:8803:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788574040.769442:0:8803:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9c85fae37800 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:3.0:1788574040.769481:0:8803:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c85fa32b480 x1875455681521024/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788574040.769541:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fa32b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1875455681521024:0@lo:8: 00000100:00100000:0.0:1788574040.769613:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574040.770401:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681521024 00000100:00100000:1.0:1788574040.770411:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681521024 00000100:00100000:1.0:1788574040.770453:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788574040.770460:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3616:x1875455681521024:12345-0@lo:8: 00010000:00080000:1.0:1788574040.770486:0:8409:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 180 last 0 00000020:00000080:1.0:1788574040.770514:0:8409:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5bf8706fdac8bd38 00002000:00100000:1.0:1788574040.770554:0:8409:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9c8600d3b000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a03 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1788574040.770559:0:8409:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:1.0:1788574040.770572:0:8409:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1788574040.770633:0:8409:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788574040.770942:0:8409:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:1.0:1788574040.770981:0:8409:0:(import.c:65:import_set_state_nolock()) ffff9c85fadd6000 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1788574040.771058:0:8803:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:1.0:1788574040.771312:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3616:x1875455681521024:12345-0@lo:8: Request processed in 849us (1696us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574040.771321:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788574040.771396:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c85fa32b480 x1875455681521024/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788574050 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574040.771408:0:3616:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788574040.771416:0:3616:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1788574040.771424:0:3616:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000020:01000000:3.0:1788574040.771429:0:8803:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00080000:0.0:1788574040.771430:0:3616:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788574040.771436:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c85fae37800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000020:00000080:3.0:1788574040.771438:0:8803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574040.771441:0:8803:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000004:00080000:0.0:1788574040.771444:0:3616:0:(osp_dev.c:1648:osp_import_event()) got connected 00000020:01000000:3.0:1788574040.771445:0:8803:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788574040.771452:0:8803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000100:00100000:0.0:1788574040.771453:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fa32b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1875455681521024:0@lo:8: 00000020:00000080:3.0:1788574040.771455:0:8803:0:(obd_config.c:1563:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788574040.771462:0:8803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788574040.771464:0:8803:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788574040.771504:0:8803:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fa328380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:8803:1875455681521152:0@lo:502: 00000100:00100000:3.0:1788574040.771557:0:8803:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574040.771597:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681521152 00000100:00100000:3.0:1788574040.771602:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681521152 00000004:00080000:1.0:1788574040.771665:0:8805:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:3.0:1788574040.771707:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788574040.771716:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e564d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+17:8803:x1875455681521152:12345-0@lo:502: 00000004:00080000:1.0:1788574040.771804:0:8805:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 180751613195ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788574040.771813:0:8805:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1788574040.771853:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e564d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+17:8803:x1875455681521152:12345-0@lo:502: Request processed in 138us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574040.771862:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788574040.771911:0:8803:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85fa3da600 going to sleep for 11 seconds 00000100:00100000:3.0:1788574040.771923:0:8803:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fa328380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:8803:1875455681521152:0@lo:502: 00000100:00100000:1.0:1788574040.771932:0:8806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2337480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8806:1875455681521408:0@lo:700: 00000020:01000000:3.0:1788574040.771946:0:8803:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788574040.771952:0:8803:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574040.771954:0:8803:0:(obd_config.c:1563:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788574040.771958:0:8803:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000100:00100000:1.0:1788574040.771987:0:8806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574040.772074:0:8806:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85fa319540 going to sleep for 11 seconds 00000100:00100000:3.0:1788574040.772531:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681521408 00000100:00100000:3.0:1788574040.772539:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681521408 00000100:00100000:3.0:1788574040.772581:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788574040.772590:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c2334380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8806:x1875455681521408:12345-0@lo:700: 00000100:00100000:3.0:1788574040.772625:0:8417:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fa328380 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8417:1875455681521536:0@lo:700: 00000100:00100000:3.0:1788574040.772659:0:8417:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574040.772687:0:8417:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85fa3da600 going to sleep for 11 seconds 00000100:00080000:3.0:1788574040.772700:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788574040.772747:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681521536 00000100:00100000:1.0:1788574040.772753:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681521536 00000100:00100000:1.0:1788574040.772787:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788574040.772794:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa32b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8417:x1875455681521536:12345-0@lo:700: 00000100:00080000:3.0:1788574040.772906:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788574040.773004:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788574040.773060:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681521664:0@lo:400: 00000100:00100000:3.0:1788574040.773164:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574040.773223:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681521664 00000100:00100000:1.0:1788574040.773228:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681521664 00000100:00100000:1.0:1788574040.773257:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788574040.773264:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa328a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681521664:12345-0@lo:400: 00000100:00100000:1.0:1788574040.773308:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa328a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681521664:12345-0@lo:400: Request processed in 45us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574040.773316:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788574040.773565:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681521664:0@lo:400: 00000100:00100000:3.0:1788574040.773587:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875455681521280:0@lo:400: 00000100:00100000:3.0:1788574040.773615:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574040.773743:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681521280 00000100:00100000:1.0:1788574040.773749:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681521280 00000100:00100000:1.0:1788574040.773781:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788574040.773788:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa328000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875455681521280:12345-0@lo:400: 00000100:00100000:1.0:1788574040.773830:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa328000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875455681521280:12345-0@lo:400: Request processed in 43us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574040.773837:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1788574040.773918:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c84c1be3100 x1875455681521280/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574056 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574040.773929:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875455681521280:0@lo:400: 00000100:00100000:3.0:1788574040.773940:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788574040.773946:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3620:1875455681522048:0@lo:400: 00000100:00100000:3.0:1788574040.773971:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574040.774167:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681522048 00000100:00100000:1.0:1788574040.774173:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681522048 00000100:00100000:1.0:1788574040.774233:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788574040.774241:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa329c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875455681522048:12345-0@lo:400: 00000100:00100000:1.0:1788574040.774278:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa329c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875455681522048:12345-0@lo:400: Request processed in 38us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574040.774284:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1788574040.774484:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788574040.774510:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c84c1be2a00 x1875455681522048/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574056 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574040.774522:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3620:1875455681522048:0@lo:400: 00000020:01000000:2.0:1788574040.774937:0:6490:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:2.0:1788574040.774979:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1788574040.774991:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7e00/0x5bf8706fdac8bd15 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bd1c expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574040.775002:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7e00/0x5bf8706fdac8bd15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bd1c expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788574040.775013:0:6490:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788574040.775016:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c85c2bfb800 from 30 10000000:01000000:2.0:1788574040.775019:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788574040.775052:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c860217ec00/0x5bf8706fdac8bd3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574040.775060:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c860217ec00/0x5bf8706fdac8bd3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574040.775070:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c860217ec00/0x5bf8706fdac8bd3f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574040.775093:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681522176:0@lo:101: 00000100:00100000:2.0:1788574040.775149:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574040.775220:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681522176 00000100:00100000:1.0:1788574040.775226:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681522176 00000100:00100000:2.0:1788574040.775257:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85fafee480 going to sleep for 11 seconds 00000100:00100000:1.0:1788574040.775261:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788574040.775270:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e564e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+17:6490:x1875455681522176:12345-0@lo:101: 00010000:00010000:1.0:1788574040.775279:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574040.775291:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85faea3e00/0x5bf8706fdac8bd46 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8bd3f expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574040.775315:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85faea3e00/0x5bf8706fdac8bd46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8bd3f expref: 18 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574040.775326:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85faea3e00/0x5bf8706fdac8bd46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8bd3f expref: 18 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574040.775335:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85faea3e00, rc 0) 00000100:00100000:1.0:1788574040.777222:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e564e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+18:6490:x1875455681522176:12345-0@lo:101: Request processed in 1944us (2063us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574040.777235:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788574040.777674:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875455681521792:0@lo:400: 00000100:00100000:1.0:1788574040.777945:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574040.778179:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788574040.778204:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681521920:0@lo:400: 00000100:00100000:1.0:1788574040.778239:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574040.778270:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681521920 00000100:00100000:1.0:1788574040.778277:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681521920 00000100:00100000:1.0:1788574040.778314:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788574040.778317:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681522176:0@lo:101: 00000100:00100000:1.0:1788574040.778324:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c2334a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681521920:12345-0@lo:400: 00010000:00010000:2.0:1788574040.778353:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c860217ec00/0x5bf8706fdac8bd3f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bd46 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574040.778367:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c860217ec00/0x5bf8706fdac8bd3f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8bd46 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574040.778387:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c2334a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681521920:12345-0@lo:400: Request processed in 65us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574040.778394:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788574040.778423:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681521920:0@lo:400: 00000100:00100000:2.0:1788574040.778434:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681522304:0@lo:501: 00000100:00100000:2.0:1788574040.778467:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574040.778510:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85fafee480 going to sleep for 11 seconds 00000100:00100000:1.0:1788574040.779625:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681522304 00000100:00100000:1.0:1788574040.779635:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681522304 00000100:00100000:1.0:1788574040.779674:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788574040.779694:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e564f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+18:6490:x1875455681522304:12345-0@lo:501: 00000100:00100000:1.0:1788574040.779836:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e564f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+18:6490:x1875455681522304:12345-0@lo:501: Request processed in 154us (1370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574040.779844:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788574040.780447:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681522304:0@lo:501: 00000100:00100000:2.0:1788574040.780495:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681522432:0@lo:503: 00000100:00100000:2.0:1788574040.780552:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574040.780593:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85fafee480 going to sleep for 11 seconds 00000100:00100000:1.0:1788574040.780768:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681522432 00000100:00100000:1.0:1788574040.780774:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681522432 00000100:00100000:1.0:1788574040.780807:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788574040.780814:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e564d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+18:6490:x1875455681522432:12345-0@lo:503: 00000100:00100000:1.0:1788574040.780908:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e564d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+18:6490:x1875455681522432:12345-0@lo:503: Request processed in 93us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574040.780915:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788574040.781922:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681522432:0@lo:503: 00000004:00080000:2.0:1788574040.784942:0:7422:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:1.0:1788574040.785557:0:8807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2334000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:8807:1875455681522560:0@lo:502: 00000100:00100000:1.0:1788574040.785640:0:8807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574040.785692:0:8807:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85ca27b900 going to sleep for 11 seconds 00000100:00100000:2.0:1788574040.785825:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681522560 00000100:00100000:2.0:1788574040.785833:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681522560 00000100:00100000:2.0:1788574040.785884:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788574040.785893:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e564c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+18:8807:x1875455681522560:12345-0@lo:502: 00000100:00100000:2.0:1788574040.786016:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e564c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+18:8807:x1875455681522560:12345-0@lo:502: Request processed in 124us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574040.786024:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788574040.786078:0:8807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2334000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:8807:1875455681522560:0@lo:502: 00000100:00100000:2.0:1788574040.786124:0:8807:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:8807:1875455681522688:0@lo:502: 00000100:00100000:2.0:1788574040.786170:0:8807:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574040.786218:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681522688 00000100:00100000:2.0:1788574040.786222:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681522688 00000100:00100000:2.0:1788574040.786243:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788574040.786249:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e564cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+18:8807:x1875455681522688:12345-0@lo:502: 00000100:00100000:2.0:1788574040.786320:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e564cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+18:8807:x1875455681522688:12345-0@lo:502: Request processed in 70us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574040.786327:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788574040.786359:0:8807:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85fafee240 going to sleep for 11 seconds 00000100:00100000:2.0:1788574040.786371:0:8807:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:8807:1875455681522688:0@lo:502: 00000040:00080000:2.0:1788574040.786389:0:8807:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1788574040.786445:0:6490:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1788574040.786465:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788574040.786476:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c860217ec00/0x5bf8706fdac8bd3f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bd46 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574040.786487:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c860217ec00/0x5bf8706fdac8bd3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bd46 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788574040.786498:0:6490:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788574040.786501:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c85c2bfb800 from 5 10000000:01000000:2.0:1788574040.786504:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788574040.786528:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c860217ee00/0x5bf8706fdac8bd4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574040.786536:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c860217ee00/0x5bf8706fdac8bd4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574040.786545:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c860217ee00/0x5bf8706fdac8bd4d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574040.786567:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681522816:0@lo:101: 00000100:00100000:2.0:1788574040.786593:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574040.786607:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85d05f5e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788574040.786619:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681522816 00000100:00100000:2.0:1788574040.786622:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681522816 00000100:00100000:2.0:1788574040.786644:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788574040.786651:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e564ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+18:6490:x1875455681522816:12345-0@lo:101: 00010000:00010000:2.0:1788574040.786659:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574040.786671:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c860217fa00/0x5bf8706fdac8bd54 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8bd4d expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574040.786699:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c860217fa00/0x5bf8706fdac8bd54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8bd4d expref: 19 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574040.786708:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c860217fa00/0x5bf8706fdac8bd54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8bd4d expref: 19 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574040.786717:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c860217fa00, rc 0) 00000100:00100000:2.0:1788574040.786746:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e564ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+19:6490:x1875455681522816:12345-0@lo:101: Request processed in 95us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574040.786751:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788574040.786781:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681522816:0@lo:101: 00010000:00010000:2.0:1788574040.786794:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c860217ee00/0x5bf8706fdac8bd4d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bd54 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574040.786802:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c860217ee00/0x5bf8706fdac8bd4d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8bd54 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574040.786856:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681522944:0@lo:256: 00000100:00100000:2.0:1788574040.786886:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574040.786899:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85d05f5e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788574040.786911:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681522944 00000100:00100000:2.0:1788574040.786914:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681522944 00000100:00100000:2.0:1788574040.786934:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788574040.786940:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c5362850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+19:6490:x1875455681522944:12345-0@lo:256: 20000000:01000000:2.0:1788574040.786954:0:6486:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788574040.786969:0:6486:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788574040.786973:0:6486:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1788574040.787049:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c5362850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+19:6490:x1875455681522944:12345-0@lo:256: Request processed in 108us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574040.787056:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788574040.787084:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681522944:0@lo:256: 10000000:01000000:2.0:1788574040.787125:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788574040.787143:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c860217ee00/0x5bf8706fdac8bd4d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bd54 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574040.787151:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c860217ee00/0x5bf8706fdac8bd4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bd54 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788574040.787159:0:6490:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788574040.787161:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1788574040.787163:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788574040.787179:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c860217fe00/0x5bf8706fdac8bd5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574040.787218:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c860217fe00/0x5bf8706fdac8bd5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574040.787226:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c860217fe00/0x5bf8706fdac8bd5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574040.787240:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681523072:0@lo:101: 00000100:00100000:2.0:1788574040.787267:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574040.787281:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85d05f5e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788574040.787293:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681523072 00000100:00100000:2.0:1788574040.787297:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681523072 00000100:00100000:2.0:1788574040.787319:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788574040.787325:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e564f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+19:6490:x1875455681523072:12345-0@lo:101: 00010000:00010000:2.0:1788574040.787332:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574040.787341:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c860217e400/0x5bf8706fdac8bd62 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8bd5b expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574040.787356:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c860217e400/0x5bf8706fdac8bd62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8bd5b expref: 20 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574040.787365:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c860217e400/0x5bf8706fdac8bd62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8bd5b expref: 20 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574040.787371:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c860217e400, rc 0) 00000100:00100000:2.0:1788574040.787401:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e564f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+20:6490:x1875455681523072:12345-0@lo:101: Request processed in 76us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574040.787405:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788574040.787433:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681523072:0@lo:101: 00010000:00010000:2.0:1788574040.787448:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c860217fe00/0x5bf8706fdac8bd5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bd62 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574040.787456:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c860217fe00/0x5bf8706fdac8bd5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8bd62 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574040.787499:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681523200:0@lo:501: 00000100:00100000:2.0:1788574040.787522:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574040.787534:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85d05f5e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788574040.787544:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681523200 00000100:00100000:2.0:1788574040.787547:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681523200 00000100:00100000:2.0:1788574040.787566:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788574040.787571:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c820f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+20:6490:x1875455681523200:12345-0@lo:501: 00000100:00100000:2.0:1788574040.787675:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c820f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+20:6490:x1875455681523200:12345-0@lo:501: Request processed in 104us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574040.787682:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788574040.787710:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681523200:0@lo:501: 00000100:00100000:2.0:1788574040.787733:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681523328:0@lo:503: 00000100:00100000:2.0:1788574040.787770:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574040.787783:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85d05f5e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788574040.787793:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681523328 00000100:00100000:2.0:1788574040.787796:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681523328 00000100:00100000:2.0:1788574040.787815:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788574040.787821:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c820d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+20:6490:x1875455681523328:12345-0@lo:503: 00000100:00100000:2.0:1788574040.787893:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c820d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+20:6490:x1875455681523328:12345-0@lo:503: Request processed in 72us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574040.787900:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788574040.787940:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681523328:0@lo:503: 00000100:00100000:3.0:1788574040.789240:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681521792 00000100:00100000:3.0:1788574040.789253:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681521792 00000100:00100000:3.0:1788574040.789307:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788574040.789315:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c2337800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875455681521792:12345-0@lo:400: 00000100:00100000:3.0:1788574040.789390:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c2337800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875455681521792:12345-0@lo:400: Request processed in 76us (11446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574040.789397:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788574040.791639:0:8808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf5e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:8808:1875455681523456:0@lo:502: 00000100:00100000:0.0:1788574040.791723:0:8808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574040.791757:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681523456 00000100:00100000:0.0:1788574040.791763:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681523456 00000100:00100000:0.0:1788574040.791801:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788574040.791809:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c820f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+20:8808:x1875455681523456:12345-0@lo:502: 00000100:00100000:0.0:1788574040.791918:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c820f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+20:8808:x1875455681523456:12345-0@lo:502: Request processed in 109us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574040.791925:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788574040.791978:0:8808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8601989000 going to sleep for 11 seconds 00000100:00100000:0.0:1788574040.791998:0:8808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf5e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:8808:1875455681523456:0@lo:502: 00000020:01000000:0.0:1788574040.792025:0:8808:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788574040.792032:0:8808:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1788574040.792040:0:8808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788574040.792042:0:8808:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788574040.792047:0:8808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788574040.792051:0:8808:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.151@tcp to nid 0x20000c0a8cc97 (192.168.204.151@tcp) 00000020:01000000:0.0:1788574040.792072:0:8808:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788574040.792081:0:8808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788574040.792095:0:8808:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9c85faf499c0) 00000020:00000080:0.0:1788574040.792116:0:8808:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:0.0:1788574040.792121:0:8808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788574040.792260:0:8808:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1788574040.792266:0:8808:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:0.0:1788574040.792273:0:8808:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5bf8706fdac8bd70 00010000:00080000:0.0:1788574040.792309:0:8808:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c85ffa64800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.151@tcp at head 00010000:00080000:3.0:1788574040.797231:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c84c1be1180 x1875455681521792/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574056 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574040.797250:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875455681521792:0@lo:400: 00010000:00010000:0.0:1788574040.798108:0:8808:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 40000000:02000000:1.0:1788574040.803002:0:6499:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000040:01000000:0.0:1788574040.815185:0:8808:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1788574040.815262:0:8808:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788574040.815468:0:8808:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788574040.815647:0:8808:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788574040.817052:0:8808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1788574040.817209:0:8808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1788574040.818456:0:8810:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788574040.818464:0:8810:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000100:00100000:1.0:1788574040.822175:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa32b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8417:x1875455681521536:12345-0@lo:700: Request processed in 49370us (49504us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574040.822230:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788574040.822241:0:8417:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c85fa328380 x1875455681521536/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788574056 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574040.822264:0:8417:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fa328380 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8417:1875455681521536:0@lo:700: 40000000:02000000:3.0:1788574040.822279:0:8417:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000020:00000080:1.0:1788574040.826313:0:8808:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788574040.826327:0:8808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788574040.826366:0:8808:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788574040.826390:0:8808:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5bf8706fdac8bd77 00000100:00080000:1.0:1788574040.826401:0:8808:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788574040.826407:0:8808:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9c85ffa64800 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:1.0:1788574040.826444:0:8808:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c84c2335c00 x1875455681523584/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788574040.826509:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2335c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875455681523584:0@lo:8: 00000100:00100000:0.0:1788574040.826596:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788574040.827433:0:8808:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788574040.827567:0:8808:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788574040.827572:0:8808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574040.827574:0:8808:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788574040.827577:0:8808:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788574040.827581:0:8808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574040.827582:0:8808:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788574040.827585:0:8808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788574040.827586:0:8808:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788574040.827598:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681523584 00000100:00100000:2.0:1788574040.827605:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681523584 00000100:00100000:1.0:1788574040.827616:0:8808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2334700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:8808:1875455681523712:0@lo:502: 00000100:00100000:2.0:1788574040.827644:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788574040.827651:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3616:x1875455681523584:12345-0@lo:8: 00000100:00100000:1.0:1788574040.827669:0:8808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788574040.827677:0:8411:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 180 last 0 00000100:00100000:1.0:1788574040.827688:0:8808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85ca27b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788574040.827706:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681523712 00000100:00100000:1.0:1788574040.827710:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681523712 00000100:00100000:1.0:1788574040.827749:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788574040.827757:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c820c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+20:8808:x1875455681523712:12345-0@lo:502: 00000020:00000080:2.0:1788574040.827943:0:8411:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5bf8706fdac8bd7e 00002000:00100000:2.0:1788574040.827956:0:8411:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9c84c1beb800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a03 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1788574040.827960:0:8411:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1788574040.827963:0:8411:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788574040.828036:0:8411:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788574040.828059:0:8411:0:(import.c:65:import_set_state_nolock()) ffff9c84c1bee000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788574040.829284:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c820c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+20:8808:x1875455681523712:12345-0@lo:502: Request processed in 1523us (1607us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574040.829296:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788574040.829361:0:8808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2334700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:8808:1875455681523712:0@lo:502: 00000020:01000000:1.0:1788574040.829394:0:8808:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788574040.829401:0:8808:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574040.829403:0:8808:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788574040.829408:0:8808:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:1.0:1788574040.830900:0:6490:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:1.0:1788574040.830999:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00000001:00100000:3.0:1788574040.831009:0:8404:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1788574040.831016:0:8404:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1788574040.831113:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c2334380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8806:x1875455681521408:12345-0@lo:700: Request processed in 58522us (59125us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574040.831123:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1788574040.831167:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c860217fe00/0x5bf8706fdac8bd5b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bd62 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574040.831180:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c860217fe00/0x5bf8706fdac8bd5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bd62 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788574040.831207:0:6490:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788574040.831210:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9c85e56999c0 from 1 10000000:01000000:1.0:1788574040.831213:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788574040.831251:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85faea2c00/0x5bf8706fdac8bd85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574040.831259:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c85faea2c00/0x5bf8706fdac8bd85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574040.831268:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c85faea2c00/0x5bf8706fdac8bd85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574040.831298:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2334700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681523840:0@lo:101: 00000100:00100000:1.0:1788574040.831336:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574040.831378:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c8b89900 going to sleep for 11 seconds 00000100:00100000:1.0:1788574040.831398:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681523840 00000100:00100000:1.0:1788574040.831405:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681523840 00000100:00100000:1.0:1788574040.831440:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788574040.831448:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c820ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+20:6490:x1875455681523840:12345-0@lo:101: 00010000:00010000:1.0:1788574040.831459:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574040.831471:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85faea2600/0x5bf8706fdac8bd8c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8bd85 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574040.831641:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1875455681523584:12345-0@lo:8: Request processed in 3986us (5043us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574040.831649:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788574040.831899:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c84c2335c00 x1875455681523584/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788574050 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574040.831985:0:3616:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788574040.831994:0:3616:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788574040.832002:0:3616:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788574040.832008:0:3616:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788574040.832011:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c85ffa64800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788574040.832093:0:3616:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788574040.832100:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2335c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875455681523584:0@lo:8: 00000004:00080000:3.0:1788574040.832166:0:8810:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788574040.832466:0:8810:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 180812274960ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788574040.832474:0:8810:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00010000:00010000:1.0:1788574040.833116:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85faea2600/0x5bf8706fdac8bd8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8bd85 expref: 21 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574040.833146:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85faea2600/0x5bf8706fdac8bd8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8bd85 expref: 21 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574040.833155:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85faea2600, rc 0) 00000100:00100000:1.0:1788574040.833232:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c820ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+21:6490:x1875455681523840:12345-0@lo:101: Request processed in 1784us (1894us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574040.833240:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788574040.833259:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2334700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681523840:0@lo:101: 00010000:00010000:3.0:1788574040.833279:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c85faea2c00/0x5bf8706fdac8bd85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bd8c expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574040.833290:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c85faea2c00/0x5bf8706fdac8bd85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8bd8c expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:1.0:1788574040.833299:0:8806:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c84c2337480 x1875455681521408/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788574056 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574040.833309:0:8806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2337480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8806:1875455681521408:0@lo:700: 00000100:00100000:3.0:1788574040.833356:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fa328380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681523968:0@lo:501: 00000100:00100000:3.0:1788574040.833533:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574040.833574:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85fa3da600 going to sleep for 11 seconds 00000100:00100000:1.0:1788574040.833998:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681523968 00000100:00100000:1.0:1788574040.834005:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681523968 00000100:00100000:1.0:1788574040.834127:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788574040.834153:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c820fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+21:6490:x1875455681523968:12345-0@lo:501: 00000100:00100000:1.0:1788574040.834283:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c820fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+21:6490:x1875455681523968:12345-0@lo:501: Request processed in 133us (803us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788574040.834291:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788574040.834330:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fa328380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681523968:0@lo:501: 10000000:01000000:1.0:1788574040.834366:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788574040.834374:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85faea2c00/0x5bf8706fdac8bd85 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bd8c expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574040.834384:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c85faea2c00/0x5bf8706fdac8bd85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bd8c expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788574040.843651:0:6471:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:1.0:1788574040.847142:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788574040.847169:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2337480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681524096:0@lo:13: 00000100:00100000:1.0:1788574040.847272:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574040.847331:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681524096 00000100:00100000:1.0:1788574040.847338:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681524096 00000100:00100000:1.0:1788574040.847386:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788574040.847394:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c2334e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681524096:12345-0@lo:13: 00002000:00000024:1.0:1788574040.847420:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:1.0:1788574040.847462:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c2334e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681524096:12345-0@lo:13: Request processed in 68us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574040.847468:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788574040.847508:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c84c2337480 x1875455681524096/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574056 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574040.847526:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2337480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681524096:0@lo:13: 00000004:00080000:1.0:1788574040.847543:0:8811:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1788574040.847569:0:8811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2337480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8811:1875455681524224:0@lo:7: 00000100:00100000:1.0:1788574040.847594:0:8811:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574040.847616:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681524224 00000100:00100000:1.0:1788574040.847619:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681524224 00000100:00100000:1.0:1788574040.847644:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788574040.847651:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c2336680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8811:x1875455681524224:12345-0@lo:7: 00000100:00080000:3.0:1788574040.848017:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788574040.849245:0:8811:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c8b89480 going to sleep for 11 seconds 00000004:00080000:0.0:1788574040.851214:0:8806:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1788574040.851248:0:8806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf5ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8806:1875455681524480:0@lo:7: 00000100:00100000:0.0:1788574040.851309:0:8806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574040.851347:0:8806:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8601989900 going to sleep for 11 seconds 00000100:00100000:0.0:1788574040.851361:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788574040.851373:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681524352:0@lo:13: 00000100:00100000:0.0:1788574040.851409:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574040.851640:0:8411:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788574040.851649:0:8411:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1788574040.854429:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681524480 00000100:00100000:0.0:1788574040.854442:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681524480 00000100:00100000:2.0:1788574040.854659:0:8815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788574040.854670:0:8815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8806:x1875455681524480:12345-0@lo:7: 00002000:00080000:1.0:1788574040.861743:0:8409:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:1.0:1788574040.861755:0:8409:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:1.0:1788574040.862320:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c2336680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8811:x1875455681524224:12345-0@lo:7: Request processed in 14664us (14720us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574040.862332:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788574040.862378:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681524352 00000100:00100000:1.0:1788574040.862386:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681524352 00000100:00100000:1.0:1788574040.862427:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788574040.862435:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3618:x1875455681524352:12345-0@lo:13: 00002000:00000024:1.0:1788574040.862460:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:1.0:1788574040.862500:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3618:x1875455681524352:12345-0@lo:13: Request processed in 66us (11090us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574040.862507:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788574040.862550:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c85faf5e300 x1875455681524352/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574056 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574040.862573:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681524352:0@lo:13: 00010000:00080000:0.0:1788574040.864989:0:8811:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c84c2337480 x1875455681524224/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788574056 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574040.865006:0:8811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2337480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8811:1875455681524224:0@lo:7: 00000004:00080000:0.0:1788574040.865023:0:8811:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:0.0:1788574040.865066:0:8811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf5f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8811:1875455681524608:0@lo:5: 00000100:00100000:0.0:1788574040.865120:0:8811:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574040.865167:0:8811:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8601989240 going to sleep for 11 seconds 00000100:00100000:1.0:1788574040.865245:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681524608 00000100:00100000:1.0:1788574040.865253:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681524608 00000100:00100000:0.0:1788574040.865345:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788574040.865354:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8811:x1875455681524608:12345-0@lo:5: 00002000:00080000:0.0:1788574040.865378:0:8411:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1788574040.865382:0:8411:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00002000:00080000:3.0:1788574040.868995:0:8815:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:3.0:1788574040.869005:0:8815:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:3.0:1788574040.869106:0:8815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8806:x1875455681524480:12345-0@lo:7: Request processed in 14433us (17792us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574040.869120:0:8815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788574040.870168:0:8806:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c85faf5ed80 x1875455681524480/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788574056 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574040.870186:0:8806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf5ed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8806:1875455681524480:0@lo:7: 00000004:00080000:1.0:1788574040.870226:0:8806:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:1.0:1788574040.870265:0:8806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2336300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8806:1875455681524736:0@lo:5: 00000100:00100000:1.0:1788574040.870307:0:8806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574040.870343:0:8806:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c8b89480 going to sleep for 11 seconds 00000100:00100000:1.0:1788574040.870358:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681524736 00000100:00100000:1.0:1788574040.870364:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681524736 00000100:00100000:1.0:1788574040.870411:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788574040.870420:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c2337480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8806:x1875455681524736:12345-0@lo:5: 00002000:00080000:1.0:1788574040.870443:0:8409:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:1.0:1788574040.870476:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c2337480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8806:x1875455681524736:12345-0@lo:5: Request processed in 58us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574040.870484:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1788574040.870508:0:8806:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c84c2336300 x1875455681524736/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788574056 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574040.870517:0:8806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2336300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8806:1875455681524736:0@lo:5: 00000004:00080000:1.0:1788574040.870526:0:8806:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:1.0:1788574040.870546:0:8806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2336300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8806:1875455681524864:0@lo:5: 00000100:00100000:1.0:1788574040.870566:0:8806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574040.870579:0:8806:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c8b89480 going to sleep for 11 seconds 00000100:00100000:3.0:1788574040.872003:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681524864 00000100:00100000:3.0:1788574040.872014:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681524864 00000100:00100000:3.0:1788574040.872057:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788574040.872065:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c2334700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8806:x1875455681524864:12345-0@lo:5: 00002000:00080000:3.0:1788574040.872101:0:8410:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:0.0:1788574040.877150:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8811:x1875455681524608:12345-0@lo:5: Request processed in 11791us (12024us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788574040.877163:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788574040.877237:0:8811:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c85faf5f100 x1875455681524608/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788574056 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574040.877254:0:8811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf5f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8811:1875455681524608:0@lo:5: 00000004:00080000:0.0:1788574040.877271:0:8811:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:0.0:1788574040.877318:0:8811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf5d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8811:1875455681524992:0@lo:700: 00000100:00100000:0.0:1788574040.877349:0:8811:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574040.877374:0:8811:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8601989240 going to sleep for 11 seconds 00000100:00100000:0.0:1788574040.878292:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681524992 00000100:00100000:0.0:1788574040.878304:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681524992 00000100:00100000:0.0:1788574040.878357:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788574040.878367:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:8811:x1875455681524992:12345-0@lo:700: 00000100:00100000:3.0:1788574040.881605:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c2334700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:8806:x1875455681524864:12345-0@lo:5: Request processed in 9534us (11030us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788574040.881616:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788574040.882583:0:8806:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c84c2336300 x1875455681524864/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788574056 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574040.882601:0:8806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2336300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8806:1875455681524864:0@lo:5: 00000004:00080000:0.0:1788574040.882618:0:8806:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:0.0:1788574040.882659:0:8806:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf5ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8806:1875455681525120:0@lo:900: 00000100:00100000:0.0:1788574040.882700:0:8806:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574040.882733:0:8806:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8601989600 going to sleep for 11 seconds 00000100:00100000:2.0:1788574040.883456:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681525120 00000100:00100000:2.0:1788574040.883465:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681525120 00000100:00100000:2.0:1788574040.883554:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788574040.883565:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8806:x1875455681525120:12345-0@lo:900: 00000100:00100000:2.0:1788574040.883655:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8806:x1875455681525120:12345-0@lo:900: Request processed in 93us (953us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574040.883663:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788574040.883727:0:8806:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c85faf5ea00 x1875455681525120/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788574056 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574040.883740:0:8806:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf5ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8806:1875455681525120:0@lo:900: 00000001:00080000:1.0:1788574040.886484:0:8404:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000001:00080000:1.0:1788574040.886500:0:8404:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000100:00100000:0.0:1788574040.886876:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8811:x1875455681524992:12345-0@lo:700: Request processed in 8508us (9523us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574040.886889:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788574040.887037:0:8811:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c85faf5d180 x1875455681524992/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788574056 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574040.887059:0:8811:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1788574040.887075:0:8811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf5d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8811:1875455681524992:0@lo:700: 00000004:02000040:2.0:1788574040.889153:0:8811:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:2.0:1788574040.894876:0:8811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be3480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8811:1875455681525248:0@lo:5: 00000100:00100000:2.0:1788574040.894981:0:8811:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574040.895160:0:8811:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85d05f5480 going to sleep for 11 seconds 00000100:00100000:1.0:1788574040.896359:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681525248 00000100:00100000:1.0:1788574040.896369:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681525248 00000100:00100000:1.0:1788574040.896434:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788574040.896444:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8811:x1875455681525248:12345-0@lo:5: 00002000:00080000:0.0:1788574040.918350:0:8409:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:0.0:1788574040.918372:0:8409:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:0.0:1788574040.924727:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8811:x1875455681525248:12345-0@lo:5: Request processed in 28276us (29738us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788574040.924741:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788574040.927881:0:8811:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c84c1be3480 x1875455681525248/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788574056 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574040.927904:0:8811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be3480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8811:1875455681525248:0@lo:5: 00000004:00080000:2.0:1788574040.927922:0:8811:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00000020:00000004:1.0:1788574041.123059:0:8837:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788574041.123673:0:8837:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788574041.252038:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2335c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681525376:0@lo:41: 00000100:00100000:1.0:1788574041.252114:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574041.252232:0:7533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681525376 00000100:00100000:1.0:1788574041.252239:0:7533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681525376 00000100:00100000:1.0:1788574041.252291:0:7533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788574041.252301:0:7533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c2334000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681525376:12345-0@lo:41: 00000004:00000024:1.0:1788574041.252338:0:7533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1788574041.252384:0:7533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c2334000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681525376:12345-0@lo:41: Request processed in 84us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574041.252391:0:7533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788574041.252438:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2335c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681525376:0@lo:41: 00010000:00010000:0.0:1788574041.750518:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788574042.109908:0:8404:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00010000:00010000:1.0:1788574042.771876:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574043.804169:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788574044.173757:0:8938:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788574044.173961:0:8938:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788574044.820737:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788574044.820758:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fa328700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681525504:0@lo:41: 00000100:00100000:3.0:1788574044.820823:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574044.821019:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681525504 00000100:00100000:3.0:1788574044.821027:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681525504 00000100:00100000:3.0:1788574044.821080:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788574044.821089:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa328e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681525504:12345-0@lo:41: 00000004:00000024:3.0:1788574044.821122:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1788574044.821167:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa328e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681525504:12345-0@lo:41: Request processed in 78us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574044.821174:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788574044.821240:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fa328700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681525504:0@lo:41: 00010000:00010000:1.0:1788574044.822564:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788574045.278236:0:8987:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788574045.278246:0:8987:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:1.0:1788574045.843443:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574045.844770:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875455681525760:0@lo:400: 00000100:00100000:0.0:1788574045.844852:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574045.844929:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1875455681526272:0@lo:400: 00000100:00100000:0.0:1788574045.844951:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574045.844980:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788574045.844986:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681525888:0@lo:400: 00000100:00100000:0.0:1788574045.845010:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574045.845031:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1875455681526400:0@lo:400: 00000100:00100000:0.0:1788574045.845064:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574045.845092:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681525888 00000100:00100000:0.0:1788574045.845101:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681525888 00000100:00100000:0.0:1788574045.845142:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788574045.845150:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681525888:12345-0@lo:400: 00000100:00100000:0.0:1788574045.845230:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681525888:12345-0@lo:400: Request processed in 81us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574045.845237:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788574045.845275:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681525888:0@lo:400: 00000100:00100000:2.0:1788574045.845481:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681525760 00000100:00100000:2.0:1788574045.845486:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681525760 00000100:00100000:2.0:1788574045.845523:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681526272 00000100:00100000:2.0:1788574045.845526:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681526272 00000100:00100000:2.0:1788574045.845546:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681526400 00000100:00100000:2.0:1788574045.845549:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681526400 00000100:00100000:2.0:1788574045.845561:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788574045.845567:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875455681525760:12345-0@lo:400: 00000100:00100000:2.0:1788574045.845605:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875455681525760:12345-0@lo:400: Request processed in 39us (753us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574045.845611:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788574045.845622:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788574045.845628:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875455681526272:12345-0@lo:400: 00000100:00100000:2.0:1788574045.845651:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875455681526272:12345-0@lo:400: Request processed in 24us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574045.845664:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788574045.845674:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788574045.845679:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875455681526400:12345-0@lo:400: 00000100:00100000:2.0:1788574045.845704:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875455681526400:12345-0@lo:400: Request processed in 26us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574045.845710:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788574045.845900:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:69505170-06bc-41d1-9626-ab1a3c7f32a0:3620:1875455681525632:0@lo:400: 00000100:00100000:3.0:1788574045.845939:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574045.845983:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681526144:0@lo:400: 00000100:00100000:3.0:1788574045.846008:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574045.846027:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681526656:0@lo:400: 00000100:00100000:3.0:1788574045.846065:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574045.846085:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788574045.846090:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875455681526016:0@lo:400: 00000100:00100000:3.0:1788574045.846110:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574045.846127:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681526528:0@lo:400: 00000100:00100000:3.0:1788574045.846148:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574045.846172:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681526016 00000100:00100000:3.0:1788574045.846176:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681526016 00000100:00100000:3.0:1788574045.846225:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788574045.846232:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa32a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875455681526016:12345-0@lo:400: 00000100:00100000:3.0:1788574045.846265:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa32a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875455681526016:12345-0@lo:400: Request processed in 34us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574045.846271:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788574045.846286:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681526144 00000100:00100000:3.0:1788574045.846289:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681526144 00000100:00100000:3.0:1788574045.846312:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788574045.846318:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa328700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681526144:12345-0@lo:400: 00000100:00100000:3.0:1788574045.846346:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa328700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681526144:12345-0@lo:400: Request processed in 28us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574045.846352:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:3.0:1788574045.846365:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788574045.846369:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788574045.846381:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681526656 00000100:00100000:3.0:1788574045.846384:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681526656 00000100:00100000:3.0:1788574045.846408:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681526528 00000100:00100000:3.0:1788574045.846417:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681526528 00000100:00100000:3.0:1788574045.846453:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788574045.846459:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa32a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681526656:12345-0@lo:400: 00000100:00100000:3.0:1788574045.846492:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa32a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681526656:12345-0@lo:400: Request processed in 33us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574045.846497:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788574045.846507:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788574045.846513:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa32ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681526528:12345-0@lo:400: 00000100:00100000:3.0:1788574045.846536:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa32ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681526528:12345-0@lo:400: Request processed in 24us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574045.846541:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1788574045.846559:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788574045.846587:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c84c1be1c00 x1875455681526016/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574061 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574045.846599:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875455681526016:0@lo:400: 00010000:00080000:3.0:1788574045.846608:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c84c1be2300 x1875455681526528/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574061 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574045.846615:0:3620:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1788574045.846629:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681526528:0@lo:400: 00000100:00100000:3.0:1788574045.846639:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681526144:0@lo:400: 00010000:00080000:3.0:1788574045.846647:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c84c1be1180 x1875455681526656/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574061 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574045.846653:0:3620:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:3.0:1788574045.846661:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681526656:0@lo:400: 00000100:00100000:2.0:1788574045.846942:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681525632 00000100:00100000:2.0:1788574045.846948:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681525632 00000100:00100000:2.0:1788574045.846983:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788574045.846990:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c820cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+21:3620:x1875455681525632:12345-0@lo:400: 00000100:00100000:2.0:1788574045.847028:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c820cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+21:3620:x1875455681525632:12345-0@lo:400: Request processed in 38us (1088us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574045.847045:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788574045.849552:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:69505170-06bc-41d1-9626-ab1a3c7f32a0:3620:1875455681525632:0@lo:400: 00010000:00080000:0.0:1788574045.849694:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c84c1be2680 x1875455681526400/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574061 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574045.849708:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1875455681526400:0@lo:400: 00010000:00080000:0.0:1788574045.849719:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c84c1be0a80 x1875455681525760/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574061 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574045.849734:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875455681525760:0@lo:400: 00010000:00080000:0.0:1788574045.849745:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c84c1be0e00 x1875455681526272/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574061 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574045.849752:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1875455681526272:0@lo:400: 00000100:00100000:1.0:1788574046.355556:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681526912:0@lo:13: 00000100:00100000:1.0:1788574046.355647:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574046.355708:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681526784:0@lo:13: 00000100:00100000:1.0:1788574046.355729:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574046.355791:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681526912 00000100:00100000:1.0:1788574046.355797:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681526912 00000100:00100000:1.0:1788574046.355850:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681526784 00000100:00100000:1.0:1788574046.355853:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681526784 00000100:00100000:1.0:1788574046.355879:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788574046.355888:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c2335c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681526912:12345-0@lo:13: 00002000:00000024:1.0:1788574046.355916:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788574046.355959:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c2335c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681526912:12345-0@lo:13: Request processed in 71us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574046.355974:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788574046.355992:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788574046.355997:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c2336a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681526784:12345-0@lo:13: 00002000:00000024:1.0:1788574046.356006:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788574046.356044:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c2336a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681526784:12345-0@lo:13: Request processed in 47us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574046.356050:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788574046.356083:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c84c1be3b80 x1875455681526912/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574062 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574046.356102:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681526912:0@lo:13: 00010000:00080000:1.0:1788574046.356113:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c85faf5ea00 x1875455681526784/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574062 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574046.356123:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681526784:0@lo:13: 00000100:00100000:3.0:1788574046.357777:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2335500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681527040:0@lo:41: 00000100:00100000:3.0:1788574046.357850:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574046.358441:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681527040 00000100:00100000:3.0:1788574046.358450:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681527040 00000100:00100000:3.0:1788574046.358509:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788574046.358518:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa329f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681527040:12345-0@lo:41: 00000004:00000024:3.0:1788574046.358549:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1788574046.359128:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa329f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681527040:12345-0@lo:41: Request processed in 608us (1275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574046.359137:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788574046.359452:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2335500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681527040:0@lo:41: 00010000:00010000:2.0:1788574046.867491:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574047.894522:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574048.915741:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574049.939386:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574049.940343:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fa328380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681527168:0@lo:41: 00000100:00100000:1.0:1788574049.940415:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574049.940456:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681527168 00000100:00100000:3.0:1788574049.940465:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681527168 00000100:00100000:3.0:1788574049.940533:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788574049.940543:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c2335500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681527168:12345-0@lo:41: 00000004:00000024:3.0:1788574049.940576:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1788574049.940638:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c2335500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681527168:12345-0@lo:41: Request processed in 96us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574049.940644:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788574049.944095:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fa328380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681527168:0@lo:41: 00010000:00010000:1.0:1788574050.963638:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574050.963875:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788574050.964073:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2336300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875455681527424:0@lo:400: 00000100:00100000:0.0:1788574050.964160:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574050.964237:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788574050.964244:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85e56c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681527552:0@lo:400: 00000100:00100000:0.0:1788574050.964269:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574050.964300:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681527424 00000100:00100000:0.0:1788574050.964307:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681527424 00000100:00100000:0.0:1788574050.964353:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788574050.964361:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875455681527424:12345-0@lo:400: 00000100:00100000:0.0:1788574050.964417:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875455681527424:12345-0@lo:400: Request processed in 56us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574050.964425:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788574050.964449:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681527552 00000100:00100000:0.0:1788574050.964453:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681527552 00000100:00100000:0.0:1788574050.964478:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788574050.964486:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de9bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681527552:12345-0@lo:400: 00000100:00100000:0.0:1788574050.964518:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de9bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681527552:12345-0@lo:400: Request processed in 34us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574050.964539:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788574050.964586:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85e56c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681527552:0@lo:400: 00010000:00080000:0.0:1788574050.964600:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c84c2336300 x1875455681527424/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574066 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574050.964610:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2336300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875455681527424:0@lo:400: 00000100:00100000:2.0:1788574050.965053:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85e56c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875455681527680:0@lo:400: 00000100:00100000:2.0:1788574050.965480:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574050.965592:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2335f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69505170-06bc-41d1-9626-ab1a3c7f32a0:3619:1875455681527296:0@lo:400: 00000100:00100000:2.0:1788574050.965621:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574050.965827:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681527680 00000100:00100000:3.0:1788574050.965834:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681527680 00000100:00100000:3.0:1788574050.965878:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788574050.965886:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875455681527680:12345-0@lo:400: 00000100:00100000:3.0:1788574050.965931:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875455681527680:12345-0@lo:400: Request processed in 47us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574050.965948:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1788574050.966010:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c85e56c0000 x1875455681527680/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574066 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574050.966022:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85e56c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875455681527680:0@lo:400: 00000100:00100000:1.0:1788574050.966408:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85e56c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3618:1875455681528064:0@lo:400: 00000100:00100000:1.0:1788574050.966441:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574050.966461:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788574050.966466:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85e56c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3618:1875455681527936:0@lo:400: 00000100:00100000:2.0:1788574050.966664:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85e56c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681528192:0@lo:400: 00000100:00100000:2.0:1788574050.966696:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574050.966731:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788574050.966737:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85e56c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681527808:0@lo:400: 00000100:00100000:2.0:1788574050.966761:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574050.966780:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85e56c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681528320:0@lo:400: 00000100:00100000:2.0:1788574050.966799:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574050.966824:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681527808 00000100:00100000:2.0:1788574050.966830:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681527808 00000100:00100000:2.0:1788574050.966860:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788574050.966867:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681527808:12345-0@lo:400: 00000100:00100000:2.0:1788574050.966907:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681527808:12345-0@lo:400: Request processed in 40us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574050.966913:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788574050.966931:0:8815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681528192 00000100:00100000:2.0:1788574050.966944:0:8815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681528192 00000100:00100000:2.0:1788574050.966975:0:8815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681528320 00000100:00100000:2.0:1788574050.966979:0:8815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681528320 00000100:00100000:2.0:1788574050.966998:0:8815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788574050.967005:0:8815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681528192:12345-0@lo:400: 00000100:00100000:2.0:1788574050.967046:0:8815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681528192:12345-0@lo:400: Request processed in 30us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574050.967052:0:8815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788574050.967072:0:8815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788574050.967078:0:8815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681528320:12345-0@lo:400: 00000100:00100000:2.0:1788574050.967105:0:8815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681528320:12345-0@lo:400: Request processed in 27us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574050.967111:0:8815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1788574050.967127:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788574050.967171:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85e56c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681527808:0@lo:400: 00010000:00080000:2.0:1788574050.967310:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c85e56c0e00 x1875455681528320/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574066 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574050.967320:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85e56c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681528320:0@lo:400: 00010000:00080000:2.0:1788574050.967332:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c85e56c3480 x1875455681528192/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574066 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574050.967340:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85e56c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681528192:0@lo:400: 00000100:00100000:1.0:1788574050.967835:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574050.967882:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681528064 00000100:00100000:1.0:1788574050.967887:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681528064 00000100:00100000:1.0:1788574050.967928:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681527936 00000100:00100000:1.0:1788574050.967932:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681527936 00000100:00100000:1.0:1788574050.967966:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788574050.967973:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e56c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875455681528064:12345-0@lo:400: 00000100:00100000:1.0:1788574050.968013:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e56c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875455681528064:12345-0@lo:400: Request processed in 41us (1570us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574050.968020:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788574050.968044:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788574050.968051:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e56c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875455681527936:12345-0@lo:400: 00000100:00100000:1.0:1788574050.968085:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e56c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875455681527936:12345-0@lo:400: Request processed in 35us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574050.968091:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1788574050.968122:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c85e56c1500 x1875455681527936/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574066 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574050.968144:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85e56c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3618:1875455681527936:0@lo:400: 00010000:00080000:1.0:1788574050.968156:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c85e56c0a80 x1875455681528064/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574066 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574050.968164:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85e56c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3618:1875455681528064:0@lo:400: 00000100:00080000:2.0:1788574050.968410:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788574050.968414:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788574050.968643:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681527296 00000100:00100000:0.0:1788574050.968649:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681527296 00000100:00100000:1.0:1788574050.969399:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788574050.969408:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c820e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+21:3619:x1875455681527296:12345-0@lo:400: 00000100:00100000:1.0:1788574050.969781:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c820e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+21:3619:x1875455681527296:12345-0@lo:400: Request processed in 374us (4157us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574050.969802:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788574050.970399:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2335f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69505170-06bc-41d1-9626-ab1a3c7f32a0:3619:1875455681527296:0@lo:400: 00000100:00100000:0.0:1788574051.475646:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788574051.475680:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fa32b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681528576:0@lo:41: 00000100:00100000:0.0:1788574051.475752:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574051.475811:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85de9bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681528448:0@lo:13: 00000100:00100000:0.0:1788574051.475832:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574051.475870:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681528448 00000100:00100000:0.0:1788574051.475877:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681528448 00000100:00100000:0.0:1788574051.475915:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788574051.475923:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de9bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681528448:12345-0@lo:13: 00002000:00000024:0.0:1788574051.475964:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788574051.476072:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de9bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681528448:12345-0@lo:13: Request processed in 148us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574051.476079:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788574051.476117:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c85de9bc380 x1875455681528448/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574067 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574051.476136:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85de9bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681528448:0@lo:13: 00000100:00100000:3.0:1788574051.476383:0:7533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681528576 00000100:00100000:3.0:1788574051.476396:0:7533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681528576 00000100:00100000:3.0:1788574051.476433:0:7533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788574051.476442:0:7533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de9bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681528576:12345-0@lo:41: 00000004:00000024:3.0:1788574051.476469:0:7533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1788574051.476513:0:7533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de9bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681528576:12345-0@lo:41: Request processed in 73us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574051.476521:0:7533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788574051.476558:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fa32b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681528576:0@lo:41: 00000100:00100000:3.0:1788574051.477574:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fa32b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681528704:0@lo:13: 00000100:00100000:3.0:1788574051.477637:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574051.477692:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681528704 00000100:00100000:3.0:1788574051.477697:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681528704 00000100:00100000:3.0:1788574051.477861:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788574051.477870:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa32aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681528704:12345-0@lo:13: 00002000:00000024:3.0:1788574051.477887:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788574051.478314:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa32aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681528704:12345-0@lo:13: Request processed in 444us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574051.478323:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788574051.478386:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c85fa32b480 x1875455681528704/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574067 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574051.478404:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fa32b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681528704:0@lo:13: 00010000:00010000:1.0:1788574051.987370:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574053.012488:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574054.036354:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788574054.715044:0:9485:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788574054.715049:0:9485:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:3.0:1788574054.715050:0:9485:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1788574054.715614:0:9485:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9c85f7fb1000 00000020:01000004:3.0:1788574054.715630:0:9485:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1788574054.715645:0:9485:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788574054.715668:0:9485:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9c84c27099c0) 00000020:00000080:3.0:1788574054.715689:0:9485:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1788574054.753586:0:9485:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1788574054.753648:0:9485:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:1.0:1788574054.805017:0:9485:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788574054.805246:0:9485:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1788574054.805261:0:9485:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788574054.805273:0:9485:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x5bf8706fdac8bd9a 00000020:01000004:1.0:1788574054.805280:0:9485:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:1.0:1788574054.805300:0:9485:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.151@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788574054.805304:0:9485:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.151@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788574054.805310:0:9485:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1788574054.805336:0:9485:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:1.0:1788574054.805340:0:9485:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.151@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1788574054.829976:0:9485:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.151@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788574054.830015:0:9485:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.151@tcp, index=0001, flags=0x20062 00000020:01000004:0.0:1788574054.830020:0:9485:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788574054.830022:0:9485:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788574054.830023:0:9485:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788574054.830024:0:9485:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788574054.830025:0:9485:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788574054.830026:0:9485:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788574054.830027:0:9485:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788574054.830578:0:9485:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788574054.830581:0:9485:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788574054.830582:0:9485:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788574054.830584:0:9485:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788574054.830587:0:9485:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:0.0:1788574054.830590:0:9485:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788574054.830598:0:9485:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788574054.830599:0:9485:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788574054.830600:0:9485:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788574054.830601:0:9485:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788574054.830602:0:9485:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788574054.830603:0:9485:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788574054.830604:0:9485:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788574054.830605:0:9485:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788574054.830606:0:9485:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788574054.830607:0:9485:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788574054.830633:0:9485:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788574054.830652:0:9485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85de9bc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:9485:1875455681528832:0@lo:253: 00000100:00100000:0.0:1788574054.830737:0:9485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574054.830856:0:9485:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c86019833c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788574054.831042:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681528832 00000100:00100000:1.0:1788574054.831051:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681528832 00000100:00100000:1.0:1788574054.831154:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788574054.831165:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c820c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+21:9485:x1875455681528832:12345-0@lo:253: 20000000:01000000:1.0:1788574054.831229:0:6485:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788574054.831234:0:6485:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1788574054.831240:0:6485:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1788574054.831243:0:6485:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1788574054.832337:0:6485:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788574054.832537:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:1.0:1788574054.832558:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1788574054.832576:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:1.0:1788574054.832583:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1788574054.832598:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:1.0:1788574054.832615:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:1.0:1788574054.833060:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:1.0:1788574054.833080:0:6485:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.151@tcp 20000000:01000000:1.0:1788574054.833083:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.151@tcp (null) (null) (null) 00000040:00080000:1.0:1788574054.833097:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:1.0:1788574054.833102:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788574054.833115:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:1.0:1788574054.833121:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.204.151@tcp (null) (null) 00000040:00080000:1.0:1788574054.833135:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:1.0:1788574054.833142:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1788574054.833155:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:1.0:1788574054.833171:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:1.0:1788574054.833271:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:1.0:1788574054.833282:0:6485:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.151@tcp 20000000:01000000:1.0:1788574054.833284:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.151@tcp (null) (null) (null) 00000040:00080000:1.0:1788574054.833298:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:1.0:1788574054.833304:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788574054.833319:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:1.0:1788574054.833324:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.204.151@tcp (null) (null) 00000040:00080000:1.0:1788574054.833336:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:1.0:1788574054.833546:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1788574054.833570:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:1.0:1788574054.833590:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:1.0:1788574054.834163:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:1.0:1788574054.834179:0:6485:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.151@tcp 20000000:01000000:1.0:1788574054.834180:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.151@tcp (null) (null) (null) 00000040:00080000:1.0:1788574054.834269:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:1.0:1788574054.834276:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788574054.834288:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:1.0:1788574054.834293:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.204.151@tcp (null) (null) 00000040:00080000:1.0:1788574054.834303:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:1.0:1788574054.834320:0:6485:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1788574054.834334:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:3.0:1788574054.834952:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:3.0:1788574054.834980:0:6485:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788574054.834984:0:6485:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788574054.834987:0:6485:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788574054.835039:0:6485:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788574054.835042:0:6485:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788574054.835880:0:9491:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 25 1->4: lustre sys.timeout 20000000:01000000:1.0:1788574054.835920:0:9491:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 25 2->4: lustre sys.timeout 00000040:00080000:1.0:1788574054.835936:0:9491:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:3.0:1788574054.836173:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:3.0:1788574054.836538:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:3.0:1788574054.836560:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:3.0:1788574054.836572:0:6485:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788574054.836575:0:6485:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788574054.837118:0:9492:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 26 1->4: lustre sys.timeout 20000000:01000000:1.0:1788574054.837150:0:9492:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 26 2->4: lustre sys.timeout 00000040:00080000:1.0:1788574054.837163:0:9492:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1788574054.837334:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1788574054.837379:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:3.0:1788574054.837396:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:3.0:1788574054.837406:0:6485:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788574054.837408:0:6485:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788574054.838029:0:9493:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 27 1->4: lustre sys.timeout 20000000:01000000:1.0:1788574054.838051:0:9493:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 27 2->4: lustre sys.timeout 00000040:00080000:1.0:1788574054.838067:0:9493:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:3.0:1788574054.838322:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:3.0:1788574054.838361:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:3.0:1788574054.838382:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:3.0:1788574054.838393:0:6485:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1788574054.838395:0:6485:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788574054.839125:0:9494:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:3.0:1788574054.839337:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:3.0:1788574054.839381:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:3.0:1788574054.839399:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:3.0:1788574054.839480:0:6485:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1788574054.839484:0:6485:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788574054.839984:0:9495:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 28 1->4: lustre sys.timeout 20000000:01000000:1.0:1788574054.840007:0:9495:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 28 2->4: lustre sys.timeout 00000040:00080000:1.0:1788574054.840023:0:9495:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:3.0:1788574054.840264:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:3.0:1788574054.840286:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:3.0:1788574054.840302:0:6485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 10000000:01000000:3.0:1788574054.840317:0:6485:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788574054.840339:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c85c152e000/0x5bf8706fdac8bda1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574054.840527:0:6485:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c85c152fe00/0x5bf8706fdac8bc97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8bc90 expref: 21 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574054.840535:0:6485:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c860217f200/0x5bf8706fdac8bcc1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8bcba expref: 21 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574054.840541:0:6485:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c85c152ea00/0x5bf8706fdac8bd00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8bcf9 expref: 21 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574054.840548:0:6485:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c860217e000/0x5bf8706fdac8bd1c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8bd15 expref: 21 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574054.840554:0:6485:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c85faea3e00/0x5bf8706fdac8bd46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8bd3f expref: 21 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574054.840562:0:6485:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c860217e400/0x5bf8706fdac8bd62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8bd5b expref: 21 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574054.840568:0:6485:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c85faea2600/0x5bf8706fdac8bd8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8bd85 expref: 21 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574054.840576:0:6485:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c85c152e000/0x5bf8706fdac8bda1 lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574054.840619:0:6485:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c85faea2600/0x5bf8706fdac8bd8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5bf8706fdac8bd85 expref: 21 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574054.840636:0:6485:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c85faea2600/0x5bf8706fdac8bd8c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5bf8706fdac8bd85 expref: 21 pid: 6486 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574054.840662:0:6485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fa32b480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6485:1875455681528960:0@lo:104: 00000100:00100000:3.0:1788574054.840939:0:6485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788574054.840995:0:6485:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c860217e400/0x5bf8706fdac8bd62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5bf8706fdac8bd5b expref: 21 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574054.841004:0:6485:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c860217e400/0x5bf8706fdac8bd62 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5bf8706fdac8bd5b expref: 21 pid: 6486 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574054.841013:0:6485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fa0e7800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6485:1875455681529088:0@lo:104: 00000100:00100000:3.0:1788574054.841034:0:6485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788574054.841106:0:6485:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c85faea3e00/0x5bf8706fdac8bd46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5bf8706fdac8bd3f expref: 21 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574054.841114:0:6485:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c85faea3e00/0x5bf8706fdac8bd46 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5bf8706fdac8bd3f expref: 21 pid: 6487 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574054.841122:0:6485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fa0e6680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6485:1875455681529216:0@lo:104: 00000100:00100000:3.0:1788574054.841142:0:6485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788574054.841577:0:6485:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c860217e000/0x5bf8706fdac8bd1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5bf8706fdac8bd15 expref: 21 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574054.841587:0:6485:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c860217e000/0x5bf8706fdac8bd1c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5bf8706fdac8bd15 expref: 21 pid: 6487 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574054.841596:0:6485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fa0e4e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6485:1875455681529344:0@lo:104: 00000100:00100000:3.0:1788574054.841636:0:6485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574054.841654:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681528960 00000100:00100000:0.0:1788574054.841662:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681528960 00000100:00100000:0.0:1788574054.841708:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681529088 00000100:00100000:0.0:1788574054.841712:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681529088 00000100:00100000:0.0:1788574054.841720:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681529216 00000100:00100000:0.0:1788574054.841722:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681529216 00000100:00100000:0.0:1788574054.841733:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788574054.841741:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa328380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:69505170-06bc-41d1-9626-ab1a3c7f32a0+5:6485:x1875455681528960:12345-0@lo:104: 00010000:00010000:0.0:1788574054.841754:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff9c85faea2c00/0x5bf8706fdac8bd85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8bd8c expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574054.841819:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788574054.841826:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa328380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:69505170-06bc-41d1-9626-ab1a3c7f32a0+5:6485:x1875455681528960:12345-0@lo:104: Request processed in 86us (888us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574054.841833:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788574054.841849:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788574054.841855:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa0e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:69505170-06bc-41d1-9626-ab1a3c7f32a0+4:6485:x1875455681529088:12345-0@lo:104: 00010000:00010000:0.0:1788574054.841873:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff9c860217fe00/0x5bf8706fdac8bd5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8bd62 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574054.841917:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788574054.841922:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa0e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:69505170-06bc-41d1-9626-ab1a3c7f32a0+4:6485:x1875455681529088:12345-0@lo:104: Request processed in 68us (888us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574054.841929:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788574054.841943:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788574054.841949:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa0e6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:69505170-06bc-41d1-9626-ab1a3c7f32a0+3:6485:x1875455681529216:12345-0@lo:104: 00010000:00010000:0.0:1788574054.841956:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff9c860217ec00/0x5bf8706fdac8bd3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8bd46 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574054.841985:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788574054.841989:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa0e6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:69505170-06bc-41d1-9626-ab1a3c7f32a0+3:6485:x1875455681529216:12345-0@lo:104: Request processed in 41us (847us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574054.841995:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:0.0:1788574054.842013:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788574054.842018:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c85faea2c00/0x5bf8706fdac8bd85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8bd8c expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574054.842024:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85faea2c00 already unused, calling callback (ffffffffc1472c20) 10000000:00010000:0.0:1788574054.842029:0:6480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c85faea2c00/0x5bf8706fdac8bd85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x5bf8706fdac8bd8c expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574054.842037:0:6480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c85faea2c00/0x5bf8706fdac8bd85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x5bf8706fdac8bd8c expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788574054.842045:0:6480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c85faea2c00/0x5bf8706fdac8bd85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x5bf8706fdac8bd8c expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788574054.842052:0:6480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788574054.842088:0:6480:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9c85faea2c00/0x5bf8706fdac8bd85 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bd8c expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574054.842095:0:6480:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788574054.842117:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c85faea2c00/0x5bf8706fdac8bd85 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bd8c expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574054.842124:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c85faea2c00/0x5bf8706fdac8bd85 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bd8c expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574054.842138:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788574054.842140:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c860217fe00/0x5bf8706fdac8bd5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8bd62 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574054.842146:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c860217fe00 already unused, calling callback (ffffffffc1472c20) 10000000:00010000:0.0:1788574054.842149:0:6480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c860217fe00/0x5bf8706fdac8bd5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x5bf8706fdac8bd62 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574054.842155:0:6480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c860217fe00/0x5bf8706fdac8bd5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x5bf8706fdac8bd62 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788574054.842162:0:6480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c860217fe00/0x5bf8706fdac8bd5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x5bf8706fdac8bd62 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788574054.842166:0:6480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788574054.842178:0:6480:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9c860217fe00/0x5bf8706fdac8bd5b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bd62 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574054.842183:0:6480:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788574054.842218:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c860217fe00/0x5bf8706fdac8bd5b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bd62 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574054.842234:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c860217fe00/0x5bf8706fdac8bd5b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bd62 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574054.842245:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788574054.842247:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c860217ec00/0x5bf8706fdac8bd3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8bd46 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574054.842253:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c860217ec00 already unused, calling callback (ffffffffc1472c20) 10000000:00010000:0.0:1788574054.842255:0:6480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c860217ec00/0x5bf8706fdac8bd3f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x5bf8706fdac8bd46 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574054.842262:0:6480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c860217ec00/0x5bf8706fdac8bd3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x5bf8706fdac8bd46 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788574054.842268:0:6480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c860217ec00/0x5bf8706fdac8bd3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x5bf8706fdac8bd46 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788574054.842273:0:6480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788574054.842287:0:6480:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9c860217ec00/0x5bf8706fdac8bd3f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bd46 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574054.842293:0:6480:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788574054.842298:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c860217ec00/0x5bf8706fdac8bd3f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bd46 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574054.842303:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c860217ec00/0x5bf8706fdac8bd3f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bd46 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574054.842311:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574054.842318:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574054.842319:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574054.842327:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574054.842366:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85de9bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:69505170-06bc-41d1-9626-ab1a3c7f32a0:3617:1875455681529600:0@lo:103: 00000100:00100000:0.0:1788574054.842401:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788574054.842688:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574054.842700:0:7433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681529600 00000100:00100000:2.0:1788574054.842705:0:7433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681529600 00010000:00010000:2.0:1788574054.842728:0:7433:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c860217e400/0x5bf8706fdac8bd62 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8bd5b expref: 22 pid: 6486 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574054.842752:0:7433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788574054.842758:0:7433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c2336300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:69505170-06bc-41d1-9626-ab1a3c7f32a0+22:3617:x1875455681529600:12345-0@lo:103: 00010000:00010000:2.0:1788574054.842781:0:7433:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788574054.842786:0:7433:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c860217e400/0x5bf8706fdac8bd62 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8bd5b expref: 22 pid: 6486 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574054.842796:0:7433:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c860217e400/0x5bf8706fdac8bd62 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5bf8706fdac8bd5b expref: 22 pid: 6486 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574054.842812:0:7433:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788574054.843076:0:7433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c2336300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:69505170-06bc-41d1-9626-ab1a3c7f32a0+22:3617:x1875455681529600:12345-0@lo:103: Request processed in 317us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574054.843084:0:7433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788574054.843874:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788574054.843905:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85de9bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69505170-06bc-41d1-9626-ab1a3c7f32a0:3619:1875455681529472:0@lo:103: 00000100:00100000:2.0:1788574054.843950:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574054.844127:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2335f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:69505170-06bc-41d1-9626-ab1a3c7f32a0:3618:1875455681529728:0@lo:103: 00000100:00100000:3.0:1788574054.844165:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574054.844267:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681529344 00000100:00100000:2.0:1788574054.844274:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681529344 00000100:00100000:2.0:1788574054.844314:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788574054.844322:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3008380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:69505170-06bc-41d1-9626-ab1a3c7f32a0+3:6485:x1875455681529344:12345-0@lo:104: 00010000:00010000:2.0:1788574054.844335:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7e00/0x5bf8706fdac8bd15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8bd1c expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574054.844588:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788574054.844595:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3008380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:69505170-06bc-41d1-9626-ab1a3c7f32a0+3:6485:x1875455681529344:12345-0@lo:104: Request processed in 274us (2958us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574054.844603:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1788574054.844626:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788574054.844632:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7e00/0x5bf8706fdac8bd15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8bd1c expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574054.844640:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d7e00 already unused, calling callback (ffffffffc1472c20) 10000000:00010000:2.0:1788574054.844645:0:6480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7e00/0x5bf8706fdac8bd15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5bf8706fdac8bd1c expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574054.844654:0:6480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7e00/0x5bf8706fdac8bd15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5bf8706fdac8bd1c expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788574054.844662:0:6480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7e00/0x5bf8706fdac8bd15 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5bf8706fdac8bd1c expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788574054.844668:0:6480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788574054.844881:0:6480:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7e00/0x5bf8706fdac8bd15 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bd1c expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574054.844902:0:6480:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788574054.844920:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7e00/0x5bf8706fdac8bd15 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bd1c expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574054.844927:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7e00/0x5bf8706fdac8bd15 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bd1c expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574054.844942:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574054.844944:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574054.844946:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574054.844960:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69505170-06bc-41d1-9626-ab1a3c7f32a0:3619:1875455681529856:0@lo:103: 00000100:00100000:0.0:1788574054.845144:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85de9bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:69505170-06bc-41d1-9626-ab1a3c7f32a0:3617:1875455681529600:0@lo:103: 00010000:00010000:2.0:1788574054.845755:0:6485:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c85c152ea00/0x5bf8706fdac8bd00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5bf8706fdac8bcf9 expref: 21 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574054.845768:0:6485:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c85c152ea00/0x5bf8706fdac8bd00 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5bf8706fdac8bcf9 expref: 21 pid: 6485 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574054.845928:0:6485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be0a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6485:1875455681529984:0@lo:104: 00000100:00100000:2.0:1788574054.845971:0:6485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788574054.846016:0:6485:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c860217f200/0x5bf8706fdac8bcc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5bf8706fdac8bcba expref: 21 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574054.846024:0:6485:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c860217f200/0x5bf8706fdac8bcc1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5bf8706fdac8bcba expref: 21 pid: 6486 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574054.846033:0:6485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be3800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6485:1875455681530112:0@lo:104: 00000100:00100000:2.0:1788574054.846056:0:6485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574054.846102:0:6475:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788574054.846122:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681529984 00000100:00100000:2.0:1788574054.846127:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681529984 00000100:00100000:2.0:1788574054.846155:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681530112 00000100:00100000:2.0:1788574054.846158:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681530112 00000100:00100000:2.0:1788574054.846171:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788574054.846178:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:69505170-06bc-41d1-9626-ab1a3c7f32a0+4:6485:x1875455681529984:12345-0@lo:104: 00010000:00010000:2.0:1788574054.846212:0:6475:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7400/0x5bf8706fdac8bcf9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8bd00 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574054.846254:0:6475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788574054.846260:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:69505170-06bc-41d1-9626-ab1a3c7f32a0+4:6485:x1875455681529984:12345-0@lo:104: Request processed in 83us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574054.846267:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788574054.846282:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788574054.846289:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f7fc2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:69505170-06bc-41d1-9626-ab1a3c7f32a0+3:6485:x1875455681530112:12345-0@lo:104: 00010000:00010000:2.0:1788574054.846296:0:6475:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff9c85faea2400/0x5bf8706fdac8bcba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8bcc1 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574054.846325:0:6475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788574054.846330:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f7fc2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:69505170-06bc-41d1-9626-ab1a3c7f32a0+3:6485:x1875455681530112:12345-0@lo:104: Request processed in 43us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574054.846336:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:2.0:1788574054.846610:0:7444:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788574054.846617:0:7444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7400/0x5bf8706fdac8bcf9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8bd00 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574054.846624:0:7444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d7400 already unused, calling callback (ffffffffc1472c20) 10000000:00010000:2.0:1788574054.846628:0:7444:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7400/0x5bf8706fdac8bcf9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5bf8706fdac8bd00 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574054.846649:0:7444:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7400/0x5bf8706fdac8bcf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5bf8706fdac8bd00 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788574054.846657:0:7444:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7400/0x5bf8706fdac8bcf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5bf8706fdac8bd00 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788574054.846662:0:7444:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788574054.846796:0:7444:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7400/0x5bf8706fdac8bcf9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bd00 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574054.846803:0:7444:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788574054.846820:0:7444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7400/0x5bf8706fdac8bcf9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bd00 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574054.846827:0:7444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7400/0x5bf8706fdac8bcf9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bd00 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574054.846838:0:7444:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788574054.846841:0:7444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c85faea2400/0x5bf8706fdac8bcba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8bcc1 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574054.846847:0:7444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85faea2400 already unused, calling callback (ffffffffc1472c20) 10000000:00010000:2.0:1788574054.846850:0:7444:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c85faea2400/0x5bf8706fdac8bcba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5bf8706fdac8bcc1 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574054.846857:0:7444:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c85faea2400/0x5bf8706fdac8bcba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5bf8706fdac8bcc1 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788574054.846875:0:7444:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c85faea2400/0x5bf8706fdac8bcba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5bf8706fdac8bcc1 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788574054.846888:0:7444:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1788574054.847132:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681529472 00000100:00100000:1.0:1788574054.847138:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681529472 00010000:00010000:1.0:1788574054.847161:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c85faea2600/0x5bf8706fdac8bd8c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8bd85 expref: 22 pid: 6486 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574054.847207:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681529728 00000100:00100000:1.0:1788574054.847211:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681529728 00010000:00010000:1.0:1788574054.847225:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c85faea3e00/0x5bf8706fdac8bd46 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8bd3f expref: 23 pid: 6487 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574054.847244:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788574054.847250:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69505170-06bc-41d1-9626-ab1a3c7f32a0+23:3619:x1875455681529472:12345-0@lo:103: 00010000:00010000:1.0:1788574054.847260:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574054.847264:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c85faea2600/0x5bf8706fdac8bd8c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8bd85 expref: 23 pid: 6486 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574054.847285:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c85faea2600/0x5bf8706fdac8bd8c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5bf8706fdac8bd85 expref: 23 pid: 6486 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574054.847302:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788574054.847336:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69505170-06bc-41d1-9626-ab1a3c7f32a0+23:3619:x1875455681529472:12345-0@lo:103: Request processed in 86us (3385us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574054.847343:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788574054.847376:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788574054.847384:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c300b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69505170-06bc-41d1-9626-ab1a3c7f32a0+22:3618:x1875455681529728:12345-0@lo:103: 00010000:00010000:1.0:1788574054.847391:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574054.847395:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c85faea3e00/0x5bf8706fdac8bd46 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8bd3f expref: 22 pid: 6487 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574054.847403:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c85faea3e00/0x5bf8706fdac8bd46 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5bf8706fdac8bd3f expref: 22 pid: 6487 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574054.847615:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788574054.847656:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c300b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69505170-06bc-41d1-9626-ab1a3c7f32a0+22:3618:x1875455681529728:12345-0@lo:103: Request processed in 272us (3490us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574054.847663:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788574054.847803:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2335f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:69505170-06bc-41d1-9626-ab1a3c7f32a0:3618:1875455681529728:0@lo:103: 00010000:00010000:2.0:1788574054.847961:0:7444:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9c85faea2400/0x5bf8706fdac8bcba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bcc1 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574054.847968:0:7444:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788574054.847992:0:7444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c85faea2400/0x5bf8706fdac8bcba lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bcc1 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574054.848000:0:7444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c85faea2400/0x5bf8706fdac8bcba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bcc1 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574054.848011:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574054.848014:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574054.848016:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574054.848028:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:69505170-06bc-41d1-9626-ab1a3c7f32a0:3620:1875455681530240:0@lo:103: 00000100:00100000:2.0:1788574054.848072:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574054.848115:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574054.848142:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85de9bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69505170-06bc-41d1-9626-ab1a3c7f32a0:3619:1875455681529472:0@lo:103: 00000100:00100000:2.0:1788574054.848165:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681530240 00000100:00100000:2.0:1788574054.848169:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681530240 00010000:00010000:2.0:1788574054.848186:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c85c152ea00/0x5bf8706fdac8bd00 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8bcf9 expref: 22 pid: 6485 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574054.848225:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681529856 00000100:00100000:2.0:1788574054.848228:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681529856 00010000:00010000:2.0:1788574054.848240:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c860217e000/0x5bf8706fdac8bd1c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8bd15 expref: 23 pid: 6487 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574054.848252:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788574054.848265:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:69505170-06bc-41d1-9626-ab1a3c7f32a0+23:3620:x1875455681530240:12345-0@lo:103: 00010000:00010000:2.0:1788574054.848274:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788574054.848279:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c85c152ea00/0x5bf8706fdac8bd00 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8bcf9 expref: 23 pid: 6485 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574054.848288:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c85c152ea00/0x5bf8706fdac8bd00 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5bf8706fdac8bcf9 expref: 23 pid: 6485 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574054.848299:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788574054.848328:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:69505170-06bc-41d1-9626-ab1a3c7f32a0+23:3620:x1875455681530240:12345-0@lo:103: Request processed in 64us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574054.848334:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788574054.848882:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788574054.848891:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e0b7b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:69505170-06bc-41d1-9626-ab1a3c7f32a0+22:3619:x1875455681529856:12345-0@lo:103: 00010000:00010000:2.0:1788574054.848901:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788574054.848906:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c860217e000/0x5bf8706fdac8bd1c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8bd15 expref: 22 pid: 6487 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574054.848916:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c860217e000/0x5bf8706fdac8bd1c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5bf8706fdac8bd15 expref: 22 pid: 6487 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574054.848927:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788574054.849017:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e0b7b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:69505170-06bc-41d1-9626-ab1a3c7f32a0+22:3619:x1875455681529856:12345-0@lo:103: Request processed in 128us (901us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574054.849024:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788574054.849078:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:69505170-06bc-41d1-9626-ab1a3c7f32a0:3620:1875455681530240:0@lo:103: 00010000:00010000:2.0:1788574054.849099:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574054.849104:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788574054.849113:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:69505170-06bc-41d1-9626-ab1a3c7f32a0:3618:1875455681530368:0@lo:103: 00000100:00100000:2.0:1788574054.849147:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574054.849181:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681530368 00000100:00100000:2.0:1788574054.849185:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681530368 00010000:00010000:2.0:1788574054.849221:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c860217f200/0x5bf8706fdac8bcc1 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8bcba expref: 22 pid: 6486 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574054.849239:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788574054.849245:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:69505170-06bc-41d1-9626-ab1a3c7f32a0+22:3618:x1875455681530368:12345-0@lo:103: 00010000:00010000:2.0:1788574054.849252:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788574054.849256:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c860217f200/0x5bf8706fdac8bcc1 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8bcba expref: 22 pid: 6486 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574054.849266:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c860217f200/0x5bf8706fdac8bcc1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5bf8706fdac8bcba expref: 22 pid: 6486 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574054.849275:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788574054.849301:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:69505170-06bc-41d1-9626-ab1a3c7f32a0+22:3618:x1875455681530368:12345-0@lo:103: Request processed in 56us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574054.849308:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788574054.849332:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:69505170-06bc-41d1-9626-ab1a3c7f32a0:3618:1875455681530368:0@lo:103: 00010000:00010000:2.0:1788574054.849393:0:6485:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c85c152fe00/0x5bf8706fdac8bc97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5bf8706fdac8bc90 expref: 21 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574054.849406:0:6485:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c85c152fe00/0x5bf8706fdac8bc97 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5bf8706fdac8bc90 expref: 21 pid: 6485 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574054.849428:0:6485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be1180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6485:1875455681530496:0@lo:104: 00000100:00100000:2.0:1788574054.849452:0:6485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574054.849476:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681530496 00000100:00100000:2.0:1788574054.849486:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681530496 00000100:00100000:2.0:1788574054.849512:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788574054.849519:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:69505170-06bc-41d1-9626-ab1a3c7f32a0+3:6485:x1875455681530496:12345-0@lo:104: 00010000:00010000:2.0:1788574054.849530:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff9c85faea2a00/0x5bf8706fdac8bc90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8bc97 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574054.849566:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788574054.849572:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:69505170-06bc-41d1-9626-ab1a3c7f32a0+3:6485:x1875455681530496:12345-0@lo:104: Request processed in 54us (119us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574054.849578:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1788574054.849595:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788574054.849601:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c85faea2a00/0x5bf8706fdac8bc90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8bc97 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574054.849608:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85faea2a00 already unused, calling callback (ffffffffc1472c20) 10000000:00010000:2.0:1788574054.849612:0:6480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c85faea2a00/0x5bf8706fdac8bc90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5bf8706fdac8bc97 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574054.849621:0:6480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c85faea2a00/0x5bf8706fdac8bc90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5bf8706fdac8bc97 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788574054.849629:0:6480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c85faea2a00/0x5bf8706fdac8bc90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5bf8706fdac8bc97 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788574054.849634:0:6480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788574054.849657:0:6480:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9c85faea2a00/0x5bf8706fdac8bc90 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bc97 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574054.849664:0:6480:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788574054.849674:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c85faea2a00/0x5bf8706fdac8bc90 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bc97 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574054.849702:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c85faea2a00/0x5bf8706fdac8bc90 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bc97 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574054.849716:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574054.849718:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574054.849720:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574054.849734:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:69505170-06bc-41d1-9626-ab1a3c7f32a0:3618:1875455681530624:0@lo:103: 00000100:00100000:2.0:1788574054.849759:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574054.849994:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681530624 00000100:00100000:2.0:1788574054.849999:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681530624 00010000:00010000:2.0:1788574054.850013:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c85c152fe00/0x5bf8706fdac8bc97 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8bc90 expref: 22 pid: 6485 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574054.850031:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788574054.850037:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:69505170-06bc-41d1-9626-ab1a3c7f32a0+22:3618:x1875455681530624:12345-0@lo:103: 00010000:00010000:2.0:1788574054.850044:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788574054.850048:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c85c152fe00/0x5bf8706fdac8bc97 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8bc90 expref: 22 pid: 6485 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574054.850057:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c85c152fe00/0x5bf8706fdac8bc97 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5bf8706fdac8bc90 expref: 22 pid: 6485 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574054.850070:0:6478:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c85c152e000/0x5bf8706fdac8bda1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574054.850078:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85c152e000/0x5bf8706fdac8bda1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574054.850091:0:6478:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c85c152e000/0x5bf8706fdac8bda1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574054.850103:0:6478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c85c152e000/0x5bf8706fdac8bda1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574054.850110:0:6478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c85c152e000/0x5bf8706fdac8bda1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574054.850116:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c85c152e000/0x5bf8706fdac8bda1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574054.850121:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85c152e000 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:2.0:1788574054.850126:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c85c152e000/0x5bf8706fdac8bda1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574054.850134:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c85c152e000/0x5bf8706fdac8bda1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574054.850142:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c85c152e000/0x5bf8706fdac8bda1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574054.850151:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788574054.850179:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:69505170-06bc-41d1-9626-ab1a3c7f32a0+22:3618:x1875455681530624:12345-0@lo:103: Request processed in 143us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574054.850186:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788574054.850234:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:69505170-06bc-41d1-9626-ab1a3c7f32a0:3618:1875455681530624:0@lo:103: 00000100:00100000:2.0:1788574054.850255:0:6485:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85f6f2d180 going to sleep for 11 seconds 00010000:00010000:2.0:1788574054.850269:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85faea2600/0x5bf8706fdac8bd8c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5bf8706fdac8bd85 expref: 21 pid: 6486 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574054.850278:0:6485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fa32b480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6485:1875455681528960:0@lo:104: 00010000:00010000:2.0:1788574054.850297:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c860217e400/0x5bf8706fdac8bd62 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5bf8706fdac8bd5b expref: 20 pid: 6486 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574054.850307:0:6485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fa0e7800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6485:1875455681529088:0@lo:104: 00010000:00010000:2.0:1788574054.850317:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85faea3e00/0x5bf8706fdac8bd46 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5bf8706fdac8bd3f expref: 19 pid: 6487 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574054.850326:0:6485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fa0e6680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6485:1875455681529216:0@lo:104: 00010000:00010000:2.0:1788574054.850336:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c860217e000/0x5bf8706fdac8bd1c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5bf8706fdac8bd15 expref: 18 pid: 6487 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574054.850343:0:6485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fa0e4e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6485:1875455681529344:0@lo:104: 00010000:00010000:2.0:1788574054.850353:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85c152ea00/0x5bf8706fdac8bd00 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5bf8706fdac8bcf9 expref: 17 pid: 6485 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574054.850624:0:6485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be0a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6485:1875455681529984:0@lo:104: 00010000:00010000:2.0:1788574054.850639:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c860217f200/0x5bf8706fdac8bcc1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5bf8706fdac8bcba expref: 16 pid: 6486 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574054.850649:0:6485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be3800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6485:1875455681530112:0@lo:104: 00010000:00010000:2.0:1788574054.850658:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85c152fe00/0x5bf8706fdac8bc97 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5bf8706fdac8bc90 expref: 15 pid: 6485 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574054.850668:0:6485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be1180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6485:1875455681530496:0@lo:104: 00010000:00010000:2.0:1788574054.850765:0:6485:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c85c152e000/0x5bf8706fdac8bda1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574054.850846:0:6485:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c85c152e000/0x5bf8706fdac8bda1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574054.850869:0:6485:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c85c152e000/0x5bf8706fdac8bda1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574054.850875:0:6485:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85c152e000/0x5bf8706fdac8bda1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788574054.850888:0:6485:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788574054.852877:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69505170-06bc-41d1-9626-ab1a3c7f32a0:3619:1875455681529856:0@lo:103: 00000100:00100000:2.0:1788574054.856121:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c820c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+14:9485:x1875455681528832:12345-0@lo:253: Request processed in 24950us (25375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574054.856137:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788574054.856264:0:9485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85de9bc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:9485:1875455681528832:0@lo:253: 10000000:01000000:0.0:1788574054.856280:0:9485:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788574054.856283:0:9485:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788574054.856285:0:9485:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788574054.856286:0:9485:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788574054.856287:0:9485:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1788574054.856288:0:9485:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788574054.856290:0:9485:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788574054.856292:0:9485:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788574054.856293:0:9485:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788574054.856295:0:9485:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788574054.856297:0:9485:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788574054.856316:0:9485:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c85f7fb1000 from lustre-OST0001 10000000:01000000:0.0:1788574054.856365:0:9485:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1788574054.856368:0:9485:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788574054.856377:0:9485:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9c85e56999c0 local copy 10000000:01000000:0.0:1788574054.856381:0:9485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788574054.856580:0:9485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6200/0x5bf8706fdac8bda8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574054.856591:0:9485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6200/0x5bf8706fdac8bda8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574054.856616:0:9485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6200/0x5bf8706fdac8bda8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574054.856634:0:9485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2335f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:9485:1875455681530752:0@lo:101: 00000100:00100000:0.0:1788574054.856671:0:9485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574054.856712:0:9485:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8601983480 going to sleep for 11 seconds 00000100:00100000:2.0:1788574054.856909:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681530752 00000100:00100000:2.0:1788574054.856915:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681530752 00000100:00100000:2.0:1788574054.856963:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788574054.856972:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c820c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+14:9485:x1875455681530752:12345-0@lo:101: 00010000:00010000:2.0:1788574054.856983:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574054.856996:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85fa32e400/0x5bf8706fdac8bdaf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8bda8 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574054.857019:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85fa32e400/0x5bf8706fdac8bdaf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8bda8 expref: 15 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574054.857029:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85fa32e400/0x5bf8706fdac8bdaf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8bda8 expref: 15 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574054.857039:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85fa32e400, rc 0) 00000100:00100000:2.0:1788574054.857081:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c820c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+15:9485:x1875455681530752:12345-0@lo:101: Request processed in 110us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574054.857087:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788574054.857163:0:9485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2335f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:9485:1875455681530752:0@lo:101: 00010000:00010000:0.0:1788574054.857176:0:9485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6200/0x5bf8706fdac8bda8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x5bf8706fdac8bdaf expref: -99 pid: 9485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574054.857185:0:9485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6200/0x5bf8706fdac8bda8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x5bf8706fdac8bdaf expref: -99 pid: 9485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574054.857304:0:9485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2335f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:9485:1875455681530880:0@lo:501: 00000100:00100000:0.0:1788574054.857357:0:9485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574054.857387:0:9485:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8601983480 going to sleep for 11 seconds 00000100:00100000:3.0:1788574054.857586:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681530880 00000100:00100000:3.0:1788574054.857590:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681530880 00000100:00100000:3.0:1788574054.857674:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788574054.857682:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c820e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+15:9485:x1875455681530880:12345-0@lo:501: 00000100:00100000:3.0:1788574054.857742:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c820e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+15:9485:x1875455681530880:12345-0@lo:501: Request processed in 61us (396us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788574054.857749:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788574054.857973:0:9485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2335f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:9485:1875455681530880:0@lo:501: 10000000:01000000:0.0:1788574054.857988:0:9485:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.151@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788574054.858007:0:9485:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.151@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788574054.858012:0:9485:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6200/0x5bf8706fdac8bda8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x5bf8706fdac8bdaf expref: -99 pid: 9485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574054.858020:0:9485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6200/0x5bf8706fdac8bda8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x5bf8706fdac8bdaf expref: -99 pid: 9485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574054.858027:0:9485:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6200/0x5bf8706fdac8bda8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x5bf8706fdac8bdaf expref: -99 pid: 9485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574054.858055:0:9485:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788574054.858080:0:9485:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c85f7fb1000 10000000:01000000:0.0:1788574054.858085:0:9485:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788574054.858091:0:9485:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788574054.858093:0:9485:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788574054.858097:0:9485:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1788574054.858099:0:9485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788574054.858118:0:9485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7c00/0x5bf8706fdac8bdb6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574054.858125:0:9485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7c00/0x5bf8706fdac8bdb6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574054.858132:0:9485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7c00/0x5bf8706fdac8bdb6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574054.858144:0:9485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2335f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:9485:1875455681531008:0@lo:101: 00000100:00100000:0.0:1788574054.858170:0:9485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574054.858251:0:9485:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8601983c00 going to sleep for 11 seconds 00010000:00010000:2.0:1788574054.858295:0:7444:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788574054.858300:0:7444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6200/0x5bf8706fdac8bda8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x5bf8706fdac8bdaf expref: -99 pid: 9485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574054.858307:0:7444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d6200 already unused, calling callback (ffffffffc1472c20) 10000000:00010000:2.0:1788574054.858311:0:7444:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6200/0x5bf8706fdac8bda8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x5bf8706fdac8bdaf expref: -99 pid: 9485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574054.858319:0:7444:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6200/0x5bf8706fdac8bda8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x5bf8706fdac8bdaf expref: -99 pid: 9485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788574054.858327:0:7444:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6200/0x5bf8706fdac8bda8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x5bf8706fdac8bdaf expref: -99 pid: 9485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788574054.858333:0:7444:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788574054.858371:0:7444:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6200/0x5bf8706fdac8bda8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x5bf8706fdac8bdaf expref: -99 pid: 9485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574054.858378:0:7444:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788574054.858403:0:7444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6200/0x5bf8706fdac8bda8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x5bf8706fdac8bdaf expref: -99 pid: 9485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574054.858419:0:7444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6200/0x5bf8706fdac8bda8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x5bf8706fdac8bdaf expref: -99 pid: 9485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574054.858433:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574054.858435:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574054.858436:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574054.858445:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788574054.858456:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:69505170-06bc-41d1-9626-ab1a3c7f32a0:3620:1875455681531136:0@lo:103: 00000100:00100000:2.0:1788574054.858486:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574054.858526:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681531136 00000100:00100000:2.0:1788574054.858531:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681531136 00000100:00100000:2.0:1788574054.858565:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788574054.858573:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69505170-06bc-41d1-9626-ab1a3c7f32a0+15:3620:x1875455681531136:12345-0@lo:103: 00010000:00010000:2.0:1788574054.858584:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788574054.858596:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85fa32e400/0x5bf8706fdac8bdaf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5bf8706fdac8bda8 expref: 15 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574054.858612:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788574054.858640:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69505170-06bc-41d1-9626-ab1a3c7f32a0+14:3620:x1875455681531136:12345-0@lo:103: Request processed in 68us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574054.858647:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788574054.858674:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:69505170-06bc-41d1-9626-ab1a3c7f32a0:3620:1875455681531136:0@lo:103: 00000100:00100000:3.0:1788574054.859113:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681531008 00000100:00100000:3.0:1788574054.859118:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681531008 00000100:00100000:3.0:1788574054.859179:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788574054.859186:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c820f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+14:9485:x1875455681531008:12345-0@lo:101: 00010000:00010000:3.0:1788574054.859220:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574054.859233:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85c152f200/0x5bf8706fdac8bdbd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8bdb6 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574054.859251:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85c152f200/0x5bf8706fdac8bdbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8bdb6 expref: 15 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574054.859260:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85c152f200/0x5bf8706fdac8bdbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8bdb6 expref: 15 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574054.859267:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85c152f200, rc 0) 00000100:00100000:3.0:1788574054.859303:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c820f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+15:9485:x1875455681531008:12345-0@lo:101: Request processed in 118us (1132us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574054.859308:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788574054.859449:0:9485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2335f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:9485:1875455681531008:0@lo:101: 00010000:00010000:0.0:1788574054.859462:0:9485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7c00/0x5bf8706fdac8bdb6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bdbd expref: -99 pid: 9485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574054.859471:0:9485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7c00/0x5bf8706fdac8bdb6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8bdbd expref: -99 pid: 9485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574054.859547:0:9485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2335f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:9485:1875455681531264:0@lo:501: 00000100:00100000:0.0:1788574054.859586:0:9485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574054.859949:0:9485:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8601983c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788574054.860023:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681531264 00000100:00100000:2.0:1788574054.860029:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681531264 00000100:00100000:2.0:1788574054.860054:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788574054.860062:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c860022b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+15:9485:x1875455681531264:12345-0@lo:501: 00000100:00100000:2.0:1788574054.860171:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c860022b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+15:9485:x1875455681531264:12345-0@lo:501: Request processed in 110us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574054.860178:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788574054.860282:0:9485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2335f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:9485:1875455681531264:0@lo:501: 00000100:00100000:0.0:1788574054.860324:0:9485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2335f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:9485:1875455681531392:0@lo:503: 00000100:00100000:0.0:1788574054.860381:0:9485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574054.860401:0:9485:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8601983c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788574054.860608:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681531392 00000100:00100000:2.0:1788574054.860613:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681531392 00000100:00100000:2.0:1788574054.860630:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788574054.860636:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8600229850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+15:9485:x1875455681531392:12345-0@lo:503: 00000100:00100000:2.0:1788574054.860727:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8600229850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+15:9485:x1875455681531392:12345-0@lo:503: Request processed in 90us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574054.860734:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788574054.860878:0:9485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2335f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:9485:1875455681531392:0@lo:503: 00000040:00080000:0.0:1788574054.861119:0:9485:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788574054.861215:0:9485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2335f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:9485:1875455681531520:0@lo:502: 00000100:00100000:0.0:1788574054.861257:0:9485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574054.861544:0:9485:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8601983c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788574054.861665:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681531520 00000100:00100000:3.0:1788574054.861671:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681531520 00000100:00100000:3.0:1788574054.861706:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788574054.861713:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c860022b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+15:9485:x1875455681531520:12345-0@lo:502: 00000100:00100000:3.0:1788574054.861894:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c860022b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+15:9485:x1875455681531520:12345-0@lo:502: Request processed in 181us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574054.861900:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788574054.861993:0:9485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2335f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:9485:1875455681531520:0@lo:502: 00000040:00080000:0.0:1788574054.862333:0:9485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788574054.862594:0:9485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1788574054.862611:0:9485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1788574054.862625:0:9485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1788574054.862639:0:9485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1788574054.862665:0:9485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1788574054.862693:0:9485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2335f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:9485:1875455681531648:0@lo:502: 00000100:00100000:0.0:1788574054.862733:0:9485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574054.862777:0:9485:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8601983c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788574054.862900:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681531648 00000100:00100000:1.0:1788574054.862905:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681531648 00000100:00100000:1.0:1788574054.862945:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788574054.862953:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5676450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+15:9485:x1875455681531648:12345-0@lo:502: 00000100:00100000:1.0:1788574054.863055:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5676450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+15:9485:x1875455681531648:12345-0@lo:502: Request processed in 103us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574054.863062:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788574054.863137:0:9485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2335f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:9485:1875455681531648:0@lo:502: 00000040:00080000:2.0:1788574054.863183:0:9485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1788574054.863223:0:9485:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:2.0:1788574054.863901:0:9496:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788574054.863910:0:9496:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1788574054.863916:0:9496:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574054.863919:0:9496:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1788574054.863925:0:9496:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788574054.863952:0:9496:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9c84c30399c0) 00000020:00000080:2.0:1788574054.863977:0:9496:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788574054.863983:0:9496:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788574054.864055:0:9496:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c85f7fb1000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1788574054.864064:0:9496:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788574054.864072:0:9496:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x5bf8706fdac8bdcb 00010000:00010000:3.0:1788574054.870169:0:9496:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:3.0:1788574054.870961:0:9496:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1788574054.875996:0:9496:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1788574054.876508:0:9496:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1788574054.883682:0:9496:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:2.0:1788574054.883939:0:9496:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:2.0:1788574054.889920:0:9496:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:1.0:1788574054.892020:0:9496:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788574054.892032:0:9496:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788574054.892039:0:9496:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574054.892041:0:9496:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788574054.892045:0:9496:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788574054.892049:0:9496:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574054.892050:0:9496:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788574054.892053:0:9496:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788574054.892055:0:9496:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788574054.892082:0:9496:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788574054.892085:0:9496:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574054.892086:0:9496:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788574054.892090:0:9496:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1788574054.892269:0:9485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1788574054.892302:0:9485:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788574054.892329:0:9485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7c00/0x5bf8706fdac8bdb6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bdbd expref: -99 pid: 9485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574054.892341:0:9485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7c00/0x5bf8706fdac8bdb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bdbd expref: -99 pid: 9485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788574054.892584:0:9485:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c85f7fb1000 from 1 10000000:01000000:3.0:1788574054.892587:0:9485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788574054.892625:0:9485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85c152f600/0x5bf8706fdac8bdd2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574054.892635:0:9485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c85c152f600/0x5bf8706fdac8bdd2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574054.892646:0:9485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c85c152f600/0x5bf8706fdac8bdd2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574054.892670:0:9485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3008a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:9485:1875455681531776:0@lo:101: 00000100:00100000:3.0:1788574054.892761:0:9485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574054.892817:0:9485:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85d10820c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788574054.892936:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681531776 00000100:00100000:1.0:1788574054.892945:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681531776 00000100:00100000:1.0:1788574054.893033:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788574054.893042:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5674450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+15:9485:x1875455681531776:12345-0@lo:101: 00010000:00010000:1.0:1788574054.893055:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574054.893068:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85faea2e00/0x5bf8706fdac8bdd9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8bdd2 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574054.893092:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85faea2e00/0x5bf8706fdac8bdd9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8bdd2 expref: 16 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574054.893103:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85faea2e00/0x5bf8706fdac8bdd9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8bdd2 expref: 16 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574054.893112:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85faea2e00, rc 0) 00000100:00100000:1.0:1788574054.893162:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5674450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+16:9485:x1875455681531776:12345-0@lo:101: Request processed in 121us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574054.893169:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788574054.893290:0:9485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3008a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:9485:1875455681531776:0@lo:101: 00010000:00010000:3.0:1788574054.893303:0:9485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c85c152f600/0x5bf8706fdac8bdd2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bdd9 expref: -99 pid: 9485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574054.893312:0:9485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c85c152f600/0x5bf8706fdac8bdd2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8bdd9 expref: -99 pid: 9485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574054.893585:0:9485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3008a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:9485:1875455681531904:0@lo:501: 00000100:00100000:3.0:1788574054.893617:0:9485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574054.896249:0:9485:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85d10820c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788574054.896912:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681531904 00000100:00100000:0.0:1788574054.896923:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681531904 00000100:00100000:0.0:1788574054.896974:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788574054.896983:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5674050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+16:9485:x1875455681531904:12345-0@lo:501: 00000100:00100000:0.0:1788574054.897154:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5674050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+16:9485:x1875455681531904:12345-0@lo:501: Request processed in 170us (3535us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574054.897173:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788574054.897568:0:9485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3008a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:9485:1875455681531904:0@lo:501: 00000100:00100000:3.0:1788574054.897620:0:9485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3008a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:9485:1875455681532032:0@lo:503: 00000100:00100000:3.0:1788574054.897670:0:9485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574054.897711:0:9485:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85d10820c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788574054.897894:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681532032 00000100:00100000:1.0:1788574054.897900:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681532032 00000100:00100000:1.0:1788574054.897947:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788574054.897955:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5676050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+16:9485:x1875455681532032:12345-0@lo:503: 00000100:00100000:1.0:1788574054.898140:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5676050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+16:9485:x1875455681532032:12345-0@lo:503: Request processed in 186us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574054.898148:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788574054.898237:0:9485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3008a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:9485:1875455681532032:0@lo:503: 00000040:00080000:3.0:1788574054.898510:0:9485:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788574054.898596:0:9485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3008a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:9485:1875455681532160:0@lo:502: 00000100:00100000:3.0:1788574054.898637:0:9485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574054.898676:0:9485:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85d10820c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788574054.898897:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681532160 00000100:00100000:1.0:1788574054.898903:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681532160 00000100:00100000:1.0:1788574054.898949:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788574054.898957:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5677850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+16:9485:x1875455681532160:12345-0@lo:502: 00000100:00100000:1.0:1788574054.899117:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5677850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+16:9485:x1875455681532160:12345-0@lo:502: Request processed in 161us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574054.899124:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788574054.899527:0:9485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3008a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:9485:1875455681532160:0@lo:502: 00000040:00080000:3.0:1788574054.900077:0:9485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1788574054.900109:0:9485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1788574054.900137:0:9485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3008a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:9485:1875455681532288:0@lo:502: 00000100:00100000:3.0:1788574054.900219:0:9485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574054.900255:0:9485:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85d10820c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788574054.901144:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681532288 00000100:00100000:2.0:1788574054.901156:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681532288 00000100:00100000:2.0:1788574054.901269:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788574054.901277:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5675050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+16:9485:x1875455681532288:12345-0@lo:502: 00000100:00100000:2.0:1788574054.901438:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5675050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+16:9485:x1875455681532288:12345-0@lo:502: Request processed in 161us (1217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574054.901445:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788574054.905621:0:9485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3008a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:9485:1875455681532288:0@lo:502: 00000040:00080000:3.0:1788574054.905737:0:9485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1788574054.905753:0:9485:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1788574054.907312:0:9500:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788574054.907324:0:9500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788574054.907327:0:9500:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788574054.907334:0:9500:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c85f7fb1000 00000020:00000080:0.0:1788574054.907337:0:9500:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788574054.907564:0:9500:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788574054.907569:0:9500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788574054.907571:0:9500:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788574054.907574:0:9500:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1788574054.907729:0:9485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788574054.907756:0:9485:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788574054.907875:0:9485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85c152f600/0x5bf8706fdac8bdd2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bdd9 expref: -99 pid: 9485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574054.907887:0:9485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c85c152f600/0x5bf8706fdac8bdd2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bdd9 expref: -99 pid: 9485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788574054.907937:0:9485:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788574054.907941:0:9485:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c85f7fb1000 10000000:01000000:3.0:1788574054.907944:0:9485:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c85f7fb1000 10000000:01000000:3.0:1788574054.907947:0:9485:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788574054.907953:0:9485:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c85f7fb1000 from 1 10000000:01000000:3.0:1788574054.907956:0:9485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788574054.908082:0:9485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85c152e600/0x5bf8706fdac8bde0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574054.908092:0:9485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c85c152e600/0x5bf8706fdac8bde0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574054.908103:0:9485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c85c152e600/0x5bf8706fdac8bde0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574054.908126:0:9485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3008a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:9485:1875455681532416:0@lo:101: 00000100:00100000:3.0:1788574054.908289:0:9485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574054.908354:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681532416 00000100:00100000:1.0:1788574054.908362:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681532416 00000100:00100000:1.0:1788574054.908409:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788574054.908418:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5675c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+16:9485:x1875455681532416:12345-0@lo:101: 00010000:00010000:1.0:1788574054.908430:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574054.908443:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85faea3400/0x5bf8706fdac8bde7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8bde0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574054.908466:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85faea3400/0x5bf8706fdac8bde7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8bde0 expref: 17 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574054.908477:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85faea3400/0x5bf8706fdac8bde7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8bde0 expref: 17 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574054.908485:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85faea3400, rc 0) 00000100:00100000:1.0:1788574054.908527:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5675c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+17:9485:x1875455681532416:12345-0@lo:101: Request processed in 110us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574054.908534:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788574054.908557:0:9485:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85d1082180 going to sleep for 11 seconds 00000100:00100000:3.0:1788574054.908579:0:9485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3008a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:9485:1875455681532416:0@lo:101: 00010000:00010000:3.0:1788574054.908595:0:9485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c85c152e600/0x5bf8706fdac8bde0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bde7 expref: -99 pid: 9485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574054.908604:0:9485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c85c152e600/0x5bf8706fdac8bde0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8bde7 expref: -99 pid: 9485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574054.908682:0:9485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3008a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:9485:1875455681532544:0@lo:501: 00000100:00100000:3.0:1788574054.908708:0:9485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574054.908731:0:9485:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85d1082180 going to sleep for 11 seconds 00000100:00100000:1.0:1788574054.908818:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681532544 00000100:00100000:1.0:1788574054.908822:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681532544 00000100:00100000:1.0:1788574054.908855:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788574054.908872:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5675450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+17:9485:x1875455681532544:12345-0@lo:501: 00000100:00100000:1.0:1788574054.908977:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5675450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+17:9485:x1875455681532544:12345-0@lo:501: Request processed in 106us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574054.908984:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788574054.909072:0:9485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3008a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:9485:1875455681532544:0@lo:501: 00000100:00100000:3.0:1788574054.909099:0:9485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3008a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:9485:1875455681532672:0@lo:503: 00000100:00100000:3.0:1788574054.909143:0:9485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574054.909163:0:9485:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85d1082180 going to sleep for 11 seconds 00000100:00100000:2.0:1788574054.910131:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681532672 00000100:00100000:2.0:1788574054.910141:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681532672 00000100:00100000:2.0:1788574054.910674:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788574054.910685:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5676850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+17:9485:x1875455681532672:12345-0@lo:503: 00000100:00100000:2.0:1788574054.911118:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5676850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+17:9485:x1875455681532672:12345-0@lo:503: Request processed in 434us (1973us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574054.911133:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788574054.911576:0:9485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3008a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:9485:1875455681532672:0@lo:503: 00000040:00080000:3.0:1788574054.911929:0:9485:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788574054.912064:0:9485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3008a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:9485:1875455681532800:0@lo:502: 00000100:00100000:3.0:1788574054.912116:0:9485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574054.912220:0:9485:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85d1082180 going to sleep for 11 seconds 00000100:00100000:0.0:1788574054.912888:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681532800 00000100:00100000:0.0:1788574054.912897:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681532800 00000100:00100000:0.0:1788574054.913066:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788574054.913076:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5677050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+17:9485:x1875455681532800:12345-0@lo:502: 00000100:00100000:0.0:1788574054.913233:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5677050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+17:9485:x1875455681532800:12345-0@lo:502: Request processed in 159us (1116us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574054.913241:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788574054.913343:0:9485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3008a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:9485:1875455681532800:0@lo:502: 00000040:00080000:3.0:1788574054.913580:0:9485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1788574054.913609:0:9485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1788574054.913622:0:9485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1788574054.913636:0:9485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1788574054.913650:0:9485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1788574054.913663:0:9485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1788574054.913686:0:9485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1788574054.913700:0:9485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1788574054.913714:0:9485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1788574054.913727:0:9485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1788574054.913739:0:9485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1788574054.913751:0:9485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1788574054.913762:0:9485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1788574054.913790:0:9485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1788574054.913805:0:9485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1788574054.913817:0:9485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1788574054.913829:0:9485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1788574054.913841:0:9485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1788574054.913853:0:9485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1788574054.913878:0:9485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1788574054.913894:0:9485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1788574054.913908:0:9485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1788574054.913922:0:9485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1788574054.913935:0:9485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1788574054.913947:0:9485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1788574054.913958:0:9485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1788574054.913995:0:9485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1788574054.914010:0:9485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:3.0:1788574054.914020:0:9485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1788574054.914031:0:9485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:3.0:1788574054.914043:0:9485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:3.0:1788574054.914055:0:9485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:3.0:1788574054.914064:0:9485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:3.0:1788574054.914075:0:9485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:3.0:1788574054.914087:0:9485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:3.0:1788574054.914098:0:9485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:3.0:1788574054.914112:0:9485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:3.0:1788574054.914126:0:9485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:3.0:1788574054.914139:0:9485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:3.0:1788574054.914164:0:9485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:3.0:1788574054.914177:0:9485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:3.0:1788574054.914233:0:9485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:3.0:1788574054.914262:0:9485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:3.0:1788574054.914278:0:9485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:3.0:1788574054.914289:0:9485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:3.0:1788574054.914301:0:9485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:3.0:1788574054.914336:0:9485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3008a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:9485:1875455681532928:0@lo:502: 00000100:00100000:3.0:1788574054.914395:0:9485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574054.914439:0:9485:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85d1082180 going to sleep for 11 seconds 00000100:00100000:0.0:1788574054.914682:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681532928 00000100:00100000:0.0:1788574054.914689:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681532928 00000100:00100000:0.0:1788574054.914723:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788574054.914731:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5675850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+17:9485:x1875455681532928:12345-0@lo:502: 00000100:00100000:0.0:1788574054.914854:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5675850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+17:9485:x1875455681532928:12345-0@lo:502: Request processed in 123us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574054.916013:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788574054.916595:0:9485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3008a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:9485:1875455681532928:0@lo:502: 00000040:00080000:3.0:1788574054.916696:0:9485:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:3.0:1788574054.916711:0:9485:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:0.0:1788574054.917652:0:9501:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788574054.917668:0:9501:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9c85faf48000) 00000020:00000080:0.0:1788574054.917696:0:9501:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:0.0:1788574054.917785:0:9501:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c85f7fb1000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788574054.917793:0:9501:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c85f7fb1000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788574054.917796:0:9501:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c85f7fb1000 3 00010000:00080000:0.0:1788574054.917824:0:9501:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c84c3022800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.151@tcp at head 00010000:00010000:0.0:1788574054.922322:0:9501:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:0.0:1788574054.922706:0:9501:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1788574054.922757:0:9501:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788574054.922771:0:9501:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x5bf8706fdac8bdf5 00000100:00080000:0.0:1788574054.922784:0:9501:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788574054.922789:0:9501:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c84c3022800 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:0.0:1788574054.922826:0:9501:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c84c2335f80 x1875455681533056/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788574054.922870:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2335f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1875455681533056:0@lo:38: 00000100:00100000:0.0:1788574054.922941:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574054.923338:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681533056 00000100:00100000:0.0:1788574054.923522:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681533056 00000100:00100000:0.0:1788574054.923557:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788574054.923565:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c2335180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1875455681533056:12345-0@lo:38: 00010000:00080000:0.0:1788574054.923608:0:6492:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 194 last 0 00000020:00000080:0.0:1788574054.923638:0:6492:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x5bf8706fdac8bdfc 00000004:00100000:0.0:1788574054.923653:0:6492:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788574054.923685:0:6492:0:(import.c:65:import_set_state_nolock()) ffff9c84c3025800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788574054.923740:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c2335180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1875455681533056:12345-0@lo:38: Request processed in 174us (799us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574054.923747:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788574054.923876:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c84c2335f80 x1875455681533056/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788574064 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574054.923887:0:3616:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788574054.923902:0:3616:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1788574054.923910:0:3616:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788574054.923914:0:3616:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788574054.923917:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c84c3022800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788574054.923922:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2335f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1875455681533056:0@lo:38: 00000100:00080000:0.0:1788574054.923944:0:9501:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788574054.924161:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2335880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681533568:0@lo:400: 00000100:00100000:0.0:1788574054.924267:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574054.924292:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681534080:0@lo:400: 00000100:00100000:0.0:1788574054.924329:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574054.924364:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788574054.924370:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2335f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875455681533184:0@lo:400: 00000100:00100000:0.0:1788574054.924393:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574054.924419:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85de9bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3619:1875455681533696:0@lo:400: 00000100:00100000:0.0:1788574054.924440:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574054.924463:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2337b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681533312:0@lo:400: 00000100:00100000:0.0:1788574054.924492:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574054.924506:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85de9bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1875455681533824:0@lo:400: 00000100:00100000:0.0:1788574054.924520:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574054.924533:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788574054.924538:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2336300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875455681533440:0@lo:400: 00000100:00100000:0.0:1788574054.924552:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574054.924562:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85de9bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681533952:0@lo:400: 00000100:00100000:0.0:1788574054.924576:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574054.924599:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681533568 00000100:00100000:0.0:1788574054.924608:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681533568 00000100:00100000:0.0:1788574054.924634:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681533312 00000100:00100000:0.0:1788574054.924636:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681533312 00000100:00100000:0.0:1788574054.924648:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788574054.924654:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c335ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681533568:12345-0@lo:400: 00000100:00100000:0.0:1788574054.924690:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c335ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681533568:12345-0@lo:400: Request processed in 36us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574054.924696:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788574054.924707:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788574054.924711:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c335ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681533312:12345-0@lo:400: 00000100:00100000:0.0:1788574054.924734:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c335ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681533312:12345-0@lo:400: Request processed in 22us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574054.924739:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788574054.924752:0:8815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681534080 00000100:00100000:0.0:1788574054.924755:0:8815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681534080 00000100:00100000:0.0:1788574054.924780:0:8815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681533952 00000100:00100000:0.0:1788574054.924782:0:8815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681533952 00000100:00100000:0.0:1788574054.924795:0:8815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788574054.924800:0:8815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c335c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681534080:12345-0@lo:400: 00000100:00100000:0.0:1788574054.924823:0:8815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c335c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681534080:12345-0@lo:400: Request processed in 23us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574054.924828:0:8815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788574054.924837:0:8815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788574054.924841:0:8815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c335ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681533952:12345-0@lo:400: 00000100:00100000:0.0:1788574054.924870:0:8815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c335ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681533952:12345-0@lo:400: Request processed in 18us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574054.924875:0:8815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788574054.924889:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681533184 00000100:00100000:0.0:1788574054.924896:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681533184 00000100:00100000:0.0:1788574054.924912:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681533696 00000100:00100000:0.0:1788574054.924914:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681533696 00000100:00100000:0.0:1788574054.924923:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681533824 00000100:00100000:0.0:1788574054.924925:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681533824 00000100:00100000:0.0:1788574054.924936:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681533440 00000100:00100000:0.0:1788574054.924938:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681533440 00000100:00100000:0.0:1788574054.924948:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788574054.924953:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c335dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875455681533184:12345-0@lo:400: 00000100:00100000:0.0:1788574054.924990:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c335dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875455681533184:12345-0@lo:400: Request processed in 37us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574054.924995:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788574054.925004:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788574054.925009:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c335c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875455681533696:12345-0@lo:400: 00000100:00100000:0.0:1788574054.925029:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c335c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875455681533696:12345-0@lo:400: Request processed in 20us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574054.925034:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788574054.925041:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788574054.925046:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c335e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875455681533824:12345-0@lo:400: 00000100:00100000:0.0:1788574054.925063:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c335e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875455681533824:12345-0@lo:400: Request processed in 17us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574054.925068:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788574054.925075:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788574054.925080:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c335e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875455681533440:12345-0@lo:400: 00000100:00100000:0.0:1788574054.925097:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c335e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875455681533440:12345-0@lo:400: Request processed in 17us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574054.925102:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1788574054.925122:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788574054.925129:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788574054.925132:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788574054.925154:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c84c2336300 x1875455681533440/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574070 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574054.925165:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2336300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875455681533440:0@lo:400: 00010000:00080000:0.0:1788574054.925174:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c85de9bdc00 x1875455681533952/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574070 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574054.925181:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85de9bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681533952:0@lo:400: 00000100:00100000:0.0:1788574054.925211:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2337b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681533312:0@lo:400: 00010000:00080000:0.0:1788574054.925221:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c85de9bca80 x1875455681533824/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574070 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574054.925229:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85de9bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1875455681533824:0@lo:400: 00010000:00080000:0.0:1788574054.925256:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c84c2335f80 x1875455681533184/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574070 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574054.925263:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2335f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875455681533184:0@lo:400: 00010000:00080000:0.0:1788574054.925271:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c85de9bc380 x1875455681533696/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574070 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574054.925278:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85de9bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3619:1875455681533696:0@lo:400: 00000100:00100000:0.0:1788574054.925285:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2335880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681533568:0@lo:400: 00010000:00080000:0.0:1788574054.925292:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c84c335f800 x1875455681534080/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574070 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574054.925300:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681534080:0@lo:400: 00000020:01000004:3.0:1788574054.925901:0:9501:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788574054.925915:0:9501:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9c84c2708000) 00000020:00000080:3.0:1788574054.925936:0:9501:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:3.0:1788574054.926012:0:9501:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c85f7fb1000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788574054.926015:0:9501:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c85f7fb1000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788574054.926018:0:9501:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c85f7fb1000 3 00010000:00080000:3.0:1788574054.926052:0:9501:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c84c3283800@lustre-MDT0001-lwp-OST0001: add connection 192.168.204.151@tcp at head 00000100:00100000:0.0:1788574054.927739:0:9502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335f800 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9502:1875455681534208:0@lo:901: 00000100:00100000:0.0:1788574054.927812:0:9502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574054.927875:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681534208 00000100:00100000:0.0:1788574054.927881:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681534208 00000100:00100000:0.0:1788574054.927938:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788574054.927947:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c335df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9502:x1875455681534208:12345-0@lo:901: 00000100:00100000:0.0:1788574054.928047:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c335df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9502:x1875455681534208:12345-0@lo:901: Request processed in 101us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574054.928055:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1788574054.928076:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788574054.928090:0:9502:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8601983b40 going to sleep for 11 seconds 00010000:00080000:0.0:1788574054.928112:0:9502:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c84c335f800 x1875455681534208/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788574070 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574054.928124:0:9502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335f800 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9502:1875455681534208:0@lo:901: 00010000:00010000:3.0:1788574054.931227:0:9501:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:3.0:1788574054.932545:0:9501:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:3.0:1788574054.932592:0:9501:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788574054.932606:0:9501:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x5bf8706fdac8be0a 00000100:00080000:3.0:1788574054.932617:0:9501:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788574054.932623:0:9501:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9c84c3283800 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:3.0:1788574054.932657:0:9501:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c84c3008a80 x1875455681534336/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788574054.932677:0:9501:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000040:00080000:3.0:1788574054.933088:0:9501:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:3.0:1788574054.933143:0:9485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:3.0:1788574054.933170:0:9485:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788574054.933186:0:9485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85c152e600/0x5bf8706fdac8bde0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bde7 expref: -99 pid: 9485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574054.933215:0:9485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c85c152e600/0x5bf8706fdac8bde0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bde7 expref: -99 pid: 9485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788574054.933265:0:9485:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788574054.933267:0:9485:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788574054.933269:0:9485:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788574054.933270:0:9485:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788574054.933271:0:9485:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788574054.933272:0:9485:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788574054.933274:0:9485:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788574054.933276:0:9485:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788574054.933277:0:9485:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788574054.933279:0:9485:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788574054.933280:0:9485:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788574054.933283:0:9485:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1788574054.933286:0:9485:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788574054.933287:0:9485:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788574054.933288:0:9485:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788574054.933289:0:9485:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788574054.933290:0:9485:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788574054.933291:0:9485:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788574054.933292:0:9485:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788574054.933293:0:9485:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788574054.933294:0:9485:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788574054.933295:0:9485:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788574054.933296:0:9485:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788574054.933311:0:9485:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788574054.933326:0:9485:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3008000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:9485:1875455681534464:0@lo:253: 00000100:00100000:3.0:1788574054.933479:0:9485:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574054.933521:0:9485:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85d10820c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788574054.934803:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3008a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3616:1875455681534336:0@lo:38: 00000100:00100000:0.0:1788574054.934878:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574054.934967:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681534464 00000100:00100000:0.0:1788574054.934974:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681534464 00000100:00100000:0.0:1788574054.935026:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788574054.935035:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5677450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+17:9485:x1875455681534464:12345-0@lo:253: 20000000:01000000:0.0:1788574054.935065:0:6486:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788574054.935079:0:6486:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1788574054.935227:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681534336 00000100:00100000:0.0:1788574054.935231:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681534336 00000100:00100000:0.0:1788574054.935254:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788574054.935259:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c335f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3616:x1875455681534336:12345-0@lo:38: 00010000:00080000:0.0:1788574054.935280:0:6493:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 194 last 0 00000020:00000080:0.0:1788574054.935314:0:6493:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x5bf8706fdac8be11 00000004:00100000:0.0:1788574054.935337:0:6493:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788574054.937554:0:6493:0:(import.c:65:import_set_state_nolock()) ffff9c84c3020800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788574054.937664:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c335f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875455681534336:12345-0@lo:38: Request processed in 2400us (2781us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574054.937675:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788574054.937936:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c84c3008a80 x1875455681534336/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788574064 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574054.937949:0:3616:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788574054.937958:0:3616:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1788574054.937967:0:3616:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788574054.937973:0:3616:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788574054.937975:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c84c3283800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788574054.937982:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3008a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3616:1875455681534336:0@lo:38: 20000000:01000000:0.0:1788574054.942493:0:6486:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788574054.942515:0:6486:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1788574054.942565:0:6508:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788574054.942570:0:6508:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788574054.942592:0:6508:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c85fa32e400/0x5bf8706fdac8be18 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574054.942612:0:6508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c85d20d6e00/0x5bf8706fdac8bd0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8bd07 expref: 17 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574054.942619:0:6508:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c860217fa00/0x5bf8706fdac8bd54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8bd4d expref: 17 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574054.942626:0:6508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c85fa32e400/0x5bf8706fdac8be18 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574054.942665:0:6508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c860217fa00/0x5bf8706fdac8bd54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5bf8706fdac8bd4d expref: 17 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574054.942680:0:6508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c860217fa00/0x5bf8706fdac8bd54 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5bf8706fdac8bd4d expref: 17 pid: 6486 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574054.942693:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be1180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6508:1875455681534592:0@lo:104: 00000100:00100000:2.0:1788574054.942758:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788574054.942816:0:6508:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c85d20d6e00/0x5bf8706fdac8bd0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5bf8706fdac8bd07 expref: 17 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574054.942825:0:6508:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c85d20d6e00/0x5bf8706fdac8bd0e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5bf8706fdac8bd07 expref: 17 pid: 6487 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574054.942833:0:6508:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be3b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6508:1875455681534720:0@lo:104: 00000100:00100000:2.0:1788574054.942875:0:6508:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574054.942941:0:6508:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c860198e300 going to sleep for 11 seconds 00000100:00100000:0.0:1788574054.943124:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681534592 00000100:00100000:0.0:1788574054.943132:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681534592 00000100:00100000:0.0:1788574054.943167:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681534720 00000100:00100000:0.0:1788574054.943170:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681534720 00000100:00100000:0.0:1788574054.943182:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788574054.943265:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:69505170-06bc-41d1-9626-ab1a3c7f32a0+4:6508:x1875455681534592:12345-0@lo:104: 00010000:00010000:0.0:1788574054.943278:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff9c860217ee00/0x5bf8706fdac8bd4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8bd54 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574054.943337:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788574054.943354:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:69505170-06bc-41d1-9626-ab1a3c7f32a0+4:6508:x1875455681534592:12345-0@lo:104: Request processed in 154us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574054.943367:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788574054.943384:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788574054.943390:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:69505170-06bc-41d1-9626-ab1a3c7f32a0+3:6508:x1875455681534720:12345-0@lo:104: 00010000:00010000:0.0:1788574054.943397:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7800/0x5bf8706fdac8bd07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8bd0e expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574054.943427:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788574054.943432:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:69505170-06bc-41d1-9626-ab1a3c7f32a0+3:6508:x1875455681534720:12345-0@lo:104: Request processed in 43us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574054.943438:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:0.0:1788574054.943462:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788574054.943467:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c860217ee00/0x5bf8706fdac8bd4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8bd54 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574054.943474:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c860217ee00 already unused, calling callback (ffffffffc1472c20) 10000000:00010000:0.0:1788574054.943478:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c860217ee00/0x5bf8706fdac8bd4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5bf8706fdac8bd54 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574054.943485:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c860217ee00/0x5bf8706fdac8bd4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5bf8706fdac8bd54 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788574054.943492:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c860217ee00/0x5bf8706fdac8bd4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5bf8706fdac8bd54 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788574054.943497:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788574054.943523:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9c860217ee00/0x5bf8706fdac8bd4d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bd54 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574054.943529:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788574054.943546:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c860217ee00/0x5bf8706fdac8bd4d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bd54 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574054.943553:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c860217ee00/0x5bf8706fdac8bd4d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bd54 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574054.943563:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788574054.943566:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7800/0x5bf8706fdac8bd07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8bd0e expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574054.943571:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d7800 already unused, calling callback (ffffffffc1472c20) 10000000:00010000:0.0:1788574054.943573:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7800/0x5bf8706fdac8bd07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5bf8706fdac8bd0e expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574054.943585:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7800/0x5bf8706fdac8bd07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5bf8706fdac8bd0e expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788574054.943591:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7800/0x5bf8706fdac8bd07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5bf8706fdac8bd0e expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788574054.943595:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788574054.943607:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7800/0x5bf8706fdac8bd07 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bd0e expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574054.943613:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788574054.943624:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7800/0x5bf8706fdac8bd07 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bd0e expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574054.943630:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7800/0x5bf8706fdac8bd07 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bd0e expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574054.943642:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574054.943643:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574054.943645:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574054.943650:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574054.943665:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:69505170-06bc-41d1-9626-ab1a3c7f32a0:3620:1875455681534848:0@lo:103: 00000100:00100000:0.0:1788574054.943692:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574054.943739:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:69505170-06bc-41d1-9626-ab1a3c7f32a0:3617:1875455681534976:0@lo:103: 00000100:00100000:0.0:1788574054.943764:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574054.943799:0:7433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681534848 00000100:00100000:0.0:1788574054.943804:0:7433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681534848 00010000:00010000:0.0:1788574054.943821:0:7433:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c860217fa00/0x5bf8706fdac8bd54 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8bd4d expref: 18 pid: 6486 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574054.943871:0:7433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681534976 00000100:00100000:0.0:1788574054.943874:0:7433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681534976 00000100:00100000:2.0:1788574054.943884:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00010000:00010000:0.0:1788574054.943886:0:7433:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c85d20d6e00/0x5bf8706fdac8bd0e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8bd07 expref: 19 pid: 6487 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574054.943892:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c335d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69505170-06bc-41d1-9626-ab1a3c7f32a0+19:3620:x1875455681534848:12345-0@lo:103: 00010000:00010000:2.0:1788574054.943903:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1788574054.943903:0:7433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00010000:00010000:2.0:1788574054.943908:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c860217fa00/0x5bf8706fdac8bd54 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8bd4d expref: 19 pid: 6486 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574054.943908:0:7433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c335d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:69505170-06bc-41d1-9626-ab1a3c7f32a0+19:3617:x1875455681534976:12345-0@lo:103: 00010000:00010000:0.0:1788574054.943914:0:7433:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574054.943917:0:7433:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c85d20d6e00/0x5bf8706fdac8bd0e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8bd07 expref: 19 pid: 6487 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574054.943919:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c860217fa00/0x5bf8706fdac8bd54 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5bf8706fdac8bd4d expref: 19 pid: 6486 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574054.944081:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5677450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+19:9485:x1875455681534464:12345-0@lo:253: Request processed in 9046us (10601us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574054.944090:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788574054.944295:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be1180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6508:1875455681534592:0@lo:104: 00000100:00100000:1.0:1788574054.944306:0:6508:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be3b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6508:1875455681534720:0@lo:104: 00010000:00010000:0.0:1788574054.944463:0:7433:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c85d20d6e00/0x5bf8706fdac8bd0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5bf8706fdac8bd07 expref: 18 pid: 6487 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574054.944478:0:7433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85d20d6e00/0x5bf8706fdac8bd0e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5bf8706fdac8bd07 expref: 18 pid: 6487 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574054.944492:0:7433:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574054.944527:0:7433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c335d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:69505170-06bc-41d1-9626-ab1a3c7f32a0+17:3617:x1875455681534976:12345-0@lo:103: Request processed in 618us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574054.944533:0:7433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788574054.944578:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:69505170-06bc-41d1-9626-ab1a3c7f32a0:3617:1875455681534976:0@lo:103: 00000100:00100000:3.0:1788574054.944733:0:9485:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3008000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69505170-06bc-41d1-9626-ab1a3c7f32a0:9485:1875455681534464:0@lo:253: 10000000:01000000:3.0:1788574054.944744:0:9485:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788574054.944747:0:9485:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788574054.944749:0:9485:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788574054.944750:0:9485:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788574054.944751:0:9485:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788574054.944752:0:9485:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788574054.944753:0:9485:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788574054.944754:0:9485:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788574054.944756:0:9485:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788574054.944757:0:9485:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788574054.944759:0:9485:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788574054.944760:0:9485:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788574054.944769:0:9485:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1788574054.945496:0:6508:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c85fa32e400/0x5bf8706fdac8be18 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574054.945568:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c860217fa00/0x5bf8706fdac8bd54 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5bf8706fdac8bd4d expref: 16 pid: 6486 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574054.945585:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c85fa32e400/0x5bf8706fdac8be18 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574054.945593:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85fa32e400/0x5bf8706fdac8be18 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788574054.945608:0:6479:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.013002044s 00010000:00010000:2.0:1788574054.945614:0:6479:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c85fa32e400/0x5bf8706fdac8be18 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574054.945621:0:6479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c85fa32e400/0x5bf8706fdac8be18 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574054.945629:0:6479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c85fa32e400/0x5bf8706fdac8be18 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574054.945635:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c85fa32e400/0x5bf8706fdac8be18 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574054.945647:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32e400 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:2.0:1788574054.945651:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c85fa32e400/0x5bf8706fdac8be18 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574054.945659:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c85fa32e400/0x5bf8706fdac8be18 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574054.945668:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c85fa32e400/0x5bf8706fdac8be18 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574054.945676:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788574054.945729:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c335d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69505170-06bc-41d1-9626-ab1a3c7f32a0+15:3620:x1875455681534848:12345-0@lo:103: Request processed in 1838us (2035us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574054.945737:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:0.0:1788574054.945820:0:6508:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c85fa32e400/0x5bf8706fdac8be18 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574054.945829:0:6508:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c85fa32e400/0x5bf8706fdac8be18 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574054.945844:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85fa32e400/0x5bf8706fdac8be18 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6508 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574054.945912:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:69505170-06bc-41d1-9626-ab1a3c7f32a0:3620:1875455681534848:0@lo:103: 00080000:10000000:3.0:1788574054.951691:0:9485:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:3.0:1788574054.951853:0:9485:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1788574054.952059:0:9485:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1788574054.952264:0:9485:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1788574054.952620:0:9485:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1788574054.952872:0:9485:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:3.0:1788574054.955234:0:9485:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1788574054.963886:0:9485:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1788574054.963897:0:9485:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1788574054.963940:0:9485:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788574054.963990:0:9485:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.151@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788574054.964009:0:9485:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=50 00000080:00000004:3.0:1788574054.964031:0:9485:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:3.0:1788574054.964957:0:9485:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788574054.965144:0:9485:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=41009432 00000100:00100000:3.0:1788574055.065814:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3008000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681535104:0@lo:41: 00000100:00100000:3.0:1788574055.065905:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574055.065990:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681535104 00000100:00100000:3.0:1788574055.065998:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681535104 00000100:00100000:3.0:1788574055.066042:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788574055.066051:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3009c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681535104:12345-0@lo:41: 00000004:00000024:3.0:1788574055.066094:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:3.0:1788574055.066143:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3009c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681535104:12345-0@lo:41: Request processed in 92us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574055.066150:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788574055.066217:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3008000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681535104:0@lo:41: 00010000:00010000:2.0:1788574055.071361:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788574055.879644:0:9558:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788574055.880494:0:9558:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788574056.084516:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574056.595556:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788574056.595582:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3008000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681535232:0@lo:13: 00000100:00100000:2.0:1788574056.595705:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574056.595908:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85e56c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681535360:0@lo:41: 00000100:00100000:2.0:1788574056.595937:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574056.596068:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681535360 00000100:00100000:1.0:1788574056.596076:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681535360 00000100:00100000:1.0:1788574056.596127:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788574056.596136:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681535360:12345-0@lo:41: 00000004:00000024:1.0:1788574056.596167:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1788574056.596253:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681535360:12345-0@lo:41: Request processed in 117us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574056.596260:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788574056.596306:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85e56c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681535360:0@lo:41: 00000100:00100000:3.0:1788574056.596498:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681535232 00000100:00100000:3.0:1788574056.596503:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681535232 00000100:00100000:3.0:1788574056.596549:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788574056.596556:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681535232:12345-0@lo:13: 00002000:00000024:3.0:1788574056.596575:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788574056.596613:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681535232:12345-0@lo:13: Request processed in 58us (909us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574056.596619:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788574056.596650:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3008000 x1875455681535232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574072 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574056.596664:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3008000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681535232:0@lo:13: 00000100:00080000:1.0:1788574056.596946:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788574056.597109:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788574056.597121:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681535488:0@lo:13: 00000100:00100000:0.0:1788574056.597156:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574056.597521:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681535488 00000100:00100000:1.0:1788574056.597528:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681535488 00000100:00100000:1.0:1788574056.597572:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788574056.597579:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c335f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681535488:12345-0@lo:13: 00002000:00000024:1.0:1788574056.597593:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788574056.597630:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c335f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681535488:12345-0@lo:13: Request processed in 51us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574056.597637:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1788574056.597734:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c1be3b80 x1875455681535488/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574072 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574056.597749:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681535488:0@lo:13: 00000100:00080000:2.0:1788574056.597802:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788574057.107892:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574058.135153:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574059.155484:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574060.179809:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574060.181622:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875455681535744:0@lo:400: 00000100:00100000:1.0:1788574060.181702:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574060.181848:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85de9bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3619:1875455681536256:0@lo:400: 00000100:00100000:1.0:1788574060.182156:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574060.182230:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2335f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1875455681536768:0@lo:400: 00000100:00100000:1.0:1788574060.182577:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574060.182613:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788574060.182623:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681535872:0@lo:400: 00000100:00100000:1.0:1788574060.182651:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574060.182676:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85de9bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1875455681536384:0@lo:400: 00000100:00100000:1.0:1788574060.182698:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574060.182716:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2337b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1875455681536896:0@lo:400: 00000100:00100000:1.0:1788574060.182737:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574060.182775:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875455681536000:0@lo:400: 00000100:00100000:1.0:1788574060.182806:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574060.182821:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85de9bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681536512:0@lo:400: 00000100:00100000:1.0:1788574060.182861:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574060.182899:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3008000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681537024:0@lo:41: 00000100:00100000:1.0:1788574060.182920:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574060.182940:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788574060.182946:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:69505170-06bc-41d1-9626-ab1a3c7f32a0:3617:1875455681535616:0@lo:400: 00000100:00100000:1.0:1788574060.182973:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574060.182996:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681536128:0@lo:400: 00000100:00100000:1.0:1788574060.183017:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574060.183035:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2335880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681536640:0@lo:400: 00000100:00100000:1.0:1788574060.183055:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574060.183101:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681535744 00000100:00100000:1.0:1788574060.183108:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681535744 00000100:00100000:1.0:1788574060.183145:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681536256 00000100:00100000:1.0:1788574060.183148:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681536256 00000100:00100000:1.0:1788574060.183169:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681536768 00000100:00100000:1.0:1788574060.183177:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681536768 00000100:00100000:1.0:1788574060.183221:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681536384 00000100:00100000:1.0:1788574060.183224:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681536384 00000100:00100000:1.0:1788574060.183239:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681536896 00000100:00100000:1.0:1788574060.183241:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681536896 00000100:00100000:3.0:1788574060.183317:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681535872 00000100:00100000:3.0:1788574060.183323:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681535872 00000100:00100000:3.0:1788574060.183701:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681537024 00000100:00100000:3.0:1788574060.183706:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681537024 00000100:00100000:3.0:1788574060.183717:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681536128 00000100:00100000:3.0:1788574060.183720:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681536128 00000100:00100000:3.0:1788574060.183733:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788574060.183743:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e56c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3619:x1875455681535872:12345-0@lo:400: 00000100:00100000:3.0:1788574060.183832:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e56c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3619:x1875455681535872:12345-0@lo:400: Request processed in 89us (1179us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574060.183854:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788574060.183873:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788574060.183879:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3658e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681537024:12345-0@lo:41: 00000004:00000024:3.0:1788574060.183904:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:3.0:1788574060.183943:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3658e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681537024:12345-0@lo:41: Request processed in 64us (1021us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574060.183949:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788574060.183961:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788574060.183967:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c365a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681536128:12345-0@lo:400: 00000100:00100000:3.0:1788574060.183994:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c365a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681536128:12345-0@lo:400: Request processed in 27us (976us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574060.183999:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788574060.184017:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681535616 00000100:00100000:3.0:1788574060.184021:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681535616 00000100:00100000:3.0:1788574060.184044:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788574060.184050:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5674850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+15:3617:x1875455681535616:12345-0@lo:400: 00000100:00100000:3.0:1788574060.184078:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5674850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+15:3617:x1875455681535616:12345-0@lo:400: Request processed in 29us (1104us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574060.184084:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788574060.184115:0:8815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681536512 00000100:00100000:3.0:1788574060.184119:0:8815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681536512 00000100:00100000:3.0:1788574060.184142:0:8815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681536640 00000100:00100000:3.0:1788574060.184145:0:8815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681536640 00000100:00100000:3.0:1788574060.184162:0:8815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788574060.184167:0:8815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3658700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681536512:12345-0@lo:400: 00000100:00100000:3.0:1788574060.184220:0:8815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3658700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681536512:12345-0@lo:400: Request processed in 52us (1358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574060.184233:0:8815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788574060.184244:0:8815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788574060.184250:0:8815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c365a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681536640:12345-0@lo:400: 00000100:00100000:3.0:1788574060.184279:0:8815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c365a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681536640:12345-0@lo:400: Request processed in 29us (1222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574060.184284:0:8815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788574060.184301:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681536000 00000100:00100000:3.0:1788574060.184305:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681536000 00000100:00100000:3.0:1788574060.184333:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788574060.184602:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681535872:0@lo:400: 00000100:00100000:3.0:1788574060.186519:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e56c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875455681535744:12345-0@lo:400: 00000100:00100000:3.0:1788574060.186622:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e56c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875455681535744:12345-0@lo:400: Request processed in 117us (4920us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574060.187098:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788574060.187112:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e56c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875455681536256:12345-0@lo:400: 00000100:00100000:1.0:1788574060.187155:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e56c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875455681536256:12345-0@lo:400: Request processed in 49us (4999us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574060.187161:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788574060.187205:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788574060.187212:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e56c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875455681536768:12345-0@lo:400: 00000100:00100000:1.0:1788574060.187241:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e56c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875455681536768:12345-0@lo:400: Request processed in 30us (4666us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574060.187436:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788574060.187452:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788574060.187460:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e56c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875455681536384:12345-0@lo:400: 00000100:00100000:1.0:1788574060.187509:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e56c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875455681536384:12345-0@lo:400: Request processed in 50us (4810us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574060.187514:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788574060.187526:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788574060.187534:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e56c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875455681536000:12345-0@lo:400: 00000100:00100000:1.0:1788574060.187585:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e56c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875455681536000:12345-0@lo:400: Request processed in 52us (4777us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574060.187593:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788574060.187609:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788574060.187616:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e56c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875455681536896:12345-0@lo:400: 00000100:00100000:1.0:1788574060.187652:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e56c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875455681536896:12345-0@lo:400: Request processed in 38us (4914us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574060.187658:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:1.0:1788574060.187687:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788574060.187693:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788574060.187696:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788574060.187772:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:69505170-06bc-41d1-9626-ab1a3c7f32a0:3617:1875455681535616:0@lo:400: 00000100:00100000:1.0:1788574060.187791:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681536128:0@lo:400: 00010000:00080000:1.0:1788574060.187806:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c2335880 x1875455681536640/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574076 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574060.187816:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2335880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681536640:0@lo:400: 00010000:00080000:1.0:1788574060.187828:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c335c380 x1875455681536000/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574076 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574060.187836:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875455681536000:0@lo:400: 00010000:00080000:1.0:1788574060.187847:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85de9bdc00 x1875455681536512/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574076 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574060.187855:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85de9bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681536512:0@lo:400: 00000100:00100000:1.0:1788574060.187874:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3008000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681537024:0@lo:41: 00010000:00080000:2.0:1788574060.189180:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85de9bca80 x1875455681536384/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574076 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574060.189229:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85de9bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1875455681536384:0@lo:400: 00010000:00080000:2.0:1788574060.189249:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c2337b80 x1875455681536896/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574076 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574060.189257:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2337b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1875455681536896:0@lo:400: 00010000:00080000:2.0:1788574060.189269:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c335ea00 x1875455681535744/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574076 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574060.189277:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875455681535744:0@lo:400: 00010000:00080000:2.0:1788574060.189292:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85de9bc380 x1875455681536256/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574076 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574060.189299:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85de9bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3619:1875455681536256:0@lo:400: 00010000:00080000:2.0:1788574060.189330:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c2335f80 x1875455681536768/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574076 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574060.189347:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2335f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1875455681536768:0@lo:400: 00000100:00100000:3.0:1788574060.189553:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:3.0:1788574061.203525:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788574061.375766:0:9848:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg451-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1788574061.715490:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788574061.715514:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681537152:0@lo:13: 00000100:00100000:2.0:1788574061.715598:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574061.715675:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681537152 00000100:00100000:2.0:1788574061.715683:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681537152 00000100:00100000:2.0:1788574061.715740:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788574061.715750:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681537152:12345-0@lo:13: 00002000:00000024:2.0:1788574061.715780:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788574061.715961:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681537152:12345-0@lo:13: Request processed in 211us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574061.715982:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1788574061.716028:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c1be1180 x1875455681537152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574077 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574061.716046:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681537152:0@lo:13: 00000100:00100000:2.0:1788574061.716674:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681537280:0@lo:13: 00000100:00100000:2.0:1788574061.716716:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574061.717173:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681537280 00000100:00100000:2.0:1788574061.717180:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681537280 00000100:00100000:2.0:1788574061.717250:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788574061.717258:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681537280:12345-0@lo:13: 00002000:00000024:2.0:1788574061.717276:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788574061.719881:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681537280:12345-0@lo:13: Request processed in 2610us (3151us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574061.719895:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788574061.721891:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c365ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681537408:0@lo:41: 00000100:00100000:2.0:1788574061.721986:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574061.722122:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681537408 00000100:00100000:2.0:1788574061.722130:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681537408 00000100:00100000:2.0:1788574061.722182:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788574061.722214:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c335ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681537408:12345-0@lo:41: 00000004:00000024:2.0:1788574061.722249:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1788574061.722300:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c335ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681537408:12345-0@lo:41: Request processed in 110us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574061.722307:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788574061.722352:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c365ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681537408:0@lo:41: 00010000:00080000:3.0:1788574061.722481:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c1be1180 x1875455681537280/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574077 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574061.722500:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681537280:0@lo:13: 00010000:00010000:0.0:1788574062.240509:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788574062.240565:0:6490:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788574062.240570:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c85fad3f000 from 39 10000000:01000000:2.0:1788574062.240576:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788574062.240623:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85fa32f400/0x5bf8706fdac8be1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574062.240633:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c85fa32f400/0x5bf8706fdac8be1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574062.240645:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c85fa32f400/0x5bf8706fdac8be1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574062.240668:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681537536:0@lo:101: 00000100:00100000:3.0:1788574062.240905:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574062.240967:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8600c3a180 going to sleep for 11 seconds 00000100:00100000:2.0:1788574062.241073:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681537536 00000100:00100000:2.0:1788574062.241080:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681537536 00000100:00100000:2.0:1788574062.241135:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788574062.241144:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5676c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+15:6490:x1875455681537536:12345-0@lo:101: 00010000:00010000:2.0:1788574062.241157:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574062.241170:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85fa32e600/0x5bf8706fdac8be26 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8be1f expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574062.241667:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85fa32e600/0x5bf8706fdac8be26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8be1f expref: 16 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574062.241680:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85fa32e600/0x5bf8706fdac8be26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8be1f expref: 16 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574062.241689:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85fa32e600, rc 0) 00000100:00100000:2.0:1788574062.241761:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5676c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+16:6490:x1875455681537536:12345-0@lo:101: Request processed in 617us (855us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574062.241782:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788574062.243008:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681537536:0@lo:101: 00010000:00010000:0.0:1788574062.243043:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c85fa32f400/0x5bf8706fdac8be1f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8be26 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574062.243056:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c85fa32f400/0x5bf8706fdac8be1f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8be26 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574062.243135:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2336300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681537664:0@lo:501: 00000100:00100000:0.0:1788574062.243182:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574062.243245:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c235d6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788574062.243943:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681537664 00000100:00100000:2.0:1788574062.243954:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681537664 00000100:00100000:2.0:1788574062.244003:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788574062.244011:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5674c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+16:6490:x1875455681537664:12345-0@lo:501: 00000100:00100000:2.0:1788574062.244176:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5674c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+16:6490:x1875455681537664:12345-0@lo:501: Request processed in 164us (992us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574062.244184:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788574062.244753:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2336300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681537664:0@lo:501: 00000100:00100000:0.0:1788574062.246151:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2336300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681537792:0@lo:503: 00000100:00100000:0.0:1788574062.246266:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574062.246307:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c235d6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788574062.246710:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681537792 00000100:00100000:2.0:1788574062.246728:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681537792 00000100:00100000:2.0:1788574062.246785:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788574062.246795:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5677c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+16:6490:x1875455681537792:12345-0@lo:503: 00000100:00100000:2.0:1788574062.247007:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5677c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+16:6490:x1875455681537792:12345-0@lo:503: Request processed in 213us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574062.247016:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788574062.247327:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2336300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681537792:0@lo:503: 00000100:00100000:0.0:1788574062.247551:0:9883:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2336300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:9883:1875455681537920:0@lo:502: 00000100:00100000:0.0:1788574062.247595:0:9883:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574062.247639:0:9883:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c235d840 going to sleep for 11 seconds 00000100:00100000:2.0:1788574062.247940:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681537920 00000100:00100000:2.0:1788574062.247946:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681537920 00000100:00100000:2.0:1788574062.247980:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788574062.247988:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5672050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+16:9883:x1875455681537920:12345-0@lo:502: 00000100:00100000:2.0:1788574062.249009:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5672050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+16:9883:x1875455681537920:12345-0@lo:502: Request processed in 1017us (1409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574062.249019:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788574062.249165:0:9883:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2336300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:9883:1875455681537920:0@lo:502: 00000100:00100000:0.0:1788574062.249243:0:9883:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2336300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:9883:1875455681538048:0@lo:502: 00000100:00100000:0.0:1788574062.249291:0:9883:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574062.249320:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681538048 00000100:00100000:0.0:1788574062.249326:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681538048 00000100:00100000:0.0:1788574062.249355:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788574062.249362:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5673850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+17:9883:x1875455681538048:12345-0@lo:502: 00000100:00100000:0.0:1788574062.249439:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5673850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+17:9883:x1875455681538048:12345-0@lo:502: Request processed in 77us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574062.249445:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788574062.249492:0:9883:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c235d840 going to sleep for 11 seconds 00000100:00100000:0.0:1788574062.249505:0:9883:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2336300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:9883:1875455681538048:0@lo:502: 00000040:00080000:0.0:1788574062.249522:0:9883:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1788574062.249589:0:6490:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1788574062.249611:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788574062.249620:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85fa32f400/0x5bf8706fdac8be1f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8be26 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574062.249640:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c85fa32f400/0x5bf8706fdac8be1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8be26 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788574062.249650:0:6490:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1788574062.249653:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1788574062.249655:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788574062.249680:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7200/0x5bf8706fdac8be2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574062.249688:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7200/0x5bf8706fdac8be2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574062.249696:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7200/0x5bf8706fdac8be2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574062.249707:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2336300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681538176:0@lo:101: 00000100:00100000:0.0:1788574062.249747:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574062.249761:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c235d840 going to sleep for 11 seconds 00000100:00100000:0.0:1788574062.249772:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681538176 00000100:00100000:0.0:1788574062.249775:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681538176 00000100:00100000:0.0:1788574062.249791:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788574062.249797:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5671050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+17:6490:x1875455681538176:12345-0@lo:101: 00010000:00010000:0.0:1788574062.249804:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574062.253682:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85d20d7e00/0x5bf8706fdac8be34 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8be2d expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574062.254145:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85d20d7e00/0x5bf8706fdac8be34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8be2d expref: 17 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574062.254162:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85d20d7e00/0x5bf8706fdac8be34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8be2d expref: 17 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574062.254171:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d20d7e00, rc 0) 00000100:00100000:3.0:1788574062.254413:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5671050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+17:6490:x1875455681538176:12345-0@lo:101: Request processed in 4614us (4664us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574062.254427:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788574062.255966:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2336300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681538176:0@lo:101: 00010000:00010000:1.0:1788574062.255993:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7200/0x5bf8706fdac8be2d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8be34 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574062.256005:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7200/0x5bf8706fdac8be2d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8be34 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574062.256095:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3659f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681538304:0@lo:501: 00000100:00100000:1.0:1788574062.256149:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574062.256211:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c5a410c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788574062.256234:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681538304 00000100:00100000:1.0:1788574062.256240:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681538304 00000100:00100000:1.0:1788574062.256283:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788574062.256293:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5671c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+17:6490:x1875455681538304:12345-0@lo:501: 00000100:00100000:1.0:1788574062.256417:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5671c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+17:6490:x1875455681538304:12345-0@lo:501: Request processed in 127us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574062.256424:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788574062.256461:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3659f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681538304:0@lo:501: 00000100:00100000:1.0:1788574062.256488:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3659f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681538432:0@lo:503: 00000100:00100000:1.0:1788574062.256527:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574062.256541:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c5a410c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788574062.256553:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681538432 00000100:00100000:1.0:1788574062.256557:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681538432 00000100:00100000:1.0:1788574062.256579:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788574062.256584:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5671450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+17:6490:x1875455681538432:12345-0@lo:503: 00000100:00100000:1.0:1788574062.256661:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5671450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+17:6490:x1875455681538432:12345-0@lo:503: Request processed in 76us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574062.256668:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788574062.256707:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3659f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681538432:0@lo:503: 00000100:00100000:0.0:1788574062.258457:0:9886:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2336300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:9886:1875455681538560:0@lo:502: 00000100:00100000:0.0:1788574062.258530:0:9886:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574062.258581:0:9886:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c235dd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788574062.258905:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681538560 00000100:00100000:1.0:1788574062.258913:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681538560 00000100:00100000:1.0:1788574062.258969:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788574062.258977:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5672850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+17:9886:x1875455681538560:12345-0@lo:502: 00000100:00100000:1.0:1788574062.259111:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5672850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+17:9886:x1875455681538560:12345-0@lo:502: Request processed in 134us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574062.259118:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788574062.259317:0:9886:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2336300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:9886:1875455681538560:0@lo:502: 00000020:01000000:0.0:1788574062.259350:0:9886:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788574062.259359:0:9886:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788574062.259362:0:9886:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788574062.259366:0:9886:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788574062.259368:0:9886:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788574062.259388:0:9886:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2336300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:9886:1875455681538688:0@lo:502: 00000100:00100000:0.0:1788574062.259422:0:9886:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574062.259456:0:9886:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c235dd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788574062.259662:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681538688 00000100:00100000:1.0:1788574062.259667:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681538688 00000100:00100000:1.0:1788574062.259701:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788574062.259709:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5673050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+17:9886:x1875455681538688:12345-0@lo:502: 00000100:00100000:1.0:1788574062.259799:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5673050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+17:9886:x1875455681538688:12345-0@lo:502: Request processed in 90us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574062.259806:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788574062.259923:0:9886:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2336300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:9886:1875455681538688:0@lo:502: 00000020:01000000:0.0:1788574062.259943:0:9886:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788574062.259948:0:9886:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788574062.259950:0:9886:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788574062.259954:0:9886:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:1.0:1788574062.260640:0:6490:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1788574062.260667:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788574062.260677:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7200/0x5bf8706fdac8be2d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8be34 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574062.260689:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7200/0x5bf8706fdac8be2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8be34 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788574062.260698:0:6490:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788574062.260701:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c85fa390800 from 39 10000000:01000000:1.0:1788574062.260704:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788574062.260745:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85faea3600/0x5bf8706fdac8be3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574062.260754:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c85faea3600/0x5bf8706fdac8be3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574062.260777:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c85faea3600/0x5bf8706fdac8be3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574062.260795:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3659f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681538816:0@lo:101: 00000100:00100000:1.0:1788574062.260915:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574062.260988:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c6a78900 going to sleep for 11 seconds 00000100:00100000:0.0:1788574062.268477:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681538816 00000100:00100000:0.0:1788574062.268492:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681538816 00000100:00100000:0.0:1788574062.268549:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788574062.268560:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5671850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+17:6490:x1875455681538816:12345-0@lo:101: 00010000:00010000:0.0:1788574062.268578:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574062.268595:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85d20d7400/0x5bf8706fdac8be42 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8be3b expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574062.268622:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85d20d7400/0x5bf8706fdac8be42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8be3b expref: 18 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574062.268635:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85d20d7400/0x5bf8706fdac8be42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8be3b expref: 18 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574062.268644:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d20d7400, rc 0) 00000100:00100000:0.0:1788574062.268747:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5671850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+18:6490:x1875455681538816:12345-0@lo:101: Request processed in 189us (7831us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574062.268755:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788574062.268889:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3659f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681538816:0@lo:101: 00010000:00010000:0.0:1788574062.268909:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c85faea3600/0x5bf8706fdac8be3b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8be42 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574062.268920:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c85faea3600/0x5bf8706fdac8be3b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8be42 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574062.269001:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2336300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681538944:0@lo:501: 00000100:00100000:0.0:1788574062.269100:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574062.269134:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c235d600 going to sleep for 11 seconds 00000100:00100000:0.0:1788574062.269150:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681538944 00000100:00100000:0.0:1788574062.269154:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681538944 00000100:00100000:0.0:1788574062.269177:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788574062.269183:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5673450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+18:6490:x1875455681538944:12345-0@lo:501: 00000100:00100000:0.0:1788574062.269327:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5673450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+18:6490:x1875455681538944:12345-0@lo:501: Request processed in 143us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574062.269334:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788574062.269364:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2336300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681538944:0@lo:501: 00000100:00100000:0.0:1788574062.269390:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2336300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681539072:0@lo:503: 00000100:00100000:0.0:1788574062.269431:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574062.269444:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c235d600 going to sleep for 11 seconds 00000100:00100000:0.0:1788574062.269454:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681539072 00000100:00100000:0.0:1788574062.269458:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681539072 00000100:00100000:0.0:1788574062.269475:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788574062.269488:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5670850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+18:6490:x1875455681539072:12345-0@lo:503: 00000100:00100000:0.0:1788574062.269560:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5670850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+18:6490:x1875455681539072:12345-0@lo:503: Request processed in 73us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574062.269567:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788574062.269605:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2336300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681539072:0@lo:503: 00000100:00100000:0.0:1788574062.269799:0:9887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2336300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:9887:1875455681539200:0@lo:502: 00000100:00100000:0.0:1788574062.270985:0:9887:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574062.271021:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681539200 00000100:00100000:0.0:1788574062.271926:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681539200 00000100:00100000:0.0:1788574062.271981:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788574062.271991:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5670c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+18:9887:x1875455681539200:12345-0@lo:502: 00000100:00100000:0.0:1788574062.272226:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5670c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+18:9887:x1875455681539200:12345-0@lo:502: Request processed in 235us (1243us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574062.272234:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788574062.272297:0:9887:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c235d900 going to sleep for 11 seconds 00000100:00100000:0.0:1788574062.272318:0:9887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2336300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:9887:1875455681539200:0@lo:502: 00000100:00100000:0.0:1788574062.272384:0:9887:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2336300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:9887:1875455681539328:0@lo:502: 00000100:00100000:0.0:1788574062.272423:0:9887:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574062.272446:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681539328 00000100:00100000:0.0:1788574062.272450:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681539328 00000100:00100000:0.0:1788574062.272471:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788574062.272477:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5672c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+18:9887:x1875455681539328:12345-0@lo:502: 00000100:00100000:0.0:1788574062.272539:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5672c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+18:9887:x1875455681539328:12345-0@lo:502: Request processed in 61us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574062.272546:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788574062.272583:0:9887:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c235d900 going to sleep for 11 seconds 00000100:00100000:0.0:1788574062.272595:0:9887:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2336300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:9887:1875455681539328:0@lo:502: 00000040:00080000:0.0:1788574062.272614:0:9887:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1788574062.272684:0:6490:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1788574062.272705:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788574062.272714:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85faea3600/0x5bf8706fdac8be3b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8be42 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574062.272738:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c85faea3600/0x5bf8706fdac8be3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8be42 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788574062.272748:0:6490:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788574062.272751:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c85fa390800 from 6 10000000:01000000:0.0:1788574062.272754:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788574062.272781:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6200/0x5bf8706fdac8be49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574062.272790:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6200/0x5bf8706fdac8be49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574062.272798:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6200/0x5bf8706fdac8be49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574062.272810:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2336300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681539456:0@lo:101: 00000100:00100000:0.0:1788574062.274920:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574062.275576:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c235d900 going to sleep for 11 seconds 00000100:00100000:1.0:1788574062.281927:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681539456 00000100:00100000:1.0:1788574062.281943:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681539456 00000100:00100000:3.0:1788574062.282454:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788574062.282464:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5673c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+18:6490:x1875455681539456:12345-0@lo:101: 00010000:00010000:3.0:1788574062.282481:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574062.282501:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85c152fe00/0x5bf8706fdac8be50 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8be49 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574062.282527:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85c152fe00/0x5bf8706fdac8be50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8be49 expref: 19 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574062.282538:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85c152fe00/0x5bf8706fdac8be50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8be49 expref: 19 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574062.282547:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85c152fe00, rc 0) 00000100:00100000:3.0:1788574062.282626:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5673c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+19:6490:x1875455681539456:12345-0@lo:101: Request processed in 163us (7708us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574062.282632:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788574062.284714:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2336300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681539456:0@lo:101: 00010000:00010000:0.0:1788574062.284758:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6200/0x5bf8706fdac8be49 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8be50 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574062.284792:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6200/0x5bf8706fdac8be49 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8be50 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574062.285000:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2336300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681539584:0@lo:256: 00000100:00100000:1.0:1788574062.290843:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574062.290906:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c235d900 going to sleep for 11 seconds 00000100:00100000:0.0:1788574062.292701:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681539584 00000100:00100000:0.0:1788574062.292726:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681539584 00000100:00100000:0.0:1788574062.292782:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788574062.292792:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5672450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+19:6490:x1875455681539584:12345-0@lo:256: 20000000:01000000:0.0:1788574062.292830:0:6487:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788574062.292847:0:6487:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788574062.292850:0:6487:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1788574062.292967:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5672450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+19:6490:x1875455681539584:12345-0@lo:256: Request processed in 176us (2131us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574062.292975:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788574062.293292:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2336300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681539584:0@lo:256: 10000000:01000000:0.0:1788574062.293349:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788574062.293359:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6200/0x5bf8706fdac8be49 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8be50 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574062.293370:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6200/0x5bf8706fdac8be49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8be50 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788574062.293379:0:6490:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1788574062.293382:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:0.0:1788574062.293384:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1788574062.293415:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6e00/0x5bf8706fdac8be57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574062.293434:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6e00/0x5bf8706fdac8be57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574062.293444:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6e00/0x5bf8706fdac8be57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574062.293474:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2336300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681539712:0@lo:101: 00000100:00100000:0.0:1788574062.293509:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574062.293528:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c235d900 going to sleep for 11 seconds 00000100:00100000:3.0:1788574062.302080:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681539712 00000100:00100000:3.0:1788574062.302097:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681539712 00000100:00100000:3.0:1788574062.302151:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788574062.302160:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5670450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+19:6490:x1875455681539712:12345-0@lo:101: 00010000:00010000:3.0:1788574062.302177:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574062.302428:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85c152e000/0x5bf8706fdac8be5e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8be57 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574062.302459:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85c152e000/0x5bf8706fdac8be5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8be57 expref: 20 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574062.302484:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85c152e000/0x5bf8706fdac8be5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8be57 expref: 20 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574062.302493:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85c152e000, rc 0) 00000100:00100000:3.0:1788574062.302573:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5670450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+20:6490:x1875455681539712:12345-0@lo:101: Request processed in 414us (9064us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574062.302580:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788574062.302641:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2336300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681539712:0@lo:101: 00010000:00010000:3.0:1788574062.302659:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6e00/0x5bf8706fdac8be57 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8be5e expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574062.302668:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6e00/0x5bf8706fdac8be57 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8be5e expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574062.302754:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3008700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681539840:0@lo:501: 00000100:00100000:3.0:1788574062.302789:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574062.302824:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c26bd180 going to sleep for 11 seconds 00000100:00100000:3.0:1788574062.303351:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681539840 00000100:00100000:3.0:1788574062.303360:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681539840 00000100:00100000:3.0:1788574062.303395:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788574062.303402:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5670050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+20:6490:x1875455681539840:12345-0@lo:501: 00000100:00100000:3.0:1788574062.303531:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5670050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+20:6490:x1875455681539840:12345-0@lo:501: Request processed in 129us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574062.303539:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788574062.303574:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3008700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681539840:0@lo:501: 00000100:00100000:3.0:1788574062.303609:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3008700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681539968:0@lo:503: 00000100:00100000:3.0:1788574062.303653:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574062.303675:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c26bd180 going to sleep for 11 seconds 00000100:00100000:3.0:1788574062.303687:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681539968 00000100:00100000:3.0:1788574062.303690:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681539968 00000100:00100000:3.0:1788574062.303710:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788574062.303727:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e564fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+20:6490:x1875455681539968:12345-0@lo:503: 00000100:00100000:3.0:1788574062.303808:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e564fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+20:6490:x1875455681539968:12345-0@lo:503: Request processed in 91us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574062.303814:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788574062.303827:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3008700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681539968:0@lo:503: 00000100:00100000:1.0:1788574062.317106:0:9890:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3659880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:9890:1875455681540096:0@lo:502: 00000100:00100000:1.0:1788574062.317218:0:9890:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574062.317261:0:9890:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c6a78900 going to sleep for 11 seconds 00000100:00100000:2.0:1788574062.317464:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681540096 00000100:00100000:2.0:1788574062.317473:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681540096 00000100:00100000:2.0:1788574062.317528:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788574062.317543:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e564e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+20:9890:x1875455681540096:12345-0@lo:502: 00000100:00100000:2.0:1788574062.317668:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e564e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+20:9890:x1875455681540096:12345-0@lo:502: Request processed in 127us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574062.317676:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788574062.317770:0:9890:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3659880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:9890:1875455681540096:0@lo:502: 00000020:01000000:1.0:1788574062.317803:0:9890:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788574062.317822:0:9890:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1788574062.317829:0:9890:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574062.317831:0:9890:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788574062.317841:0:9890:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788574062.317845:0:9890:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.151@tcp to nid 0x20000c0a8cc97 (192.168.204.151@tcp) 00000020:01000000:1.0:1788574062.317869:0:9890:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1788574062.317872:0:9890:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788574062.317899:0:9890:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9c84c2510000) 00000020:00000080:1.0:1788574062.317921:0:9890:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:1.0:1788574062.317928:0:9890:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788574062.318008:0:9890:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1788574062.318015:0:9890:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788574062.318149:0:9890:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5bf8706fdac8be6c 00010000:00080000:1.0:1788574062.318219:0:9890:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c85fae37000@lustre-OST0001-osc-MDT0001: add connection 192.168.204.151@tcp at head 00010000:00010000:1.0:1788574062.318443:0:9890:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:1.0:1788574062.318571:0:9890:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1788574062.318581:0:9890:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1788574062.318773:0:9890:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788574062.319159:0:9890:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788574062.319306:0:9890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1788574062.319388:0:9890:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1788574062.320348:0:9892:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788574062.320354:0:9892:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788574062.324508:0:9890:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788574062.324524:0:9890:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788574062.324575:0:9890:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788574062.324602:0:9890:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5bf8706fdac8be73 00000100:00080000:2.0:1788574062.324612:0:9890:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788574062.324618:0:9890:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9c85fae37000 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:2.0:1788574062.324654:0:9890:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c84c335d880 x1875455681540224/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788574062.324675:0:9890:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788574062.324746:0:9890:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788574062.324751:0:9890:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574062.324753:0:9890:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788574062.324756:0:9890:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788574062.324760:0:9890:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574062.324761:0:9890:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788574062.324764:0:9890:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788574062.324766:0:9890:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788574062.324794:0:9890:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:9890:1875455681540352:0@lo:502: 00000100:00100000:1.0:1788574062.324931:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1875455681540224:0@lo:8: 00000100:00100000:1.0:1788574062.324998:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574062.325079:0:8815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681540224 00000100:00100000:1.0:1788574062.325086:0:8815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681540224 00000100:00100000:1.0:1788574062.325115:0:8815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788574062.325122:0:8815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3659880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3616:x1875455681540224:12345-0@lo:8: 00010000:00080000:1.0:1788574062.325146:0:8815:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 202 last 0 00000020:00000080:1.0:1788574062.325172:0:8815:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5bf8706fdac8be7a 00002000:00100000:1.0:1788574062.325185:0:8815:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9c85fae34000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a03 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:1.0:1788574062.325207:0:8815:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:1.0:1788574062.325212:0:8815:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1788574062.325275:0:8815:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788574062.325510:0:8815:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:1.0:1788574062.325535:0:8815:0:(import.c:65:import_set_state_nolock()) ffff9c85fae30000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788574062.325587:0:8815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3659880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3616:x1875455681540224:12345-0@lo:8: Request processed in 464us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574062.325594:0:8815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1788574062.325637:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c335d880 x1875455681540224/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788574072 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574062.325648:0:3616:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788574062.325663:0:3616:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1788574062.325669:0:3616:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788574062.325674:0:3616:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788574062.325676:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c85fae37000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788574062.325686:0:3616:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788574062.325690:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1875455681540224:0@lo:8: 00000100:00100000:1.0:1788574062.325745:0:9894:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c365b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9894:1875455681540480:0@lo:700: 00000100:00100000:1.0:1788574062.325773:0:9894:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574062.325791:0:9894:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85e5770300 going to sleep for 11 seconds 00000100:00100000:2.0:1788574062.326133:0:9890:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574062.326172:0:9890:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8600c3a180 going to sleep for 11 seconds 00000004:00080000:2.0:1788574062.326212:0:9892:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788574062.326267:0:9892:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 202306076933ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788574062.326273:0:9892:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1788574062.326798:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3659180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875455681540608:0@lo:400: 00000100:00100000:1.0:1788574062.327150:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574062.327177:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3658380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1875455681541120:0@lo:400: 00000100:00100000:1.0:1788574062.327382:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574062.327401:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3659c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3617:1875455681541632:0@lo:400: 00000100:00100000:1.0:1788574062.327422:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574062.327451:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788574062.327457:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c365bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681540736:0@lo:400: 00000100:00100000:1.0:1788574062.327483:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574062.327502:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c365b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1875455681541248:0@lo:400: 00000100:00100000:1.0:1788574062.327540:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574062.327562:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3659f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1875455681541760:0@lo:400: 00000100:00100000:1.0:1788574062.327583:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574062.327608:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c365aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875455681540864:0@lo:400: 00000100:00100000:1.0:1788574062.327631:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574062.327642:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3658a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681541376:0@lo:400: 00000100:00100000:1.0:1788574062.327676:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574062.327698:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788574062.327703:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c365b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681540992:0@lo:400: 00000100:00100000:1.0:1788574062.327739:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574062.327758:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3658000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681541504:0@lo:400: 00000100:00100000:1.0:1788574062.327778:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574062.327834:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681540352 00000100:00100000:3.0:1788574062.327850:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681540352 00000100:00100000:3.0:1788574062.327897:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788574062.327906:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e564c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+20:9890:x1875455681540352:12345-0@lo:502: 00000100:00100000:2.0:1788574062.327953:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681540608 00000100:00100000:2.0:1788574062.327958:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681540608 00000100:00100000:2.0:1788574062.327980:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681541120 00000100:00100000:2.0:1788574062.327982:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681541120 00000100:00100000:2.0:1788574062.328004:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681541632 00000100:00100000:2.0:1788574062.328006:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681541632 00000100:00100000:2.0:1788574062.328017:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681541248 00000100:00100000:2.0:1788574062.328019:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681541248 00000100:00100000:3.0:1788574062.328041:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e564c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+20:9890:x1875455681540352:12345-0@lo:502: Request processed in 136us (1908us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574062.328049:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788574062.328113:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681541760 00000100:00100000:2.0:1788574062.328117:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681541760 00000100:00100000:2.0:1788574062.328127:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681540864 00000100:00100000:2.0:1788574062.328128:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681540864 00000100:00100000:2.0:1788574062.328138:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788574062.328143:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c365ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875455681540608:12345-0@lo:400: 00000100:00100000:2.0:1788574062.328185:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c365ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875455681540608:12345-0@lo:400: Request processed in 41us (1036us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574062.328209:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788574062.328222:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788574062.328228:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de9bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875455681541120:12345-0@lo:400: 00000100:00100000:2.0:1788574062.328257:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de9bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875455681541120:12345-0@lo:400: Request processed in 29us (875us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574062.328262:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788574062.328274:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788574062.328279:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de9bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875455681541632:12345-0@lo:400: 00000100:00100000:2.0:1788574062.328303:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de9bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875455681541632:12345-0@lo:400: Request processed in 24us (881us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574062.328308:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788574062.328317:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788574062.328322:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c35f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875455681541248:12345-0@lo:400: 00000100:00100000:2.0:1788574062.328354:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c35f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875455681541248:12345-0@lo:400: Request processed in 32us (814us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574062.328360:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788574062.328371:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788574062.328376:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c35f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875455681541760:12345-0@lo:400: 00000100:00100000:2.0:1788574062.328399:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c35f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875455681541760:12345-0@lo:400: Request processed in 23us (815us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574062.328404:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788574062.328413:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788574062.328417:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c35f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875455681540864:12345-0@lo:400: 00000100:00100000:2.0:1788574062.328445:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c35f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875455681540864:12345-0@lo:400: Request processed in 27us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574062.328450:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788574062.328480:0:9890:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:9890:1875455681540352:0@lo:502: 00000020:01000000:2.0:1788574062.328509:0:9890:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788574062.328515:0:9890:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574062.328517:0:9890:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788574062.328522:0:9890:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000020:01000000:2.0:1788574062.328581:0:6490:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:2.0:1788574062.328601:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1788574062.328610:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6e00/0x5bf8706fdac8be57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8be5e expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574062.328621:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6e00/0x5bf8706fdac8be57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8be5e expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788574062.328631:0:6490:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788574062.328639:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c85c2bfb800 from 39 10000000:01000000:2.0:1788574062.328641:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788574062.328668:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85fa32ec00/0x5bf8706fdac8be81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574062.328676:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c85fa32ec00/0x5bf8706fdac8be81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574062.328684:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c85fa32ec00/0x5bf8706fdac8be81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574062.328698:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681541888:0@lo:101: 00000100:00100000:2.0:1788574062.328738:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574062.328767:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85fae4c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788574062.328959:0:7533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681540736 00000100:00100000:1.0:1788574062.328965:0:7533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681540736 00000100:00100000:1.0:1788574062.328995:0:7533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681540992 00000100:00100000:1.0:1788574062.328998:0:7533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681540992 00000100:00100000:1.0:1788574062.329010:0:7533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788574062.329017:0:7533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de9bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681540736:12345-0@lo:400: 00000100:00100000:1.0:1788574062.329125:0:7533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de9bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681540736:12345-0@lo:400: Request processed in 108us (1641us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574062.329132:0:7533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788574062.329146:0:7533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788574062.329152:0:7533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c35f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681540992:12345-0@lo:400: 00000100:00100000:1.0:1788574062.329179:0:7533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c35f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681540992:12345-0@lo:400: Request processed in 27us (1439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574062.329184:0:7533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788574062.329219:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681541376 00000100:00100000:1.0:1788574062.329222:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681541376 00000100:00100000:1.0:1788574062.329245:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681541504 00000100:00100000:1.0:1788574062.329248:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681541504 00000100:00100000:1.0:1788574062.329268:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788574062.329274:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c35f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681541376:12345-0@lo:400: 00000100:00100000:1.0:1788574062.329303:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c35f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681541376:12345-0@lo:400: Request processed in 30us (1626us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574062.329318:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788574062.329331:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788574062.329337:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c35fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681541504:12345-0@lo:400: 00000100:00100000:1.0:1788574062.329366:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c35fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681541504:12345-0@lo:400: Request processed in 30us (1587us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574062.329371:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1788574062.329392:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788574062.329396:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788574062.329398:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788574062.329423:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c365bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681540736:0@lo:400: 00010000:00080000:1.0:1788574062.329436:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c365b800 x1875455681541248/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574062.329445:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c365b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1875455681541248:0@lo:400: 00010000:00080000:1.0:1788574062.329456:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3659f80 x1875455681541760/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574062.329464:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3659f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1875455681541760:0@lo:400: 00010000:00080000:1.0:1788574062.329473:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3659180 x1875455681540608/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574062.329481:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3659180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875455681540608:0@lo:400: 00010000:00080000:1.0:1788574062.329490:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3658380 x1875455681541120/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574062.329499:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3658380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1875455681541120:0@lo:400: 00010000:00080000:1.0:1788574062.329510:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3659c00 x1875455681541632/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574062.329526:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3659c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3617:1875455681541632:0@lo:400: 00000100:00100000:1.0:1788574062.329563:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c365b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681540992:0@lo:400: 00010000:00080000:1.0:1788574062.329573:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3658000 x1875455681541504/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574062.329581:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3658000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681541504:0@lo:400: 00010000:00080000:1.0:1788574062.329591:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c365aa00 x1875455681540864/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574062.329597:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c365aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875455681540864:0@lo:400: 00010000:00080000:1.0:1788574062.329606:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3658a80 x1875455681541376/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574062.329614:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3658a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681541376:0@lo:400: 00000100:00100000:1.0:1788574062.329635:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681541888 00000100:00100000:1.0:1788574062.329638:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681541888 00000100:00100000:1.0:1788574062.329662:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788574062.329668:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e564c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+20:6490:x1875455681541888:12345-0@lo:101: 00010000:00010000:1.0:1788574062.329676:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574062.329691:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85faea3c00/0x5bf8706fdac8be88 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8be81 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574062.329713:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85faea3c00/0x5bf8706fdac8be88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8be81 expref: 21 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574062.329737:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85faea3c00/0x5bf8706fdac8be88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8be81 expref: 21 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574062.329756:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85faea3c00, rc 0) 00000100:00100000:1.0:1788574062.329787:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e564c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+21:6490:x1875455681541888:12345-0@lo:101: Request processed in 119us (1048us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574062.329792:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788574062.329985:0:8418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681540480 00000100:00100000:0.0:1788574062.329989:0:8418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681540480 00000100:00100000:0.0:1788574062.330058:0:8418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788574062.330066:0:8418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3659500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9894:x1875455681540480:12345-0@lo:700: 00000100:00100000:0.0:1788574062.330100:0:8418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2335f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8418:1875455681542016:0@lo:700: 00000100:00100000:0.0:1788574062.330131:0:8418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574062.330151:0:8418:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c235db40 going to sleep for 11 seconds 00000100:00080000:0.0:1788574062.330166:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788574062.330180:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681542016 00000100:00100000:0.0:1788574062.330183:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681542016 00000100:00100000:0.0:1788574062.330280:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788574062.330288:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c2337b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8418:x1875455681542016:12345-0@lo:700: 00000100:00100000:3.0:1788574062.332555:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681541888:0@lo:101: 00010000:00010000:3.0:1788574062.332589:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c85fa32ec00/0x5bf8706fdac8be81 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8be88 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574062.332602:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c85fa32ec00/0x5bf8706fdac8be81 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8be88 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574062.332699:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3008e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681542144:0@lo:501: 00000100:00100000:3.0:1788574062.332776:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574062.332801:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c26bd540 going to sleep for 11 seconds 00000100:00100000:3.0:1788574062.332823:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681542144 00000100:00100000:3.0:1788574062.332851:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681542144 00000100:00100000:3.0:1788574062.332891:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788574062.332899:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e564e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+21:6490:x1875455681542144:12345-0@lo:501: 00000100:00100000:3.0:1788574062.333052:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e564e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+21:6490:x1875455681542144:12345-0@lo:501: Request processed in 153us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574062.333059:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788574062.333106:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3008e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681542144:0@lo:501: 00000100:00100000:3.0:1788574062.333132:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3008e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681542272:0@lo:503: 00000100:00100000:3.0:1788574062.333173:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574062.333217:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c26bd540 going to sleep for 11 seconds 00000100:00100000:3.0:1788574062.333229:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681542272 00000100:00100000:3.0:1788574062.333233:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681542272 00000100:00100000:3.0:1788574062.333253:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788574062.333259:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e564f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+21:6490:x1875455681542272:12345-0@lo:503: 00000100:00100000:3.0:1788574062.333338:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e564f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+21:6490:x1875455681542272:12345-0@lo:503: Request processed in 78us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574062.333345:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788574062.333385:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3008e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681542272:0@lo:503: 00000004:00080000:2.0:1788574062.336873:0:7422:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 40000000:02000000:1.0:1788574062.337580:0:6499:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000100:00100000:0.0:1788574062.338911:0:9896:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2335880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:9896:1875455681542400:0@lo:502: 00000100:00100000:0.0:1788574062.339011:0:9896:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574062.339965:0:9896:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c235dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788574062.340083:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681542400 00000100:00100000:2.0:1788574062.340092:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681542400 00000100:00100000:2.0:1788574062.340152:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788574062.340161:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e564d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+21:9896:x1875455681542400:12345-0@lo:502: 00000100:00100000:2.0:1788574062.340318:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e564d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+21:9896:x1875455681542400:12345-0@lo:502: Request processed in 157us (1307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574062.340326:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788574062.340645:0:9896:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2335880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:9896:1875455681542400:0@lo:502: 00000100:00100000:0.0:1788574062.340708:0:9896:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2335880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:9896:1875455681542528:0@lo:502: 00000100:00100000:0.0:1788574062.340768:0:9896:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574062.340803:0:9896:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c235dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788574062.341356:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681542528 00000100:00100000:2.0:1788574062.341363:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681542528 00000100:00100000:2.0:1788574062.341396:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788574062.341403:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e564dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+21:9896:x1875455681542528:12345-0@lo:502: 00000100:00100000:2.0:1788574062.341505:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e564dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+21:9896:x1875455681542528:12345-0@lo:502: Request processed in 101us (736us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574062.341514:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788574062.341606:0:9896:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2335880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:9896:1875455681542528:0@lo:502: 00000040:00080000:0.0:1788574062.341631:0:9896:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1788574062.341700:0:6490:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1788574062.341735:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788574062.343134:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85fa32ec00/0x5bf8706fdac8be81 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8be88 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574062.343151:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c85fa32ec00/0x5bf8706fdac8be81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8be88 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788574062.343164:0:6490:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788574062.343167:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c85c2bfb800 from 6 10000000:01000000:0.0:1788574062.343170:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788574062.343233:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7800/0x5bf8706fdac8be8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574062.343243:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7800/0x5bf8706fdac8be8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574062.343254:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7800/0x5bf8706fdac8be8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574062.343311:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2335880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681542656:0@lo:101: 00000100:00100000:0.0:1788574062.343384:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574062.343434:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c235dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788574062.346029:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681542656 00000100:00100000:3.0:1788574062.346043:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681542656 00000100:00100000:3.0:1788574062.346112:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788574062.346122:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e564d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+21:6490:x1875455681542656:12345-0@lo:101: 00010000:00010000:3.0:1788574062.346138:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574062.346156:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85c152ea00/0x5bf8706fdac8be96 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8be8f expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574062.346184:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85c152ea00/0x5bf8706fdac8be96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8be8f expref: 22 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574062.346231:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85c152ea00/0x5bf8706fdac8be96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8be8f expref: 22 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574062.346241:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85c152ea00, rc 0) 00000100:00100000:3.0:1788574062.346313:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e564d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+22:6490:x1875455681542656:12345-0@lo:101: Request processed in 192us (2928us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574062.346319:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788574062.346376:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2335880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681542656:0@lo:101: 00010000:00010000:3.0:1788574062.346394:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7800/0x5bf8706fdac8be8f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8be96 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574062.346404:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7800/0x5bf8706fdac8be8f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8be96 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574062.346464:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3008e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681542784:0@lo:256: 00000100:00100000:3.0:1788574062.346497:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574062.346528:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c26bd000 going to sleep for 11 seconds 00000100:00100000:3.0:1788574062.346541:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681542784 00000100:00100000:3.0:1788574062.346545:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681542784 00000100:00100000:3.0:1788574062.346565:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788574062.346571:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e564e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+22:6490:x1875455681542784:12345-0@lo:256: 20000000:01000000:3.0:1788574062.346587:0:6485:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788574062.346603:0:6485:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788574062.346606:0:6485:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1788574062.346686:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e564e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+22:6490:x1875455681542784:12345-0@lo:256: Request processed in 114us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574062.346694:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788574062.353143:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3008e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681542784:0@lo:256: 00000100:00100000:3.0:1788574062.353741:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c2337b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8418:x1875455681542016:12345-0@lo:700: Request processed in 23451us (23606us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574062.353754:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788574062.357067:0:8418:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c2335f80 x1875455681542016/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788574078 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574062.357087:0:8418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2335f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8418:1875455681542016:0@lo:700: 40000000:02000000:1.0:1788574062.357103:0:8418:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 10000000:01000000:0.0:1788574062.361381:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788574062.361396:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7800/0x5bf8706fdac8be8f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8be96 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574062.361415:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7800/0x5bf8706fdac8be8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8be96 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788574062.361425:0:6490:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788574062.361429:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1788574062.361431:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788574062.361471:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6a00/0x5bf8706fdac8be9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574062.361479:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6a00/0x5bf8706fdac8be9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574062.361491:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6a00/0x5bf8706fdac8be9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574062.361514:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2335880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681542912:0@lo:101: 00000100:00100000:0.0:1788574062.361579:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574062.361634:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681542912 00000100:00100000:0.0:1788574062.361634:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c235d600 going to sleep for 11 seconds 00000100:00100000:2.0:1788574062.361642:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681542912 00000100:00100000:2.0:1788574062.361690:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788574062.361698:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e564f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+22:6490:x1875455681542912:12345-0@lo:101: 00010000:00010000:2.0:1788574062.361709:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574062.361737:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85fa32fe00/0x5bf8706fdac8bea4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8be9d expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574062.361761:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85fa32fe00/0x5bf8706fdac8bea4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8be9d expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574062.361771:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85fa32fe00/0x5bf8706fdac8bea4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8be9d expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574062.361780:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85fa32fe00, rc 0) 00000100:00100000:2.0:1788574062.361849:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e564f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+23:6490:x1875455681542912:12345-0@lo:101: Request processed in 142us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574062.361856:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788574062.361904:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2335880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681542912:0@lo:101: 00010000:00010000:2.0:1788574062.361918:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6a00/0x5bf8706fdac8be9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bea4 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574062.361927:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6a00/0x5bf8706fdac8be9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8bea4 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574062.361981:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681543040:0@lo:501: 00000100:00100000:2.0:1788574062.362006:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574062.362156:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85fae4c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788574062.362170:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681543040 00000100:00100000:2.0:1788574062.362173:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681543040 00000100:00100000:2.0:1788574062.362217:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788574062.362224:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e564d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+23:6490:x1875455681543040:12345-0@lo:501: 00000100:00100000:2.0:1788574062.362505:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e564d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+23:6490:x1875455681543040:12345-0@lo:501: Request processed in 280us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574062.362512:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788574062.362546:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681543040:0@lo:501: 00000100:00100000:2.0:1788574062.362576:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681543168:0@lo:503: 00000100:00100000:2.0:1788574062.362613:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574062.362628:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681543168 00000100:00100000:3.0:1788574062.362632:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681543168 00000100:00100000:2.0:1788574062.362636:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85fae4c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788574062.362661:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788574062.362667:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e564c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+23:6490:x1875455681543168:12345-0@lo:503: 00000100:00100000:3.0:1788574062.363675:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e564c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+23:6490:x1875455681543168:12345-0@lo:503: Request processed in 1005us (1059us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574062.363675:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681543168:0@lo:503: 00000100:00100000:3.0:1788574062.363684:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788574062.366252:0:9901:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:9901:1875455681543296:0@lo:502: 00000100:00100000:2.0:1788574062.366343:0:9901:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574062.366388:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681543296 00000100:00100000:2.0:1788574062.366394:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681543296 00000100:00100000:2.0:1788574062.366436:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788574062.366443:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e564cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+23:9901:x1875455681543296:12345-0@lo:502: 00000100:00100000:2.0:1788574062.366567:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e564cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+23:9901:x1875455681543296:12345-0@lo:502: Request processed in 123us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574062.366574:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788574062.366633:0:9901:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c6a783c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788574062.366655:0:9901:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:9901:1875455681543296:0@lo:502: 00000020:01000000:2.0:1788574062.366682:0:9901:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788574062.366690:0:9901:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788574062.366703:0:9901:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574062.366706:0:9901:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788574062.366711:0:9901:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788574062.366730:0:9901:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.151@tcp to nid 0x20000c0a8cc97 (192.168.204.151@tcp) 00000020:01000000:2.0:1788574062.366753:0:9901:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788574062.366756:0:9901:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788574062.366772:0:9901:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9c84c3038000) 00000020:00000080:2.0:1788574062.366796:0:9901:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:2.0:1788574062.366802:0:9901:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788574062.366902:0:9901:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1788574062.366909:0:9901:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:2.0:1788574062.366916:0:9901:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5bf8706fdac8beb2 00010000:00080000:2.0:1788574062.366947:0:9901:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c85ffa60000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.151@tcp at head 00010000:00010000:0.0:1788574062.372101:0:9901:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:0.0:1788574062.372420:0:9901:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1788574062.372435:0:9901:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788574062.372630:0:9901:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788574062.372763:0:9901:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788574062.374111:0:9901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1788574062.374468:0:9901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000001:00100000:0.0:1788574062.375080:0:9487:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000040:00080000:2.0:1788574062.375106:0:9902:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788574062.375111:0:9902:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00010000:00080000:2.0:1788574062.375291:0:9894:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c365b100 x1875455681540480/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788574078 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574062.375308:0:9894:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c365b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9894:1875455681540480:0@lo:700: 00000100:00100000:0.0:1788574062.375963:0:8418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3659500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9894:x1875455681540480:12345-0@lo:700: Request processed in 45896us (50186us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574062.375975:0:8418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000020:00000080:1.0:1788574062.377120:0:9901:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788574062.377137:0:9901:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788574062.377178:0:9901:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788574062.377314:0:9901:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5bf8706fdac8beb9 00000100:00080000:1.0:1788574062.377324:0:9901:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788574062.377329:0:9901:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c85ffa60000 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:1.0:1788574062.377361:0:9901:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c84c35fa300 x1875455681543424/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788574062.377387:0:9901:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1788574062.377449:0:9901:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788574062.377453:0:9901:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574062.377455:0:9901:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788574062.377458:0:9901:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788574062.377462:0:9901:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574062.377463:0:9901:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788574062.377466:0:9901:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788574062.377467:0:9901:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788574062.377497:0:9901:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c35fad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:9901:1875455681543552:0@lo:502: 00000100:00100000:2.0:1788574062.377546:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c35fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875455681543424:0@lo:8: 00000100:00100000:1.0:1788574062.377570:0:9901:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574062.377579:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574062.377610:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681543424 00000100:00100000:1.0:1788574062.377616:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681543424 00000100:00100000:1.0:1788574062.377643:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788574062.377650:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c335f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3616:x1875455681543424:12345-0@lo:8: 00010000:00080000:1.0:1788574062.377676:0:8409:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 202 last 0 00000020:00000080:1.0:1788574062.377699:0:8409:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5bf8706fdac8bec0 00002000:00100000:1.0:1788574062.377712:0:8409:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9c84c3698800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a03 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788574062.377726:0:8409:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1788574062.377728:0:8409:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788574062.377802:0:8409:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788574062.377825:0:8409:0:(import.c:65:import_set_state_nolock()) ffff9c84c369a000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788574062.378360:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681543552 00000100:00100000:2.0:1788574062.378366:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681543552 00000100:00100000:2.0:1788574062.378414:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788574062.378422:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e564ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+23:9901:x1875455681543552:12345-0@lo:502: 00000100:00100000:2.0:1788574062.378547:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e564ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+23:9901:x1875455681543552:12345-0@lo:502: Request processed in 126us (975us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574062.378555:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788574062.379008:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c335f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3616:x1875455681543424:12345-0@lo:8: Request processed in 1355us (1424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574062.379016:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1788574062.379066:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c35fa300 x1875455681543424/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788574072 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574062.379077:0:3616:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788574062.379085:0:3616:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788574062.379092:0:3616:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788574062.379097:0:3616:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788574062.379101:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c85ffa60000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788574062.379109:0:3616:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788574062.379115:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c35fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875455681543424:0@lo:8: 00000100:00100000:1.0:1788574062.379583:0:9901:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c7de69c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788574062.379600:0:9901:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c35fad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:9901:1875455681543552:0@lo:502: 00000020:01000000:1.0:1788574062.379632:0:9901:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788574062.379637:0:9901:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574062.379639:0:9901:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788574062.379643:0:9901:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000020:01000000:1.0:1788574062.379702:0:6490:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:1.0:1788574062.379733:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788574062.379743:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6a00/0x5bf8706fdac8be9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bea4 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574062.379754:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6a00/0x5bf8706fdac8be9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bea4 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788574062.379764:0:6490:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788574062.379767:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9c85e56999c0 from 1 10000000:01000000:1.0:1788574062.379769:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788574062.379801:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85faea3200/0x5bf8706fdac8bec7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574062.379809:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c85faea3200/0x5bf8706fdac8bec7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574062.379819:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c85faea3200/0x5bf8706fdac8bec7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574062.379835:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c35fad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681543680:0@lo:101: 00000004:00080000:2.0:1788574062.379927:0:9902:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1788574062.381030:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574062.381079:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c7de69c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788574062.381310:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681543680 00000100:00100000:2.0:1788574062.381317:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681543680 00000100:00100000:2.0:1788574062.381366:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788574062.381375:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c5362850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+23:6490:x1875455681543680:12345-0@lo:101: 00010000:00010000:2.0:1788574062.381389:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574062.381404:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85fa32ee00/0x5bf8706fdac8bece lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8bec7 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574062.381427:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85fa32ee00/0x5bf8706fdac8bece lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8bec7 expref: 24 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574062.381438:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85fa32ee00/0x5bf8706fdac8bece lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8bec7 expref: 24 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574062.381447:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85fa32ee00, rc 0) 00000100:00100000:2.0:1788574062.381490:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c5362850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:6490:x1875455681543680:12345-0@lo:101: Request processed in 117us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574062.381497:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788574062.381667:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c35fad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681543680:0@lo:101: 00010000:00010000:1.0:1788574062.381682:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c85faea3200/0x5bf8706fdac8bec7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bece expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574062.381696:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c85faea3200/0x5bf8706fdac8bec7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8bece expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574062.381770:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c35fad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681543808:0@lo:501: 00000100:00100000:1.0:1788574062.381809:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574062.381897:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681543808 00000100:00100000:2.0:1788574062.381902:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681543808 00000100:00100000:2.0:1788574062.381934:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788574062.381941:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e564f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:6490:x1875455681543808:12345-0@lo:501: 00000100:00100000:2.0:1788574062.382007:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e564f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:6490:x1875455681543808:12345-0@lo:501: Request processed in 66us (197us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788574062.382014:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788574062.383071:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c7de69c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788574062.383102:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c35fad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681543808:0@lo:501: 10000000:01000000:1.0:1788574062.383183:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788574062.383634:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85faea3200/0x5bf8706fdac8bec7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bece expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574062.383645:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c85faea3200/0x5bf8706fdac8bec7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bece expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788574062.383760:0:9902:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 202363569472ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788574062.383769:0:9902:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:3.0:1788574062.386461:0:9894:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1788574062.386495:0:9894:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c300a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9894:1875455681544064:0@lo:7: 00000100:00100000:3.0:1788574062.386563:0:9894:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574062.386593:0:9894:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c26bd180 going to sleep for 11 seconds 00000100:00100000:3.0:1788574062.386609:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788574062.386621:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c300a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681543936:0@lo:13: 00000100:00100000:3.0:1788574062.386646:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574062.386676:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681544064 00000100:00100000:3.0:1788574062.386682:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681544064 00000100:00100000:3.0:1788574062.386735:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788574062.386745:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c300ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9894:x1875455681544064:12345-0@lo:7: 00000100:00100000:2.0:1788574062.389028:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788574062.389046:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681544192:0@lo:13: 00000100:00100000:2.0:1788574062.389109:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574062.389150:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681543936 00000100:00100000:2.0:1788574062.389164:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681543936 00000100:00100000:2.0:1788574062.389238:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681544192 00000100:00100000:2.0:1788574062.389242:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681544192 00000100:00100000:2.0:1788574062.389274:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788574062.389283:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3009f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3620:x1875455681543936:12345-0@lo:13: 00002000:00000024:2.0:1788574062.389306:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923910656 avail 3692388352 00000100:00100000:2.0:1788574062.389348:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3009f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3620:x1875455681543936:12345-0@lo:13: Request processed in 66us (2701us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574062.389356:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788574062.389372:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788574062.389378:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c335d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3619:x1875455681544192:12345-0@lo:13: 00002000:00000024:2.0:1788574062.389387:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923910656 avail 3692388352 00000100:00100000:2.0:1788574062.389415:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c335d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3619:x1875455681544192:12345-0@lo:13: Request processed in 38us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574062.389422:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:2.0:1788574062.389438:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788574062.390028:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c335fb80 x1875455681544192/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574078 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574062.390050:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681544192:0@lo:13: 00000004:00080000:2.0:1788574062.390077:0:9903:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1788574062.390103:0:9903:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9903:1875455681544320:0@lo:7: 00000100:00100000:2.0:1788574062.390139:0:9903:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574062.390168:0:9903:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c3653cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788574062.390535:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681544320 00000100:00100000:1.0:1788574062.390541:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681544320 00000100:00100000:1.0:1788574062.390589:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788574062.390597:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c335c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9903:x1875455681544320:12345-0@lo:7: 00000004:00080000:2.0:1788574062.391580:0:6471:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00080000:2.0:1788574062.393806:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c300a680 x1875455681543936/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574078 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574062.393833:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c300a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681543936:0@lo:13: 00002000:00080000:3.0:1788574062.394977:0:8411:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1788574062.394984:0:8411:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1788574062.395070:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c300ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9894:x1875455681544064:12345-0@lo:7: Request processed in 8324us (8504us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574062.395081:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1788574062.396993:0:9894:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c300a300 x1875455681544064/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788574078 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574062.397013:0:9894:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c300a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9894:1875455681544064:0@lo:7: 00000004:00080000:2.0:1788574062.397026:0:9894:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1788574062.397077:0:9894:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fa32b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9894:1875455681544448:0@lo:5: 00000100:00100000:2.0:1788574062.397135:0:9894:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574062.397237:0:9894:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c3653b40 going to sleep for 11 seconds 00002000:00080000:0.0:1788574062.399524:0:8409:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:0.0:1788574062.399532:0:8409:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:0.0:1788574062.399675:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c335c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9903:x1875455681544320:12345-0@lo:7: Request processed in 9076us (9531us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574062.399685:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788574062.399709:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681544448 00000100:00100000:0.0:1788574062.399727:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681544448 00000100:00100000:1.0:1788574062.399818:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788574062.399830:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa328380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9894:x1875455681544448:12345-0@lo:5: 00002000:00080000:1.0:1788574062.399871:0:8410:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:1.0:1788574062.399915:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa328380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9894:x1875455681544448:12345-0@lo:5: Request processed in 88us (2779us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574062.399921:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1788574062.400058:0:9903:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c335fb80 x1875455681544320/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788574078 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574062.400072:0:9903:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9903:1875455681544320:0@lo:7: 00000004:00080000:2.0:1788574062.400086:0:9903:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:2.0:1788574062.400121:0:9903:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9903:1875455681544576:0@lo:5: 00000100:00100000:2.0:1788574062.400155:0:9903:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574062.400353:0:8815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681544576 00000100:00100000:1.0:1788574062.400358:0:8815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681544576 00000100:00100000:1.0:1788574062.400387:0:8815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788574062.400393:0:8815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa0e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:9903:x1875455681544576:12345-0@lo:5: 00002000:00080000:1.0:1788574062.400407:0:8815:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1788574062.400410:0:8815:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00010000:00080000:3.0:1788574062.400413:0:9894:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85fa32b480 x1875455681544448/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788574078 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574062.400433:0:9894:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fa32b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9894:1875455681544448:0@lo:5: 00000004:00080000:3.0:1788574062.400442:0:9894:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1788574062.400465:0:9894:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3009880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9894:1875455681544704:0@lo:5: 00000100:00100000:3.0:1788574062.400492:0:9894:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574062.400514:0:9894:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c3277b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788574062.400525:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681544704 00000100:00100000:3.0:1788574062.400528:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681544704 00000100:00100000:3.0:1788574062.400545:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788574062.400550:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c300b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9894:x1875455681544704:12345-0@lo:5: 00002000:00080000:3.0:1788574062.400571:0:8410:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:2.0:1788574062.400923:0:9903:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c3653cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788574062.405978:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c300b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:9894:x1875455681544704:12345-0@lo:5: Request processed in 5418us (5476us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788574062.405993:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1788574062.407934:0:9894:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3009880 x1875455681544704/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788574078 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574062.407957:0:9894:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3009880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9894:1875455681544704:0@lo:5: 00000004:00080000:3.0:1788574062.407975:0:9894:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1788574062.408024:0:9894:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3009500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9894:1875455681544832:0@lo:900: 00000100:00100000:3.0:1788574062.408094:0:9894:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574062.408140:0:9894:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c3277b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788574062.410452:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681544832 00000100:00100000:0.0:1788574062.410467:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681544832 00000100:00100000:0.0:1788574062.410517:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788574062.410527:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3009180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9894:x1875455681544832:12345-0@lo:900: 00000100:00100000:0.0:1788574062.410623:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3009180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9894:x1875455681544832:12345-0@lo:900: Request processed in 97us (2530us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574062.410631:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788574062.410961:0:9894:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3009500 x1875455681544832/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788574078 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574062.410976:0:9894:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3009500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9894:1875455681544832:0@lo:900: 00000001:00080000:0.0:1788574062.411518:0:9487:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:0.0:1788574062.411531:0:9487:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1788574062.411653:0:8815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa0e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:9903:x1875455681544576:12345-0@lo:5: Request processed in 11251us (11489us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788574062.411664:0:8815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1788574062.411705:0:9903:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c335fb80 x1875455681544576/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788574078 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574062.411727:0:9903:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1788574062.411733:0:9903:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9903:1875455681544576:0@lo:5: 00000004:00080000:2.0:1788574062.411746:0:9903:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:2.0:1788574062.411794:0:9903:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fa0e6680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9903:1875455681544960:0@lo:700: 00000100:00100000:2.0:1788574062.411829:0:9903:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574062.411970:0:9903:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c3653cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788574062.412004:0:8417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681544960 00000100:00100000:0.0:1788574062.412010:0:8417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681544960 00000100:00100000:0.0:1788574062.412047:0:8417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788574062.412054:0:8417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa0e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9903:x1875455681544960:12345-0@lo:700: 00000020:00000004:2.0:1788574062.421729:0:9910:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788574062.422028:0:9910:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000001:00080000:0.0:1788574062.426316:0:9487:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:3.0:1788574062.426599:0:8417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa0e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9903:x1875455681544960:12345-0@lo:700: Request processed in 14541us (14765us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574062.426612:0:8417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788574062.426616:0:9903:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85fa0e6680 x1875455681544960/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788574078 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574062.426630:0:9903:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fa0e6680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9903:1875455681544960:0@lo:700: 00000004:02000040:3.0:1788574062.432629:0:9903:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:3.0:1788574062.443912:0:9903:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c300bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9903:1875455681545088:0@lo:5: 00000100:00100000:3.0:1788574062.443992:0:9903:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574062.444067:0:9903:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c3277840 going to sleep for 11 seconds 00000100:00100000:1.0:1788574062.444947:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681545088 00000100:00100000:1.0:1788574062.444957:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681545088 00000100:00100000:1.0:1788574062.445021:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788574062.445031:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c300aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:9903:x1875455681545088:12345-0@lo:5: 00002000:00080000:0.0:1788574062.456584:0:8409:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1788574062.456605:0:8409:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:0.0:1788574062.458039:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c300aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9903:x1875455681545088:12345-0@lo:5: Request processed in 13003us (14040us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788574062.458063:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1788574062.458200:0:9903:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c300bb80 x1875455681545088/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788574078 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574062.458221:0:9903:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c300bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9903:1875455681545088:0@lo:5: 00000004:00080000:1.0:1788574062.458237:0:9903:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00010000:00010000:0.0:1788574063.254771:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788574063.465708:0:9487:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00010000:00010000:3.0:1788574064.275653:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574065.304859:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574065.305088:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788574065.305110:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fa0e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681545216:0@lo:41: 00000100:00100000:2.0:1788574065.305177:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574065.305267:0:7533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681545216 00000100:00100000:2.0:1788574065.305276:0:7533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681545216 00000100:00100000:2.0:1788574065.305323:0:7533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788574065.305332:0:7533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa0e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681545216:12345-0@lo:41: 00000004:00000024:2.0:1788574065.305365:0:7533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1788574065.305412:0:7533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa0e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681545216:12345-0@lo:41: Request processed in 81us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574065.305419:0:7533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788574065.305478:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fa0e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681545216:0@lo:41: 00000020:00000004:2.0:1788574065.659442:0:10011:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788574065.659860:0:10011:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788574066.324661:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574066.837518:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fa0e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681545344:0@lo:13: 00000100:00100000:2.0:1788574066.837593:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574066.837689:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fa0e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681545472:0@lo:13: 00000100:00100000:2.0:1788574066.837716:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574066.837751:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681545344 00000100:00100000:2.0:1788574066.837757:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681545344 00000100:00100000:2.0:1788574066.837798:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681545472 00000100:00100000:2.0:1788574066.837801:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681545472 00000100:00100000:1.0:1788574066.837932:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c35fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681545600:0@lo:41: 00000100:00100000:1.0:1788574066.837964:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574066.837996:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681545600 00000100:00100000:1.0:1788574066.838000:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681545600 00000100:00100000:1.0:1788574066.838034:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788574066.838043:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c35fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681545600:12345-0@lo:41: 00000004:00000024:1.0:1788574066.838079:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788574066.838126:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c35fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681545600:12345-0@lo:41: Request processed in 83us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574066.838142:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788574066.838215:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c35fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681545600:0@lo:41: 00000100:00100000:2.0:1788574066.838955:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788574066.838970:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c335fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681545344:12345-0@lo:13: 00002000:00000024:2.0:1788574066.838994:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788574066.839052:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c335fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681545344:12345-0@lo:13: Request processed in 86us (1458us total) trans 0 rc 0/0 00010000:00080000:1.0:1788574066.839109:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85fa0e6680 x1875455681545344/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574082 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574066.839126:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fa0e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681545344:0@lo:13: 00000100:00080000:3.0:1788574066.841486:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788574066.842230:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788574066.842264:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788574066.842278:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de938700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681545472:12345-0@lo:13: 00002000:00000024:2.0:1788574066.842304:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788574066.842400:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de938700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681545472:12345-0@lo:13: Request processed in 127us (4683us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574066.842407:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1788574066.842983:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85fa0e6300 x1875455681545472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574082 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574066.843005:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fa0e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681545472:0@lo:13: 00000020:00000004:1.0:1788574066.854573:0:10060:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788574066.854584:0:10060:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:3.0:1788574067.347818:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574067.859909:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c300b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:69505170-06bc-41d1-9626-ab1a3c7f32a0:3617:1875455681545728:0@lo:400: 00000100:00100000:1.0:1788574067.859983:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574067.860047:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3008e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681546240:0@lo:400: 00000100:00100000:1.0:1788574067.860074:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574067.860096:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c300b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681546752:0@lo:400: 00000100:00100000:1.0:1788574067.860116:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574067.860131:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681547264:0@lo:400: 00000100:00100000:1.0:1788574067.860146:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574067.860165:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788574067.860169:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3009500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875455681545856:0@lo:400: 00000100:00100000:1.0:1788574067.860227:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574067.860246:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3008700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1875455681546368:0@lo:400: 00000100:00100000:1.0:1788574067.860265:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574067.860276:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3008380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3617:1875455681546880:0@lo:400: 00000100:00100000:1.0:1788574067.860292:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574067.860313:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c300a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875455681546112:0@lo:400: 00000100:00100000:1.0:1788574067.860330:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574067.860354:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3008a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681546624:0@lo:400: 00000100:00100000:1.0:1788574067.860371:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574067.860382:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681547136:0@lo:400: 00000100:00100000:1.0:1788574067.860397:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574067.860410:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788574067.860415:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c300a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681545984:0@lo:400: 00000100:00100000:1.0:1788574067.860434:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574067.860524:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3008000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3620:1875455681546496:0@lo:400: 00000100:00100000:1.0:1788574067.860546:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574067.860555:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fa32b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3620:1875455681547008:0@lo:400: 00000100:00100000:1.0:1788574067.860571:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574067.860712:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681545856 00000100:00100000:0.0:1788574067.860720:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681545856 00000100:00100000:0.0:1788574067.860755:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681546368 00000100:00100000:0.0:1788574067.860758:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681546368 00000100:00100000:0.0:1788574067.860778:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681546880 00000100:00100000:0.0:1788574067.860780:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681546880 00000100:00100000:0.0:1788574067.860793:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681546112 00000100:00100000:0.0:1788574067.860795:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681546112 00000100:00100000:0.0:1788574067.860803:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681546496 00000100:00100000:0.0:1788574067.860806:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681546496 00000100:00100000:0.0:1788574067.860816:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681547008 00000100:00100000:0.0:1788574067.860818:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681547008 00000100:00100000:0.0:1788574067.860832:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788574067.860840:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c35fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875455681545856:12345-0@lo:400: 00000100:00100000:0.0:1788574067.860897:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c35fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875455681545856:12345-0@lo:400: Request processed in 57us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574067.860905:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788574067.860921:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788574067.860927:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c35f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875455681546368:12345-0@lo:400: 00000100:00100000:0.0:1788574067.860953:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c35f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875455681546368:12345-0@lo:400: Request processed in 27us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574067.860959:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788574067.860978:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788574067.860984:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c35f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875455681546880:12345-0@lo:400: 00000100:00100000:0.0:1788574067.861009:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c35f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875455681546880:12345-0@lo:400: Request processed in 27us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574067.861016:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788574067.861025:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788574067.861030:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c35fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875455681546112:12345-0@lo:400: 00000100:00100000:0.0:1788574067.861059:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c35fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875455681546112:12345-0@lo:400: Request processed in 29us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574067.861064:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788574067.861073:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788574067.861079:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c35fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875455681546496:12345-0@lo:400: 00000100:00100000:0.0:1788574067.861103:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c35fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875455681546496:12345-0@lo:400: Request processed in 25us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574067.861107:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788574067.861116:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788574067.861121:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa0e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875455681547008:12345-0@lo:400: 00000100:00100000:0.0:1788574067.861143:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa0e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875455681547008:12345-0@lo:400: Request processed in 22us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574067.861149:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788574067.861164:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681546752 00000100:00100000:0.0:1788574067.861167:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681546752 00000100:00100000:0.0:1788574067.861182:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681547264 00000100:00100000:0.0:1788574067.861184:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681547264 00000100:00100000:0.0:1788574067.861212:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681546624 00000100:00100000:0.0:1788574067.861215:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681546624 00000100:00100000:0.0:1788574067.861223:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681547136 00000100:00100000:0.0:1788574067.861230:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681547136 00000100:00100000:0.0:1788574067.861244:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788574067.861249:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c35f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681546752:12345-0@lo:400: 00000100:00100000:0.0:1788574067.861275:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c35f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681546752:12345-0@lo:400: Request processed in 26us (1158us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574067.861280:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788574067.861290:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788574067.861294:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c35f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681547264:12345-0@lo:400: 00000100:00100000:0.0:1788574067.861316:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c35f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681547264:12345-0@lo:400: Request processed in 22us (1169us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574067.861321:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788574067.861329:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788574067.861334:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c35faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681546624:12345-0@lo:400: 00000100:00100000:0.0:1788574067.861358:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c35faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681546624:12345-0@lo:400: Request processed in 24us (985us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574067.861363:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788574067.861372:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788574067.861377:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c35fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681547136:12345-0@lo:400: 00000100:00100000:0.0:1788574067.861399:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c35fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681547136:12345-0@lo:400: Request processed in 22us (1001us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574067.861405:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788574067.861544:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681546240 00000100:00100000:1.0:1788574067.861549:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681546240 00000100:00100000:1.0:1788574067.861575:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681545984 00000100:00100000:1.0:1788574067.861577:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681545984 00000100:00100000:3.0:1788574067.861694:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681545728 00000100:00100000:3.0:1788574067.861700:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681545728 00000100:00100000:3.0:1788574067.861727:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788574067.861733:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c820f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:3617:x1875455681545728:12345-0@lo:400: 00000100:00100000:3.0:1788574067.861770:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c820f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:3617:x1875455681545728:12345-0@lo:400: Request processed in 36us (1788us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574067.861775:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00080000:3.0:1788574067.861806:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788574067.861810:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788574067.861813:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788574067.861856:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788574067.861866:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c35fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681546240:12345-0@lo:400: 00000100:00100000:1.0:1788574067.861900:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c35fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681546240:12345-0@lo:400: Request processed in 37us (1826us total) trans 0 rc 0/0 00010000:00080000:2.0:1788574067.862150:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3008000 x1875455681546496/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574067.862164:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3008000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3620:1875455681546496:0@lo:400: 00010000:00080000:2.0:1788574067.862175:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85fa32b480 x1875455681547008/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574067.862182:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fa32b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3620:1875455681547008:0@lo:400: 00010000:00080000:2.0:1788574067.862209:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c300a680 x1875455681546112/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574067.863025:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2335f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681547520:0@lo:13: 00000100:00100000:0.0:1788574067.863079:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574067.863123:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681547520 00000100:00100000:0.0:1788574067.863130:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681547520 00000100:00100000:0.0:1788574067.863166:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788574067.863172:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c2335880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681547520:12345-0@lo:13: 00002000:00000024:0.0:1788574067.863224:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788574067.863265:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c2335880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681547520:12345-0@lo:13: Request processed in 93us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574067.863272:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1788574067.863302:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c2335f80 x1875455681547520/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574083 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574067.863311:0:3619:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:0.0:1788574067.863330:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2335f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681547520:0@lo:13: 00000100:00100000:0.0:1788574067.863356:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2336300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681547392:0@lo:13: 00000100:00100000:0.0:1788574067.863382:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574067.863403:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681547392 00000100:00100000:0.0:1788574067.863407:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681547392 00000100:00100000:0.0:1788574067.863422:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788574067.863428:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c2335f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681547392:12345-0@lo:13: 00000100:00100000:2.0:1788574067.865597:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c300a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875455681546112:0@lo:400: 00010000:00080000:2.0:1788574067.865649:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3008a80 x1875455681546624/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574067.865659:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3008a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681546624:0@lo:400: 00010000:00080000:2.0:1788574067.865699:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c1be1180 x1875455681547136/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574067.865706:0:3620:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1788574067.865723:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681547136:0@lo:400: 00002000:00000024:0.0:1788574067.865848:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788574067.865930:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c2335f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681547392:12345-0@lo:13: Request processed in 2501us (2546us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574067.865939:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1788574067.865978:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c2336300 x1875455681547392/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574083 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574067.865994:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2336300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681547392:0@lo:13: 00010000:00080000:0.0:1788574067.866026:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3009500 x1875455681545856/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574067.866034:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3009500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875455681545856:0@lo:400: 00010000:00080000:0.0:1788574067.866044:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3008700 x1875455681546368/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574067.866058:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3008700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1875455681546368:0@lo:400: 00010000:00080000:0.0:1788574067.866071:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3008380 x1875455681546880/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574067.866078:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3008380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3617:1875455681546880:0@lo:400: 00000100:00100000:0.0:1788574067.866086:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c300b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:69505170-06bc-41d1-9626-ab1a3c7f32a0:3617:1875455681545728:0@lo:400: 00000100:00100000:0.0:1788574067.866095:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3008e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681546240:0@lo:400: 00010000:00080000:0.0:1788574067.866106:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c300b800 x1875455681546752/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574067.866112:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c300b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681546752:0@lo:400: 00010000:00080000:0.0:1788574067.866122:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85faf3ce00 x1875455681547264/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574067.866128:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681547264:0@lo:400: 00000100:00100000:3.0:1788574067.867038:0:7533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788574067.867074:0:7533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c35f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681545984:12345-0@lo:400: 00000100:00100000:3.0:1788574067.867162:0:7533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c35f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681545984:12345-0@lo:400: Request processed in 113us (6725us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574067.867170:0:7533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788574067.867289:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c300a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681545984:0@lo:400: 00000100:00100000:1.0:1788574067.867390:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788574068.360739:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574068.361348:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668912512 00000100:00100000:3.0:1788574068.361360:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668912512 00000100:00100000:3.0:1788574068.361413:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 181 00000100:00100000:3.0:1788574068.361421:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c820d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2392:x1875455668912512:12345-192.168.204.51@tcp:250: 00010000:00080000:3.0:1788574068.361448:0:6485:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 0aa00de1-a4b8-4ab8-ae12-895c156dafdd@192.168.204.51@tcp t0 exp 0000000000000000 cur 208 last 0 00000020:00000080:3.0:1788574068.361479:0:6485:0:(genops.c:1385:class_connect()) connect: client 0aa00de1-a4b8-4ab8-ae12-895c156dafdd, cookie 0x5bf8706fdac8bed5 00000100:00080000:3.0:1788574068.361640:0:6485:0:(import.c:65:import_set_state_nolock()) ffff9c84c3285000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788574068.361772:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c820d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+5:2392:x1875455668912512:12345-192.168.204.51@tcp:250: Request processed in 350us (1042us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574068.361797:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 181 00010000:00010000:1.0:1788574068.372716:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574068.374598:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574068.375858:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668912384 00000100:00100000:0.0:1788574068.375871:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668912384 00000100:00100000:0.0:1788574068.375939:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 182 00000100:00100000:0.0:1788574068.375949:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c820f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+5:6149:x1875455668912384:12345-192.168.204.51@tcp:101: 00010000:00010000:0.0:1788574068.375964:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574068.375982:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85d20d6400/0x5bf8706fdac8bedc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x652b547cf44d65fe expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574068.376029:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85d20d6400/0x5bf8706fdac8bedc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d65fe expref: 6 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574068.376041:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85d20d6400/0x5bf8706fdac8bedc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d65fe expref: 6 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574068.376049:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d20d6400, rc 0) 00000100:00100000:0.0:1788574068.376123:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c820f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+6:6149:x1875455668912384:12345-192.168.204.51@tcp:101: Request processed in 175us (1532us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574068.376130:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 182 00000100:00100000:1.0:1788574068.379250:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574068.379629:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668912640 00000100:00100000:0.0:1788574068.379639:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668912640 00000100:00100000:0.0:1788574068.379697:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 183 00000100:00100000:0.0:1788574068.379706:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c820c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+6:6149:x1875455668912640:12345-192.168.204.51@tcp:501: 00000100:00100000:0.0:1788574068.379827:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c820c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+6:6149:x1875455668912640:12345-192.168.204.51@tcp:501: Request processed in 121us (585us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788574068.379848:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 183 00000100:00100000:1.0:1788574068.388679:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574068.388899:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668912768 00000100:00100000:3.0:1788574068.388910:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668912768 00000100:00100000:0.0:1788574068.389322:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 184 00000100:00100000:0.0:1788574068.389336:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c820ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+6:6149:x1875455668912768:12345-192.168.204.51@tcp:101: 00010000:00010000:0.0:1788574068.389353:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574068.389370:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85d20d6600/0x5bf8706fdac8bee3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6605 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574068.389398:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85d20d6600/0x5bf8706fdac8bee3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6605 expref: 7 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574068.389433:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85d20d6600/0x5bf8706fdac8bee3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6605 expref: 7 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574068.389442:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d20d6600, rc 0) 00000100:00100000:0.0:1788574068.389635:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c820ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+7:6149:x1875455668912768:12345-192.168.204.51@tcp:101: Request processed in 302us (965us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574068.389644:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 184 00000100:00100000:1.0:1788574068.395795:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574068.395933:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668912896 00000100:00100000:2.0:1788574068.395943:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668912896 00000100:00100000:2.0:1788574068.396042:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 185 00000100:00100000:2.0:1788574068.396052:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c820fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+7:6149:x1875455668912896:12345-192.168.204.51@tcp:501: 00000100:00100000:2.0:1788574068.396414:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c820fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+8:6149:x1875455668912896:12345-192.168.204.51@tcp:501: Request processed in 362us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574068.396423:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 185 00000100:00100000:1.0:1788574068.409545:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574068.409856:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668913024 00000100:00100000:0.0:1788574068.409867:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668913024 00000100:00100000:0.0:1788574068.409926:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 186 00000100:00100000:0.0:1788574068.409936:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c820cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+8:6149:x1875455668913024:12345-192.168.204.51@tcp:503: 00000100:00100000:0.0:1788574068.410106:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c820cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+8:6149:x1875455668913024:12345-192.168.204.51@tcp:503: Request processed in 170us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574068.410114:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 186 00000100:00100000:1.0:1788574068.421055:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574068.421308:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668913152 00000100:00100000:2.0:1788574068.421319:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668913152 00000100:00100000:2.0:1788574068.421424:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 187 00000100:00100000:2.0:1788574068.421434:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c820e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+8:6168:x1875455668913152:12345-192.168.204.51@tcp:502: 00000100:00100000:2.0:1788574068.421613:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c820e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+8:6168:x1875455668913152:12345-192.168.204.51@tcp:502: Request processed in 168us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574068.421621:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 187 00000100:00100000:1.0:1788574068.473066:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574068.473580:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668913280 00000100:00100000:3.0:1788574068.473591:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668913280 00000100:00100000:3.0:1788574068.473662:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 188 00000100:00100000:3.0:1788574068.473673:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c820c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+8:6168:x1875455668913280:12345-192.168.204.51@tcp:502: 00000100:00100000:3.0:1788574068.476992:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c820c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+8:6168:x1875455668913280:12345-192.168.204.51@tcp:502: Request processed in 3310us (3925us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574068.477007:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 188 00000100:00100000:1.0:1788574068.486481:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574068.488648:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668913408 00000100:00100000:2.0:1788574068.488666:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668913408 00000100:00100000:2.0:1788574068.488744:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 189 00000100:00100000:2.0:1788574068.488755:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c820c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+8:6149:x1875455668913408:12345-192.168.204.51@tcp:101: 00010000:00010000:2.0:1788574068.488779:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574068.488798:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85fa32e200/0x5bf8706fdac8beea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6636 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574068.488841:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85fa32e200/0x5bf8706fdac8beea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6636 expref: 9 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574068.488853:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85fa32e200/0x5bf8706fdac8beea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6636 expref: 9 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574068.488862:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85fa32e200, rc 0) 00000100:00100000:2.0:1788574068.488933:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c820c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+9:6149:x1875455668913408:12345-192.168.204.51@tcp:101: Request processed in 179us (2460us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574068.488941:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 189 00000100:00100000:1.0:1788574068.495566:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574068.495849:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668913536 00000100:00100000:3.0:1788574068.495860:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668913536 00000100:00100000:3.0:1788574068.495927:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 190 00000100:00100000:3.0:1788574068.495938:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c820e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+9:6149:x1875455668913536:12345-192.168.204.51@tcp:256: 20000000:01000000:3.0:1788574068.495964:0:6485:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788574068.495988:0:6485:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788574068.495993:0:6485:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788574068.495996:0:6485:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788574068.495998:0:6485:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1788574068.496000:0:6485:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:3.0:1788574068.502320:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c820e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+9:6149:x1875455668913536:12345-192.168.204.51@tcp:256: Request processed in 6374us (6755us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574068.502335:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 190 00000100:00100000:1.0:1788574068.506388:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574068.506831:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668913664 00000100:00100000:2.0:1788574068.506841:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668913664 00000100:00100000:2.0:1788574068.506898:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 191 00000100:00100000:2.0:1788574068.506909:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c820f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+9:6149:x1875455668913664:12345-192.168.204.51@tcp:101: 00010000:00010000:2.0:1788574068.506924:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574068.506939:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85fa32e000/0x5bf8706fdac8bef1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x652b547cf44d663d expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574068.506966:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85fa32e000/0x5bf8706fdac8bef1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d663d expref: 10 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574068.506978:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85fa32e000/0x5bf8706fdac8bef1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d663d expref: 10 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574068.506987:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85fa32e000, rc 0) 00000100:00100000:2.0:1788574068.507055:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c820f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+10:6149:x1875455668913664:12345-192.168.204.51@tcp:101: Request processed in 148us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574068.507076:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 191 00000100:00100000:0.0:1788574068.509647:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574068.509789:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668913792 00000100:00100000:3.0:1788574068.509800:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668913792 00000100:00100000:3.0:1788574068.509857:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 192 00000100:00100000:3.0:1788574068.509866:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c860022b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+10:6149:x1875455668913792:12345-192.168.204.51@tcp:501: 00000100:00100000:3.0:1788574068.510330:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c860022b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+10:6149:x1875455668913792:12345-192.168.204.51@tcp:501: Request processed in 463us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574068.510339:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 192 00000100:00100000:1.0:1788574068.512898:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574068.512994:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668913920 00000100:00100000:0.0:1788574068.513004:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668913920 00000100:00100000:0.0:1788574068.513406:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 193 00000100:00100000:0.0:1788574068.513419:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8600229850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+10:6149:x1875455668913920:12345-192.168.204.51@tcp:503: 00000100:00100000:0.0:1788574068.513578:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8600229850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+10:6149:x1875455668913920:12345-192.168.204.51@tcp:503: Request processed in 161us (689us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574068.513586:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 193 00000100:00100000:1.0:1788574068.521734:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574068.522002:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668914048 00000100:00100000:3.0:1788574068.522013:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668914048 00000100:00100000:3.0:1788574068.522185:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 194 00000100:00100000:3.0:1788574068.522232:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c860022b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+10:6172:x1875455668914048:12345-192.168.204.51@tcp:502: 00000100:00100000:3.0:1788574068.522395:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c860022b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+10:6172:x1875455668914048:12345-192.168.204.51@tcp:502: Request processed in 165us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574068.522404:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 194 00000100:00100000:1.0:1788574068.531792:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574068.531943:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668914176 00000100:00100000:0.0:1788574068.531955:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668914176 00000100:00100000:0.0:1788574068.532017:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 195 00000100:00100000:0.0:1788574068.532027:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5676450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+10:6172:x1875455668914176:12345-192.168.204.51@tcp:502: 00000100:00100000:0.0:1788574068.532212:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5676450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+10:6172:x1875455668914176:12345-192.168.204.51@tcp:502: Request processed in 186us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574068.532221:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 195 00000100:00100000:1.0:1788574068.553311:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574068.553345:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574068.553444:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668914304 00000100:00100000:2.0:1788574068.553455:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668914304 00000100:00100000:2.0:1788574068.553498:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668914560 00000100:00100000:2.0:1788574068.553501:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668914560 00000100:00100000:2.0:1788574068.553534:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 7 00000100:00100000:2.0:1788574068.553542:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa0e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2392:x1875455668914304:12345-192.168.204.51@tcp:38: 00010000:00080000:2.0:1788574068.553571:0:6493:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 659467ff-94af-418e-92fe-11e4323a48aa@192.168.204.51@tcp t0 exp 0000000000000000 cur 208 last 0 00000020:00000080:2.0:1788574068.553638:0:6493:0:(genops.c:1385:class_connect()) connect: client 659467ff-94af-418e-92fe-11e4323a48aa, cookie 0x5bf8706fdac8bef8 00000004:00100000:2.0:1788574068.553664:0:6493:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788574068.553908:0:6493:0:(import.c:65:import_set_state_nolock()) ffff9c84c1be9800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788574068.553982:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa0e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+6:2392:x1875455668914304:12345-192.168.204.51@tcp:38: Request processed in 439us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574068.553990:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 7 00000100:00100000:2.0:1788574068.554010:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 8 00000100:00100000:2.0:1788574068.554014:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c365b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2392:x1875455668914560:12345-192.168.204.51@tcp:38: 00010000:00080000:2.0:1788574068.554028:0:6493:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 659467ff-94af-418e-92fe-11e4323a48aa@192.168.204.51@tcp t0 exp 0000000000000000 cur 208 last 0 00000020:00000080:2.0:1788574068.554079:0:6493:0:(genops.c:1385:class_connect()) connect: client 659467ff-94af-418e-92fe-11e4323a48aa, cookie 0x5bf8706fdac8beff 00000004:00100000:2.0:1788574068.554092:0:6493:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788574068.554307:0:6493:0:(import.c:65:import_set_state_nolock()) ffff9c85faf2e000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788574068.554333:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c365b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+6:2392:x1875455668914560:12345-192.168.204.51@tcp:38: Request processed in 317us (987us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574068.554339:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 8 00010000:00010000:0.0:1788574069.396961:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574069.561799:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574069.561846:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574069.562015:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668914688 00000100:00100000:0.0:1788574069.562025:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668914688 00000100:00100000:0.0:1788574069.562111:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668914432 00000100:00100000:0.0:1788574069.562115:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668914432 00000100:00100000:0.0:1788574069.562150:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 9 00000100:00100000:0.0:1788574069.562160:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3658a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+6:0:x1875455668914688:12345-192.168.204.51@tcp:41: 00000004:00000024:0.0:1788574069.562231:0:6494:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788574069.562294:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3658a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+6:0:x1875455668914688:12345-192.168.204.51@tcp:41: Request processed in 135us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574069.562302:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 9 00000100:00100000:0.0:1788574069.562319:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 10 00000100:00100000:0.0:1788574069.562326:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c365aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+6:0:x1875455668914432:12345-192.168.204.51@tcp:41: 00000004:00000024:0.0:1788574069.562344:0:6494:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1788574069.562370:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c365aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+6:0:x1875455668914432:12345-192.168.204.51@tcp:41: Request processed in 44us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574069.562377:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 10 00000100:00080000:3.0:1788574069.562436:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788574069.562440:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788574069.565384:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574069.566919:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668914816 00000100:00100000:0.0:1788574069.566933:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668914816 00000100:00100000:0.0:1788574069.567019:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 11 00000100:00100000:0.0:1788574069.567029:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de939500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+6:6149:x1875455668914816:12345-192.168.204.51@tcp:41: 00000004:00000024:0.0:1788574069.567077:0:6494:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1788574069.567161:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de939500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+6:6149:x1875455668914816:12345-192.168.204.51@tcp:41: Request processed in 133us (1784us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574069.567183:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 11 00000100:00100000:1.0:1788574069.571400:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574069.572239:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668914944 00000100:00100000:0.0:1788574069.572250:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668914944 00000100:00100000:0.0:1788574069.572375:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 12 00000100:00100000:0.0:1788574069.572386:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3658000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+6:6149:x1875455668914944:12345-192.168.204.51@tcp:40: 00000100:00100000:0.0:1788574069.572560:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3658000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+6:6149:x1875455668914944:12345-192.168.204.51@tcp:40: Request processed in 175us (1170us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574069.572568:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 12 00000100:00100000:1.0:1788574069.575793:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574069.576818:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668915072 00000100:00100000:0.0:1788574069.576831:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668915072 00000100:00100000:0.0:1788574069.576887:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 16 00000100:00100000:0.0:1788574069.576894:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c365b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2392:x1875455668915072:12345-192.168.204.51@tcp:8: 00010000:00080000:0.0:1788574069.576928:0:8409:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 659467ff-94af-418e-92fe-11e4323a48aa@192.168.204.51@tcp t0 exp 0000000000000000 cur 209 last 0 00000020:00000080:0.0:1788574069.576960:0:8409:0:(genops.c:1385:class_connect()) connect: client 659467ff-94af-418e-92fe-11e4323a48aa, cookie 0x5bf8706fdac8bf06 00002000:00100000:0.0:1788574069.576972:0:8409:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 659467ff-94af-418e-92fe-11e4323a48aa/ffff9c84c3024800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788574069.576990:0:8409:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1788574069.577806:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574069.577914:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668915328 00000100:00100000:3.0:1788574069.577921:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668915328 00000100:00100000:3.0:1788574069.577968:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 196 00000100:00100000:3.0:1788574069.577974:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5674450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+10:2395:x1875455668915328:12345-192.168.204.51@tcp:400: 00000100:00100000:3.0:1788574069.578050:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5674450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+10:2395:x1875455668915328:12345-192.168.204.51@tcp:400: Request processed in 76us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574069.578056:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 196 00002000:00080000:0.0:1788574069.578892:0:8409:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788574069.578928:0:8409:0:(import.c:65:import_set_state_nolock()) ffff9c84c3020000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788574069.579450:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c365b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:659467ff-94af-418e-92fe-11e4323a48aa+6:2392:x1875455668915072:12345-192.168.204.51@tcp:8: Request processed in 2553us (3667us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574069.579460:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 16 00000100:00100000:2.0:1788574069.581251:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574069.581654:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574069.581724:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668915456 00000100:00100000:2.0:1788574069.581735:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668915456 00000100:00100000:2.0:1788574069.581790:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 4 00000100:00100000:2.0:1788574069.581800:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3659c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:659467ff-94af-418e-92fe-11e4323a48aa+6:6149:x1875455668915456:12345-192.168.204.51@tcp:900: 00000100:00100000:2.0:1788574069.581880:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3659c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:659467ff-94af-418e-92fe-11e4323a48aa+6:6149:x1875455668915456:12345-192.168.204.51@tcp:900: Request processed in 82us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574069.581887:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 4 00000100:00100000:0.0:1788574069.582381:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668915200 00000100:00100000:0.0:1788574069.582388:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668915200 00000100:00100000:0.0:1788574069.582460:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 17 00000100:00100000:0.0:1788574069.582466:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de93aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2392:x1875455668915200:12345-192.168.204.51@tcp:8: 00010000:00080000:0.0:1788574069.582505:0:8411:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 659467ff-94af-418e-92fe-11e4323a48aa@192.168.204.51@tcp t0 exp 0000000000000000 cur 209 last 0 00000020:00000080:0.0:1788574069.582534:0:8411:0:(genops.c:1385:class_connect()) connect: client 659467ff-94af-418e-92fe-11e4323a48aa, cookie 0x5bf8706fdac8bf0d 00002000:00100000:0.0:1788574069.582546:0:8411:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 659467ff-94af-418e-92fe-11e4323a48aa/ffff9c84c3026800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788574069.582563:0:8411:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788574069.582749:0:8411:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788574069.582778:0:8411:0:(import.c:65:import_set_state_nolock()) ffff9c84c3027000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788574069.582832:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de93aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:659467ff-94af-418e-92fe-11e4323a48aa+6:2392:x1875455668915200:12345-192.168.204.51@tcp:8: Request processed in 364us (1589us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574069.582839:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 17 00000100:00100000:1.0:1788574069.586777:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574069.586912:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668915584 00000100:00100000:2.0:1788574069.586921:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668915584 00000100:00100000:2.0:1788574069.587012:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 0 00000100:00100000:2.0:1788574069.587023:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3658380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:659467ff-94af-418e-92fe-11e4323a48aa+6:6149:x1875455668915584:12345-192.168.204.51@tcp:33: 00000004:00080000:1.0:1788574069.623368:0:6495:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 36248us 00000004:00200000:1.0:1788574069.638992:0:6495:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1788574069.639109:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3658380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:659467ff-94af-418e-92fe-11e4323a48aa+6:6149:x1875455668915584:12345-192.168.204.51@tcp:33: Request processed in 52082us (52336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574069.639156:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 0 00000100:00100000:2.0:1788574069.825623:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574069.826013:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668915712 00000100:00100000:0.0:1788574069.826087:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668915712 00000100:00100000:0.0:1788574069.826245:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 13 00000100:00100000:0.0:1788574069.826257:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de93b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+6:6190:x1875455668915712:12345-192.168.204.51@tcp:101: 00010000:00010000:0.0:1788574069.826279:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574069.826363:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8bf14 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d666e expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574069.826437:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217fa00/0x5bf8706fdac8bf1b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574069.826452:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217fa00/0x5bf8706fdac8bf1b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574069.826467:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217fa00/0x5bf8706fdac8bf1b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788574069.827110:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788574069.827128:0:6494:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788574069.827150:0:6494:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217fa00/0x5bf8706fdac8bf1b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574069.827311:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8bf14 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d666e expref: 8 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574069.827333:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217fa00/0x5bf8706fdac8bf1b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d666e expref: 7 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574069.827342:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c85c6b83700) 00010000:00010000:0.0:1788574069.827346:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788574069.827349:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c860217fa00, rc 0) 00000100:00100000:0.0:1788574069.827458:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de93b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+7:6190:x1875455668915712:12345-192.168.204.51@tcp:101: Request processed in 1204us (1845us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574069.827466:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 13 00010000:00010000:3.0:1788574070.420214:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574070.421415:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788574070.421441:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85de93a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681547648:0@lo:41: 00000100:00100000:3.0:1788574070.421719:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574070.421868:0:7533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681547648 00000100:00100000:2.0:1788574070.421876:0:7533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681547648 00000100:00100000:2.0:1788574070.421938:0:7533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788574070.421948:0:7533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681547648:12345-0@lo:41: 00000004:00000024:2.0:1788574070.422162:0:7533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1788574070.422243:0:7533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681547648:12345-0@lo:41: Request processed in 296us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574070.422250:0:7533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788574070.422295:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85de93a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681547648:0@lo:41: 00010000:00010000:0.0:1788574071.444732:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574071.955430:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2336300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681547904:0@lo:13: 00000100:00100000:0.0:1788574071.955519:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574071.955588:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3659180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681547776:0@lo:41: 00000100:00100000:2.0:1788574071.955618:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85de93a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681548032:0@lo:13: 00000100:00100000:3.0:1788574071.955633:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574071.955725:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574071.955879:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681547904 00000100:00100000:3.0:1788574071.955899:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681547904 00000100:00100000:1.0:1788574071.955930:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681548032 00000100:00100000:1.0:1788574071.955937:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681548032 00000100:00100000:3.0:1788574071.955964:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788574071.955976:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c300a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681547904:12345-0@lo:13: 00002000:00000024:3.0:1788574071.956007:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788574071.956060:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c300a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681547904:12345-0@lo:13: Request processed in 87us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574071.956067:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788574071.956084:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788574071.956090:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de939c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681548032:12345-0@lo:13: 00002000:00000024:3.0:1788574071.956100:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788574071.956130:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de939c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681548032:12345-0@lo:13: Request processed in 41us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574071.956136:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1788574071.956171:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85de93a680 x1875455681548032/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574087 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1788574071.956214:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c2336300 x1875455681547904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574087 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574071.956218:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85de93a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681548032:0@lo:13: 00000100:00100000:1.0:1788574071.956236:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2336300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681547904:0@lo:13: 00000100:00080000:2.0:1788574071.956513:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788574071.956792:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681547776 00000100:00100000:0.0:1788574071.956798:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681547776 00000100:00100000:0.0:1788574071.957153:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788574071.957163:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681547776:12345-0@lo:41: 00000004:00000024:0.0:1788574071.957217:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788574071.957273:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681547776:12345-0@lo:41: Request processed in 112us (1640us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574071.957280:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788574071.957355:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3659180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681547776:0@lo:41: 00000100:00100000:0.0:1788574072.073829:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574072.074058:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668915840 00000100:00100000:2.0:1788574072.074069:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668915840 00000100:00100000:2.0:1788574072.074159:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 14 00000100:00100000:2.0:1788574072.074171:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c300b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+7:6242:x1875455668915840:12345-192.168.204.51@tcp:41: 00000004:00000024:2.0:1788574072.074242:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1788574072.074317:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c300b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+7:6242:x1875455668915840:12345-192.168.204.51@tcp:41: Request processed in 149us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574072.074325:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 14 00000100:00080000:3.0:1788574072.074590:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788574072.078407:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574072.078555:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668915968 00000100:00100000:3.0:1788574072.078566:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668915968 00000100:00080000:2.0:1788574072.078704:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788574072.078749:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 15 00000100:00100000:3.0:1788574072.078761:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3659f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+6:6242:x1875455668915968:12345-192.168.204.51@tcp:41: 00000004:00000024:3.0:1788574072.078799:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788574072.078865:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3659f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+6:6242:x1875455668915968:12345-192.168.204.51@tcp:41: Request processed in 106us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574072.078873:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 15 00000100:00100000:1.0:1788574072.083252:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574072.083387:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668916096 00000100:00100000:2.0:1788574072.083397:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668916096 00000100:00100000:2.0:1788574072.083476:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 18 00000100:00100000:2.0:1788574072.083486:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c365b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:659467ff-94af-418e-92fe-11e4323a48aa+6:6242:x1875455668916096:12345-192.168.204.51@tcp:13: 00002000:00000024:2.0:1788574072.083520:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788574072.083639:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c365b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:659467ff-94af-418e-92fe-11e4323a48aa+6:6242:x1875455668916096:12345-192.168.204.51@tcp:13: Request processed in 154us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574072.083647:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 18 00000100:00080000:3.0:1788574072.086798:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788574072.087422:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574072.087516:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668916224 00000100:00100000:2.0:1788574072.087526:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668916224 00000100:00100000:2.0:1788574072.087610:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 19 00000100:00100000:2.0:1788574072.087621:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c365bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:659467ff-94af-418e-92fe-11e4323a48aa+6:6242:x1875455668916224:12345-192.168.204.51@tcp:13: 00002000:00000024:2.0:1788574072.087678:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788574072.087749:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c365bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:659467ff-94af-418e-92fe-11e4323a48aa+6:6242:x1875455668916224:12345-192.168.204.51@tcp:13: Request processed in 130us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574072.087757:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 19 00000100:00080000:3.0:1788574072.088024:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788574072.467596:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574072.980226:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3008e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681548160:0@lo:13: 00000100:00100000:0.0:1788574072.980226:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c300b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681548288:0@lo:13: 00000100:00100000:0.0:1788574072.980483:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574072.983141:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681548288 00000100:00100000:2.0:1788574072.983159:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681548288 00000100:00100000:2.0:1788574072.983258:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788574072.983269:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3008380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681548288:12345-0@lo:13: 00002000:00000024:2.0:1788574072.983313:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788574072.983395:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3008380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681548288:12345-0@lo:13: Request processed in 128us (2911us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574072.983403:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:0.0:1788574072.983842:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788574072.983892:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c300b480 x1875455681548288/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574088 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574072.983914:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c300b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681548288:0@lo:13: 00000100:00100000:3.0:1788574072.985165:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85de939880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:69505170-06bc-41d1-9626-ab1a3c7f32a0:3618:1875455681548416:0@lo:400: 00000100:00100000:3.0:1788574072.985271:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574072.985326:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3727480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681548928:0@lo:400: 00000100:00100000:3.0:1788574072.985358:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574072.985380:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3724000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681549440:0@lo:400: 00000100:00100000:3.0:1788574072.985406:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574072.985436:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788574072.985443:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fa32b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875455681548800:0@lo:400: 00000100:00100000:3.0:1788574072.985470:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574072.985489:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3724a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681549312:0@lo:400: 00000100:00100000:3.0:1788574072.985520:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574072.985552:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681548928 00000100:00100000:3.0:1788574072.985558:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681548928 00000100:00100000:3.0:1788574072.985604:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788574072.985613:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681548928:12345-0@lo:400: 00000100:00100000:3.0:1788574072.985665:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681548928:12345-0@lo:400: Request processed in 53us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574072.985672:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788574072.985701:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681549440 00000100:00100000:3.0:1788574072.985705:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681549440 00000100:00100000:3.0:1788574072.985737:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681549312 00000100:00100000:3.0:1788574072.985741:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681549312 00000100:00100000:3.0:1788574072.985767:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788574072.985773:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681549440:12345-0@lo:400: 00000100:00100000:3.0:1788574072.985807:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681549440:12345-0@lo:400: Request processed in 34us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574072.985821:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788574072.985833:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788574072.985839:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681549312:12345-0@lo:400: 00000100:00100000:2.0:1788574072.986030:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681548416 00000100:00100000:2.0:1788574072.986034:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681548416 00000100:00100000:2.0:1788574072.986076:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1788574072.986144:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5674050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:3618:x1875455681548416:12345-0@lo:400: 00000100:00100000:2.0:1788574072.986187:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5674050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:3618:x1875455681548416:12345-0@lo:400: Request processed in 103us (916us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574072.986213:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1788574072.986249:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681548800 00000100:00100000:2.0:1788574072.986254:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681548800 00000100:00100000:2.0:1788574072.986281:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788574072.986288:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875455681548800:12345-0@lo:400: 00000100:00100000:2.0:1788574072.986322:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875455681548800:12345-0@lo:400: Request processed in 35us (852us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574072.986329:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788574072.986363:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85de93a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875455681548544:0@lo:400: 00000100:00100000:2.0:1788574072.986396:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574072.986418:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3724380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3619:1875455681549056:0@lo:400: 00000100:00100000:2.0:1788574072.986440:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574072.986460:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3725c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1875455681549568:0@lo:400: 00000100:00100000:2.0:1788574072.986485:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574072.986505:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788574072.986522:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681548672:0@lo:400: 00000100:00100000:2.0:1788574072.986559:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574072.986579:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3727800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1875455681549184:0@lo:400: 00000100:00100000:2.0:1788574072.986597:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574072.986610:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3724700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1875455681549696:0@lo:400: 00000100:00100000:2.0:1788574072.986630:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574072.986650:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681548544 00000100:00100000:2.0:1788574072.986654:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681548544 00000100:00100000:2.0:1788574072.986670:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681549056 00000100:00100000:2.0:1788574072.986672:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681549056 00000100:00100000:2.0:1788574072.986693:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681549568 00000100:00100000:2.0:1788574072.986696:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681549568 00000100:00100000:2.0:1788574072.986706:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681549184 00000100:00100000:2.0:1788574072.986709:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681549184 00000100:00100000:2.0:1788574072.986720:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681549696 00000100:00100000:2.0:1788574072.986723:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681549696 00000100:00100000:2.0:1788574072.986734:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788574072.986740:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3726680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875455681548544:12345-0@lo:400: 00000100:00100000:2.0:1788574072.986775:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3726680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875455681548544:12345-0@lo:400: Request processed in 34us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574072.986781:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788574072.986792:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788574072.986799:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3726300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875455681549056:12345-0@lo:400: 00000100:00100000:2.0:1788574072.986825:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3726300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875455681549056:12345-0@lo:400: Request processed in 28us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574072.986831:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788574072.987441:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681549312:12345-0@lo:400: Request processed in 1600us (1928us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574072.987450:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788574072.987528:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788574072.987540:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3726d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875455681549568:12345-0@lo:400: 00000100:00100000:2.0:1788574072.987575:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3726d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875455681549568:12345-0@lo:400: Request processed in 39us (1088us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574072.987692:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00100000:1.0:1788574072.989100:0:9487:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 659467ff-94af-418e-92fe-11e4323a48aa 00000100:00080000:1.0:1788574072.989306:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788574072.989312:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788574072.989368:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788574072.989383:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3725880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875455681549184:12345-0@lo:400: 00000100:00100000:3.0:1788574072.989475:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3725880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875455681549184:12345-0@lo:400: Request processed in 97us (2875us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574072.989483:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788574072.989508:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788574072.989529:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3727100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875455681549696:12345-0@lo:400: 00000100:00100000:3.0:1788574072.989563:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3727100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875455681549696:12345-0@lo:400: Request processed in 38us (2932us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574072.989569:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788574072.989618:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fa32b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875455681548800:0@lo:400: 00010000:00080000:3.0:1788574072.989637:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3724a80 x1875455681549312/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574088 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574072.989647:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3724a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681549312:0@lo:400: 00000100:00100000:3.0:1788574072.989659:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85de939880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:69505170-06bc-41d1-9626-ab1a3c7f32a0:3618:1875455681548416:0@lo:400: 00000100:00100000:3.0:1788574072.989671:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3727480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681548928:0@lo:400: 00010000:00080000:3.0:1788574072.989681:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3724000 x1875455681549440/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574088 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574072.989697:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3724000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681549440:0@lo:400: 00000100:00100000:3.0:1788574072.989726:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788574072.989737:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3724e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681549824:0@lo:400: 00000100:00100000:3.0:1788574072.989773:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574072.989806:0:8815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681549824 00000100:00100000:3.0:1788574072.990960:0:8815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681549824 00000100:00100000:3.0:1788574072.991034:0:8815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788574072.991043:0:8815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681549824:12345-0@lo:400: 00000100:00100000:3.0:1788574072.991109:0:8815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681549824:12345-0@lo:400: Request processed in 68us (1335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574072.991116:0:8815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1788574072.991138:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788574072.991171:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3724e00 x1875455681549824/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574088 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574072.991184:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3724e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681549824:0@lo:400: 00000100:00100000:0.0:1788574072.991412:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681548672 00000100:00100000:0.0:1788574072.991419:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681548672 00000100:00100000:0.0:1788574072.991457:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788574072.991465:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3725f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681548672:12345-0@lo:400: 00000100:00100000:0.0:1788574072.991509:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3725f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681548672:12345-0@lo:400: Request processed in 44us (4948us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574072.991528:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788574072.991958:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788574072.992006:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681548672:0@lo:400: 00010000:00080000:2.0:1788574072.992021:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3727800 x1875455681549184/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574088 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574072.992030:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3727800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1875455681549184:0@lo:400: 00010000:00080000:2.0:1788574072.992041:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3724700 x1875455681549696/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574088 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574072.992048:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3724700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1875455681549696:0@lo:400: 00000100:00100000:2.0:1788574072.992061:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85de93a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875455681548544:0@lo:400: 00000100:00100000:2.0:1788574072.992073:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3724380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3619:1875455681549056:0@lo:400: 00000100:00100000:2.0:1788574072.992084:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3725c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1875455681549568:0@lo:400: 00000100:00100000:2.0:1788574072.992117:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681548160 00000100:00100000:2.0:1788574072.992122:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681548160 00000100:00100000:2.0:1788574072.992159:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788574072.992166:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3659180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681548160:12345-0@lo:13: 00002000:00000024:2.0:1788574072.992250:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788574072.992295:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3659180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681548160:12345-0@lo:13: Request processed in 129us (4603us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574072.992301:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:0.0:1788574072.995216:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3008e00 x1875455681548160/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574088 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574072.995246:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3008e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681548160:0@lo:13: 00010000:00010000:2.0:1788574073.492080:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788574074.008809:0:7422:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 659467ff-94af-418e-92fe-11e4323a48aa 00000001:00100000:2.0:1788574074.008888:0:6471:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 659467ff-94af-418e-92fe-11e4323a48aa 00010000:00010000:0.0:1788574074.515393:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788574074.650333:0:10158:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1788574074.951779:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574074.951896:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574074.952025:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668916608 00000100:00100000:3.0:1788574074.952036:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668916608 00000100:00100000:3.0:1788574074.952114:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 56 00000100:00100000:3.0:1788574074.952124:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c2336300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+5:2395:x1875455668916608:12345-192.168.204.51@tcp:400: 00000100:00080000:1.0:1788574074.952186:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788574074.952440:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c2336300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+5:2395:x1875455668916608:12345-192.168.204.51@tcp:400: Request processed in 317us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574074.952449:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 56 00000100:00100000:0.0:1788574074.952608:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668916352 00000100:00100000:0.0:1788574074.952614:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668916352 00000100:00100000:0.0:1788574074.952648:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 198 00000100:00100000:0.0:1788574074.952655:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5676050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+10:2395:x1875455668916352:12345-192.168.204.51@tcp:400: 00000100:00100000:0.0:1788574074.952683:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5676050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+10:2395:x1875455668916352:12345-192.168.204.51@tcp:400: Request processed in 30us (915us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574074.952689:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 198 00000100:00100000:1.0:1788574074.953377:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574074.953519:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668916480 00000100:00100000:0.0:1788574074.953533:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668916480 00000100:00100000:0.0:1788574074.953580:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 57 00000100:00100000:0.0:1788574074.953588:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601837b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+6:2396:x1875455668916480:12345-192.168.204.51@tcp:400: 00000100:00100000:0.0:1788574074.953627:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601837b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+6:2396:x1875455668916480:12345-192.168.204.51@tcp:400: Request processed in 40us (797us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574074.953634:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 57 00000100:00100000:0.0:1788574074.953738:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00080000:1.0:1788574074.953750:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788574074.953799:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668916864 00000100:00100000:2.0:1788574074.953804:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668916864 00000100:00100000:2.0:1788574074.953863:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 17 00000100:00100000:2.0:1788574074.953873:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3008e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:659467ff-94af-418e-92fe-11e4323a48aa+5:2395:x1875455668916864:12345-192.168.204.51@tcp:400: 00000100:00100000:0.0:1788574074.953881:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574074.953917:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3008e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:659467ff-94af-418e-92fe-11e4323a48aa+5:2395:x1875455668916864:12345-192.168.204.51@tcp:400: Request processed in 47us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574074.953926:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 17 00000100:00100000:2.0:1788574074.953938:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668916736 00000100:00100000:2.0:1788574074.953941:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668916736 00000100:00100000:2.0:1788574074.953973:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 18 00000100:00100000:2.0:1788574074.953980:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c300b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:659467ff-94af-418e-92fe-11e4323a48aa+6:2396:x1875455668916736:12345-192.168.204.51@tcp:400: 00000100:00100000:2.0:1788574074.954008:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c300b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:659467ff-94af-418e-92fe-11e4323a48aa+6:2396:x1875455668916736:12345-192.168.204.51@tcp:400: Request processed in 29us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574074.954015:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 18 00000100:00080000:1.0:1788574074.954090:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788574074.954093:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:1.0:1788574075.028774:0:8404:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 659467ff-94af-418e-92fe-11e4323a48aa 00000100:00100000:3.0:1788574075.539638:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3725c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681549952:0@lo:41: 00000100:00100000:3.0:1788574075.539741:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574075.539892:0:7533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681549952 00000100:00100000:2.0:1788574075.539912:0:7533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681549952 00000100:00100000:2.0:1788574075.539974:0:7533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788574075.539984:0:7533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681549952:12345-0@lo:41: 00000004:00000024:2.0:1788574075.540021:0:7533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1788574075.540084:0:7533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681549952:12345-0@lo:41: Request processed in 101us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574075.540091:0:7533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00010000:3.0:1788574075.540486:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574075.540525:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3725c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681549952:0@lo:41: 00010000:00010000:2.0:1788574076.563343:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574077.075595:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3008700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681550080:0@lo:13: 00000100:00100000:2.0:1788574077.075673:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574077.076214:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681550080 00000100:00100000:3.0:1788574077.076223:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681550080 00000100:00100000:3.0:1788574077.076289:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788574077.076299:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c8601836a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681550208:0@lo:41: 00000100:00100000:3.0:1788574077.076301:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3724380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681550080:12345-0@lo:13: 00002000:00000024:3.0:1788574077.076333:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788574077.076338:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574077.076379:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3724380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681550080:12345-0@lo:13: Request processed in 81us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574077.076385:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681550208 00000100:00100000:3.0:1788574077.076386:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788574077.076389:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681550208 00000100:00100000:1.0:1788574077.076415:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788574077.076421:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601837480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681550208:12345-0@lo:41: 00010000:00080000:3.0:1788574077.076454:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3008700 x1875455681550080/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574093 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000004:00000024:1.0:1788574077.076455:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788574077.076471:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3008700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681550080:0@lo:13: 00000100:00100000:1.0:1788574077.076486:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601837480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681550208:12345-0@lo:41: Request processed in 65us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574077.076492:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788574077.076535:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c8601836a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681550208:0@lo:41: 00000100:00080000:0.0:1788574077.076705:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788574077.076912:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788574077.081852:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3724700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681550336:0@lo:13: 00000100:00100000:3.0:1788574077.081935:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574077.082059:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681550336 00000100:00100000:2.0:1788574077.082069:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681550336 00000100:00100000:2.0:1788574077.082155:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788574077.082165:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681550336:12345-0@lo:13: 00002000:00000024:2.0:1788574077.082228:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788574077.082287:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681550336:12345-0@lo:13: Request processed in 124us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574077.082294:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:0.0:1788574077.082466:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788574077.082615:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3724700 x1875455681550336/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574093 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574077.082649:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3724700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681550336:0@lo:13: 00010000:00010000:0.0:1788574077.587441:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574078.099445:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3009500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681550464:0@lo:13: 00000100:00100000:0.0:1788574078.099527:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574078.099625:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681550464 00000100:00100000:0.0:1788574078.099634:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681550464 00000100:00100000:0.0:1788574078.099697:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788574078.099708:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3008a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681550464:12345-0@lo:13: 00002000:00000024:0.0:1788574078.099743:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788574078.099792:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3008a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681550464:12345-0@lo:13: Request processed in 86us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574078.099800:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1788574078.099824:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788574078.099853:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3009500 x1875455681550464/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574094 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574078.099870:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3009500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681550464:0@lo:13: 00000100:00100000:2.0:1788574078.100014:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3727800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681550592:0@lo:13: 00000100:00100000:2.0:1788574078.100048:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574078.100096:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681550592 00000100:00100000:2.0:1788574078.100100:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681550592 00000100:00100000:2.0:1788574078.100131:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788574078.100138:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3725500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681550592:12345-0@lo:13: 00002000:00000024:2.0:1788574078.100148:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788574078.100178:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3725500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681550592:12345-0@lo:13: Request processed in 40us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574078.100207:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1788574078.100228:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788574078.100250:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3727800 x1875455681550592/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574094 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574078.100264:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3727800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681550592:0@lo:13: 00000100:00100000:0.0:1788574078.100735:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c300a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875455681550848:0@lo:400: 00000100:00100000:0.0:1788574078.100773:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574078.100804:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3008700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1875455681551360:0@lo:400: 00000100:00100000:0.0:1788574078.100828:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574078.100845:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3721c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3617:1875455681551872:0@lo:400: 00000100:00100000:0.0:1788574078.100869:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574078.100889:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788574078.100907:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3008000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681550976:0@lo:400: 00000100:00100000:0.0:1788574078.100937:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574078.100956:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3723800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1875455681551488:0@lo:400: 00000100:00100000:0.0:1788574078.101169:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574078.101217:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3720700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1875455681552000:0@lo:400: 00000100:00100000:0.0:1788574078.101241:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574078.101267:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681550848 00000100:00100000:0.0:1788574078.101273:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681550848 00000100:00100000:0.0:1788574078.101302:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681551360 00000100:00100000:0.0:1788574078.101306:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681551360 00000100:00100000:0.0:1788574078.101329:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681551872 00000100:00100000:0.0:1788574078.101332:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681551872 00000100:00100000:0.0:1788574078.101346:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681551488 00000100:00100000:0.0:1788574078.101349:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681551488 00000100:00100000:0.0:1788574078.101359:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681552000 00000100:00100000:0.0:1788574078.101362:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681552000 00000100:00100000:0.0:1788574078.101392:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788574078.101400:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3720e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875455681550848:12345-0@lo:400: 00000100:00100000:0.0:1788574078.101470:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3720e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875455681550848:12345-0@lo:400: Request processed in 71us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574078.101477:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788574078.101493:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788574078.101499:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3722680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875455681551360:12345-0@lo:400: 00000100:00100000:0.0:1788574078.101535:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3722680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875455681551360:12345-0@lo:400: Request processed in 36us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574078.101541:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788574078.101553:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788574078.101558:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3722300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875455681551872:12345-0@lo:400: 00000100:00100000:0.0:1788574078.101596:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3722300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875455681551872:12345-0@lo:400: Request processed in 37us (726us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574078.101602:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788574078.101614:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788574078.101620:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3721f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875455681551488:12345-0@lo:400: 00000100:00100000:0.0:1788574078.101646:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3721f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875455681551488:12345-0@lo:400: Request processed in 26us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574078.101652:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788574078.101661:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788574078.101667:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3721880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875455681552000:12345-0@lo:400: 00000100:00100000:0.0:1788574078.101688:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3721880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875455681552000:12345-0@lo:400: Request processed in 22us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574078.101694:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788574078.102278:0:7533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681550976 00000100:00100000:2.0:1788574078.102285:0:7533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681550976 00000100:00100000:2.0:1788574078.102317:0:7533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788574078.102324:0:7533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3722d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681550976:12345-0@lo:400: 00000100:00100000:2.0:1788574078.102367:0:7533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3722d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681550976:12345-0@lo:400: Request processed in 44us (1430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574078.102373:0:7533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788574078.102402:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3009500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:69505170-06bc-41d1-9626-ab1a3c7f32a0:3620:1875455681550720:0@lo:400: 00000100:00100000:2.0:1788574078.102460:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574078.102498:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c300bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681551232:0@lo:400: 00000100:00100000:2.0:1788574078.102522:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574078.102543:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3720000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681551744:0@lo:400: 00000100:00100000:2.0:1788574078.102566:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574078.102589:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788574078.102596:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3009880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875455681551104:0@lo:400: 00000100:00100000:2.0:1788574078.102618:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574078.102637:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3720a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681551616:0@lo:400: 00000100:00100000:2.0:1788574078.102659:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574078.102690:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681550720 00000100:00100000:2.0:1788574078.102694:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681550720 00000100:00100000:2.0:1788574078.102724:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1788574078.102731:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5677850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:3620:x1875455681550720:12345-0@lo:400: 00000100:00100000:2.0:1788574078.102765:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5677850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:3620:x1875455681550720:12345-0@lo:400: Request processed in 34us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574078.102772:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1788574078.102798:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681551232 00000100:00100000:2.0:1788574078.102801:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681551232 00000100:00100000:2.0:1788574078.102822:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788574078.102827:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3727800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681551232:12345-0@lo:400: 00000100:00100000:2.0:1788574078.102857:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3727800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681551232:12345-0@lo:400: Request processed in 30us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574078.102864:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788574078.102881:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681551744 00000100:00100000:2.0:1788574078.102885:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681551744 00000100:00100000:3.0:1788574078.104512:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3008000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681550976:0@lo:400: 00010000:00080000:3.0:1788574078.104534:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3723800 x1875455681551488/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574094 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574078.104545:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3723800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1875455681551488:0@lo:400: 00010000:00080000:3.0:1788574078.104563:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3720700 x1875455681552000/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574094 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574078.104572:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3720700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1875455681552000:0@lo:400: 00000100:00100000:3.0:1788574078.104605:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c300a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875455681550848:0@lo:400: 00000100:00100000:3.0:1788574078.104616:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3008700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1875455681551360:0@lo:400: 00000100:00100000:3.0:1788574078.104633:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3721c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3617:1875455681551872:0@lo:400: 00000100:00100000:3.0:1788574078.104704:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681551616 00000100:00100000:3.0:1788574078.104710:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681551616 00000100:00100000:3.0:1788574078.104748:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788574078.104756:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3726a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681551616:12345-0@lo:400: 00000100:00100000:3.0:1788574078.104822:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3726a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681551616:12345-0@lo:400: Request processed in 66us (2161us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574078.104829:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788574078.104853:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681551104 00000100:00100000:3.0:1788574078.104857:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681551104 00000100:00100000:3.0:1788574078.104883:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788574078.104890:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3727b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875455681551104:12345-0@lo:400: 00000100:00100000:3.0:1788574078.104921:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3727b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875455681551104:12345-0@lo:400: Request processed in 31us (2301us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574078.104928:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:3.0:1788574078.104949:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788574078.104954:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788574078.105009:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3009880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875455681551104:0@lo:400: 00010000:00080000:3.0:1788574078.105022:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3720a80 x1875455681551616/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574094 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574078.105032:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3720a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681551616:0@lo:400: 00000100:00100000:3.0:1788574078.105043:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3009500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:69505170-06bc-41d1-9626-ab1a3c7f32a0:3620:1875455681550720:0@lo:400: 00000100:00100000:3.0:1788574078.105068:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c300bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681551232:0@lo:400: 00000100:00100000:2.0:1788574078.106300:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788574078.106330:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3725180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681551744:12345-0@lo:400: 00000100:00100000:2.0:1788574078.106424:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3725180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681551744:12345-0@lo:400: Request processed in 91us (3846us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574078.106431:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:2.0:1788574078.106480:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3720000 x1875455681551744/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574094 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574078.106492:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3720000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681551744:0@lo:400: 00010000:00010000:1.0:1788574078.617686:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788574078.650117:0:10305:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe0df09f40 20000000:00000080:1.0:1788574078.650133:0:10305:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c85faf0b800 uarg=0000000000000000 20000000:01000000:1.0:1788574078.650173:0:10305:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1788574078.650176:0:10305:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1788574078.650178:0:10305:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:1.0:1788574078.650182:0:10305:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:1.0:1788574078.650332:0:10305:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:1.0:1788574078.650398:0:10305:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788574078.650400:0:10305:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788574078.650833:0:10306:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:1.0:1788574078.651052:0:10305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:1.0:1788574078.651081:0:10305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:1.0:1788574078.651097:0:10305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:1.0:1788574078.651106:0:10305:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788574078.651108:0:10305:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788574078.651473:0:10307:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:1.0:1788574078.651630:0:10305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:1.0:1788574078.651651:0:10305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:1.0:1788574078.651667:0:10305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:1.0:1788574078.651677:0:10305:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788574078.651679:0:10305:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788574078.652060:0:10308:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:1.0:1788574078.652550:0:10305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:1.0:1788574078.652578:0:10305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:1.0:1788574078.652592:0:10305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:1.0:1788574078.652603:0:10305:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1788574078.652605:0:10305:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788574078.653850:0:10309:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:1.0:1788574078.654046:0:10305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:1.0:1788574078.654086:0:10305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:1.0:1788574078.654099:0:10305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:1.0:1788574078.654109:0:10305:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1788574078.654114:0:10305:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788574078.654580:0:10310:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:1.0:1788574078.654719:0:10305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:1.0:1788574078.654818:0:10305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:1.0:1788574078.654830:0:10305:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 10000000:01000000:1.0:1788574078.654841:0:10305:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788574078.654860:0:10305:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c85faea3e00/0x5bf8706fdac8bf22 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574078.654877:0:10305:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c85c152f200/0x5bf8706fdac8bdbd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8bdb6 expref: 23 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574078.654886:0:10305:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c85faea3400/0x5bf8706fdac8bde7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8bde0 expref: 23 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574078.654893:0:10305:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c85fa32e600/0x5bf8706fdac8be26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8be1f expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574078.654898:0:10305:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c85d20d7e00/0x5bf8706fdac8be34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8be2d expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574078.654905:0:10305:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c85d20d7400/0x5bf8706fdac8be42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8be3b expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574078.654910:0:10305:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c85c152e000/0x5bf8706fdac8be5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8be57 expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574078.654916:0:10305:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c85faea3c00/0x5bf8706fdac8be88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8be81 expref: 23 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574078.654922:0:10305:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c85fa32fe00/0x5bf8706fdac8bea4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8be9d expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574078.654938:0:10305:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c85fa32ee00/0x5bf8706fdac8bece lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8bec7 expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574078.654946:0:10305:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c85d20d6400/0x5bf8706fdac8bedc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d65fe expref: 9 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574078.654952:0:10305:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c85d20d6600/0x5bf8706fdac8bee3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6605 expref: 9 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574078.654959:0:10305:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c85faea3e00/0x5bf8706fdac8bf22 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574078.654995:0:10305:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c85d20d6600/0x5bf8706fdac8bee3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6605 expref: 9 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574078.655010:0:10305:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c85d20d6600/0x5bf8706fdac8bee3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6605 expref: 9 pid: 6486 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574078.655025:0:10305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c8601836a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10305:1875455681552128:192.168.204.51@tcp:104: 00010000:00010000:1.0:1788574078.655174:0:10305:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c85d20d6400/0x5bf8706fdac8bedc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d65fe expref: 9 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574078.655183:0:10305:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c85d20d6400/0x5bf8706fdac8bedc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d65fe expref: 9 pid: 6487 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574078.655223:0:10305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c8601834380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10305:1875455681552256:192.168.204.51@tcp:104: 00010000:00010000:1.0:1788574078.655256:0:10305:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c85fa32ee00/0x5bf8706fdac8bece lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5bf8706fdac8bec7 expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574078.655275:0:10305:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c85fa32ee00/0x5bf8706fdac8bece lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5bf8706fdac8bec7 expref: 23 pid: 6485 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574078.655284:0:10305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c8601837800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10305:1875455681552384:0@lo:104: 00000100:00100000:1.0:1788574078.655325:0:10305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788574078.655357:0:10305:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c85fa32fe00/0x5bf8706fdac8bea4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5bf8706fdac8be9d expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574078.655365:0:10305:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c85fa32fe00/0x5bf8706fdac8bea4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5bf8706fdac8be9d expref: 23 pid: 6485 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574078.655372:0:10305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c8601834000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10305:1875455681552512:0@lo:104: 00000100:00100000:1.0:1788574078.655390:0:10305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788574078.655428:0:10305:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c85faea3c00/0x5bf8706fdac8be88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5bf8706fdac8be81 expref: 23 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574078.655436:0:10305:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c85faea3c00/0x5bf8706fdac8be88 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5bf8706fdac8be81 expref: 23 pid: 6487 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574078.655445:0:10305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c8601834700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10305:1875455681552640:0@lo:104: 00000100:00100000:1.0:1788574078.655463:0:10305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788574078.655480:0:10305:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c85c152e000/0x5bf8706fdac8be5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5bf8706fdac8be57 expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574078.655487:0:10305:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c85c152e000/0x5bf8706fdac8be5e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5bf8706fdac8be57 expref: 23 pid: 6486 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574078.655494:0:10305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c8601836680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10305:1875455681552768:0@lo:104: 00000100:00100000:1.0:1788574078.655529:0:10305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788574078.655555:0:10305:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c85d20d7400/0x5bf8706fdac8be42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5bf8706fdac8be3b expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574078.655562:0:10305:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c85d20d7400/0x5bf8706fdac8be42 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5bf8706fdac8be3b expref: 23 pid: 6485 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574078.655570:0:10305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c8601836300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10305:1875455681552896:0@lo:104: 00010000:00010000:1.0:1788574078.655592:0:10305:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c85d20d7e00/0x5bf8706fdac8be34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5bf8706fdac8be2d expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574078.655598:0:10305:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c85d20d7e00/0x5bf8706fdac8be34 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5bf8706fdac8be2d expref: 23 pid: 6485 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574078.655605:0:10305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c8601836d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10305:1875455681553024:0@lo:104: 00010000:00010000:1.0:1788574078.655626:0:10305:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c85fa32e600/0x5bf8706fdac8be26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5bf8706fdac8be1f expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574078.655633:0:10305:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c85fa32e600/0x5bf8706fdac8be26 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5bf8706fdac8be1f expref: 23 pid: 6486 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574078.655640:0:10305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c8601835f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10305:1875455681553152:0@lo:104: 00010000:00010000:1.0:1788574078.655663:0:10305:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c85faea3400/0x5bf8706fdac8bde7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5bf8706fdac8bde0 expref: 23 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574078.655669:0:10305:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c85faea3400/0x5bf8706fdac8bde7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5bf8706fdac8bde0 expref: 23 pid: 6487 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574078.655675:0:10305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c8601835880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10305:1875455681553280:0@lo:104: 00010000:00010000:1.0:1788574078.655692:0:10305:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c85c152f200/0x5bf8706fdac8bdbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5bf8706fdac8bdb6 expref: 23 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574078.655704:0:10305:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c85c152f200/0x5bf8706fdac8bdbd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5bf8706fdac8bdb6 expref: 23 pid: 6487 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574078.655712:0:10305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c8601837100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10305:1875455681553408:0@lo:104: 00000100:00100000:3.0:1788574078.655855:0:6475:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788574078.655911:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681552384 00000100:00100000:0.0:1788574078.655918:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681552384 00000100:00100000:0.0:1788574078.655956:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681552512 00000100:00100000:0.0:1788574078.655958:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681552512 00000100:00100000:0.0:1788574078.655967:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681552640 00000100:00100000:0.0:1788574078.655969:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681552640 00000100:00100000:0.0:1788574078.655978:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681552768 00000100:00100000:0.0:1788574078.655980:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681552768 00000100:00100000:0.0:1788574078.655993:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788574078.656000:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601834a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:69505170-06bc-41d1-9626-ab1a3c7f32a0+6:10305:x1875455681552384:12345-0@lo:104: 00010000:00010000:0.0:1788574078.656019:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff9c85faea3200/0x5bf8706fdac8bec7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8bece expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574078.656162:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574078.656177:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574078.656184:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574078.656213:0:6475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574078.656221:0:6475:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:3.0:1788574078.656227:0:6475:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:3.0:1788574078.656322:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681552896 00000100:00100000:3.0:1788574078.656327:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681552896 00000100:00100000:3.0:1788574078.656345:0:6475:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:3.0:1788574078.656350:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681553024 00000100:00100000:3.0:1788574078.656352:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681553024 00000100:00100000:3.0:1788574078.656359:0:6475:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:3.0:1788574078.656363:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681553152 00000100:00100000:3.0:1788574078.656365:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681553152 00000100:00100000:3.0:1788574078.656373:0:6475:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:3.0:1788574078.656376:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681553280 00000100:00100000:3.0:1788574078.656379:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681553280 00000100:00100000:3.0:1788574078.656454:0:10311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788574078.656461:0:10311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601835c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:69505170-06bc-41d1-9626-ab1a3c7f32a0+10:10305:x1875455681552512:12345-0@lo:104: 00010000:00010000:3.0:1788574078.656470:0:10311:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6a00/0x5bf8706fdac8be9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8bea4 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574078.656524:0:10311:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788574078.656531:0:10311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601835c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:69505170-06bc-41d1-9626-ab1a3c7f32a0+10:10305:x1875455681552512:12345-0@lo:104: Request processed in 71us (1139us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574078.656543:0:10311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788574078.656559:0:10311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788574078.656564:0:10311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601834e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:69505170-06bc-41d1-9626-ab1a3c7f32a0+9:10305:x1875455681552640:12345-0@lo:104: 00010000:00010000:3.0:1788574078.656572:0:10311:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff9c85fa32ec00/0x5bf8706fdac8be81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8be88 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574078.656604:0:10311:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788574078.656609:0:10311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601834e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:69505170-06bc-41d1-9626-ab1a3c7f32a0+9:10305:x1875455681552640:12345-0@lo:104: Request processed in 45us (1144us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574078.656614:0:10311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788574078.656626:0:10311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788574078.656632:0:10311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601804450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:69505170-06bc-41d1-9626-ab1a3c7f32a0+8:10305:x1875455681552768:12345-0@lo:104: 00010000:00010000:3.0:1788574078.656640:0:10311:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6e00/0x5bf8706fdac8be57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8be5e expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574078.656673:0:10311:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788574078.656677:0:10311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601804450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:69505170-06bc-41d1-9626-ab1a3c7f32a0+8:10305:x1875455681552768:12345-0@lo:104: Request processed in 46us (1148us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574078.656682:0:10311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:3.0:1788574078.656697:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788574078.656702:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6a00/0x5bf8706fdac8be9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8bea4 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574078.656709:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d6a00 already unused, calling callback (ffffffffc1472c20) 10000000:00010000:3.0:1788574078.656714:0:6480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6a00/0x5bf8706fdac8be9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x5bf8706fdac8bea4 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574078.656818:0:6480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6a00/0x5bf8706fdac8be9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x5bf8706fdac8bea4 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788574078.656826:0:6480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6a00/0x5bf8706fdac8be9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x5bf8706fdac8bea4 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788574078.656832:0:6480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788574078.656869:0:6480:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6a00/0x5bf8706fdac8be9d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bea4 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574078.656875:0:6480:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788574078.656895:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6a00/0x5bf8706fdac8be9d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bea4 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574078.656904:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6a00/0x5bf8706fdac8be9d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bea4 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574078.656913:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788574078.656916:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c85fa32ec00/0x5bf8706fdac8be81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8be88 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574078.656921:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32ec00 already unused, calling callback (ffffffffc1472c20) 10000000:00010000:3.0:1788574078.656923:0:6480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c85fa32ec00/0x5bf8706fdac8be81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x5bf8706fdac8be88 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574078.656928:0:6480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c85fa32ec00/0x5bf8706fdac8be81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x5bf8706fdac8be88 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788574078.656933:0:6480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c85fa32ec00/0x5bf8706fdac8be81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x5bf8706fdac8be88 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788574078.656944:0:6480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788574078.656957:0:6480:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9c85fa32ec00/0x5bf8706fdac8be81 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8be88 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574078.656963:0:6480:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788574078.656968:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c85fa32ec00/0x5bf8706fdac8be81 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8be88 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574078.656974:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c85fa32ec00/0x5bf8706fdac8be81 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8be88 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574078.656981:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788574078.656984:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6e00/0x5bf8706fdac8be57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8be5e expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574078.656988:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d6e00 already unused, calling callback (ffffffffc1472c20) 10000000:00010000:3.0:1788574078.656990:0:6480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6e00/0x5bf8706fdac8be57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x5bf8706fdac8be5e expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574078.656996:0:6480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6e00/0x5bf8706fdac8be57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x5bf8706fdac8be5e expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788574078.657001:0:6480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6e00/0x5bf8706fdac8be57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x5bf8706fdac8be5e expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788574078.657006:0:6480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788574078.657015:0:6480:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6e00/0x5bf8706fdac8be57 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8be5e expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574078.657021:0:6480:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788574078.657043:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6e00/0x5bf8706fdac8be57 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8be5e expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574078.657050:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6e00/0x5bf8706fdac8be57 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8be5e expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574078.657058:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574078.657060:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574078.657062:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574078.657077:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69505170-06bc-41d1-9626-ab1a3c7f32a0:3619:1875455681553536:0@lo:103: 00000100:00100000:3.0:1788574078.657112:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574078.657148:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788574078.657154:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69505170-06bc-41d1-9626-ab1a3c7f32a0:3619:1875455681553664:0@lo:103: 00000100:00100000:3.0:1788574078.657175:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574078.657229:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:69505170-06bc-41d1-9626-ab1a3c7f32a0:3617:1875455681553792:0@lo:103: 00000100:00100000:3.0:1788574078.657254:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574078.657281:0:10311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788574078.657289:0:10311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:69505170-06bc-41d1-9626-ab1a3c7f32a0+7:10305:x1875455681552896:12345-0@lo:104: 00010000:00010000:3.0:1788574078.657297:0:10311:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff9c85faea3600/0x5bf8706fdac8be3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8be42 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574078.657341:0:10311:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788574078.657347:0:10311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:69505170-06bc-41d1-9626-ab1a3c7f32a0+7:10305:x1875455681552896:12345-0@lo:104: Request processed in 60us (1185us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574078.657353:0:10311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:3.0:1788574078.657368:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788574078.657372:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c85faea3600/0x5bf8706fdac8be3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8be42 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574078.657388:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85faea3600 already unused, calling callback (ffffffffc1472c20) 10000000:00010000:3.0:1788574078.657391:0:6480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c85faea3600/0x5bf8706fdac8be3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x5bf8706fdac8be42 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574078.657397:0:6480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c85faea3600/0x5bf8706fdac8be3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x5bf8706fdac8be42 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788574078.657414:0:6480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c85faea3600/0x5bf8706fdac8be3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x5bf8706fdac8be42 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788574078.657418:0:6480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788574078.657434:0:6480:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9c85faea3600/0x5bf8706fdac8be3b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8be42 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574078.657440:0:6480:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788574078.657450:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c85faea3600/0x5bf8706fdac8be3b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8be42 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574078.657455:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c85faea3600/0x5bf8706fdac8be3b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8be42 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574078.657463:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574078.657465:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574078.657467:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574078.657474:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788574078.657480:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c300bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:69505170-06bc-41d1-9626-ab1a3c7f32a0:3617:1875455681553920:0@lo:103: 00000100:00100000:3.0:1788574078.657502:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574078.657526:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681553536 00000100:00100000:3.0:1788574078.657531:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681553536 00010000:00010000:3.0:1788574078.657556:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c85fa32fe00/0x5bf8706fdac8bea4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8be9d expref: 24 pid: 6485 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574078.657571:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681553664 00000100:00100000:3.0:1788574078.657574:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681553664 00010000:00010000:3.0:1788574078.657582:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c85faea3c00/0x5bf8706fdac8be88 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8be81 expref: 25 pid: 6487 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574078.657590:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681553792 00000100:00100000:3.0:1788574078.657593:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681553792 00010000:00010000:3.0:1788574078.657602:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c85c152e000/0x5bf8706fdac8be5e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8be57 expref: 26 pid: 6486 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574078.657610:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681553920 00000100:00100000:3.0:1788574078.657612:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681553920 00010000:00010000:3.0:1788574078.657620:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c85d20d7400/0x5bf8706fdac8be42 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8be3b expref: 27 pid: 6485 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574078.657630:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788574078.657634:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e0b79050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:69505170-06bc-41d1-9626-ab1a3c7f32a0+27:3619:x1875455681553536:12345-0@lo:103: 00010000:00010000:3.0:1788574078.657644:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574078.657649:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c85fa32fe00/0x5bf8706fdac8bea4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8be9d expref: 27 pid: 6485 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574078.657658:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c85fa32fe00/0x5bf8706fdac8bea4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5bf8706fdac8be9d expref: 27 pid: 6485 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574078.657674:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788574078.657701:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e0b79050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:69505170-06bc-41d1-9626-ab1a3c7f32a0+27:3619:x1875455681553536:12345-0@lo:103: Request processed in 66us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574078.657707:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1788574078.657868:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788574078.657875:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601834a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:69505170-06bc-41d1-9626-ab1a3c7f32a0+6:10305:x1875455681552384:12345-0@lo:104: Request processed in 1875us (2550us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574078.657882:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788574078.657914:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788574078.657921:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf3f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:69505170-06bc-41d1-9626-ab1a3c7f32a0+5:10305:x1875455681553024:12345-0@lo:104: 00010000:00010000:0.0:1788574078.657929:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7200/0x5bf8706fdac8be2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8be34 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574078.657953:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788574078.657957:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf3f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:69505170-06bc-41d1-9626-ab1a3c7f32a0+5:10305:x1875455681553024:12345-0@lo:104: Request processed in 39us (1780us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574078.657962:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788574078.657976:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788574078.657982:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf3c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:69505170-06bc-41d1-9626-ab1a3c7f32a0+4:10305:x1875455681553152:12345-0@lo:104: 00010000:00010000:0.0:1788574078.657989:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff9c85fa32f400/0x5bf8706fdac8be1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8be26 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574078.658012:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788574078.658017:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf3c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:69505170-06bc-41d1-9626-ab1a3c7f32a0+4:10305:x1875455681553152:12345-0@lo:104: Request processed in 36us (1831us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574078.658022:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788574078.658033:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788574078.658039:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf3f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:69505170-06bc-41d1-9626-ab1a3c7f32a0+3:10305:x1875455681553280:12345-0@lo:104: 00010000:00010000:0.0:1788574078.658052:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff9c85c152e600/0x5bf8706fdac8bde0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8bde7 expref: -99 pid: 9485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574078.658078:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1788574078.658083:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf3f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:69505170-06bc-41d1-9626-ab1a3c7f32a0+3:10305:x1875455681553280:12345-0@lo:104: Request processed in 44us (1869us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574078.658089:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:0.0:1788574078.658107:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788574078.658111:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c85faea3200/0x5bf8706fdac8bec7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8bece expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574078.658117:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85faea3200 already unused, calling callback (ffffffffc1472c20) 10000000:00010000:0.0:1788574078.658120:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c85faea3200/0x5bf8706fdac8bec7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x5bf8706fdac8bece expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574078.658127:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c85faea3200/0x5bf8706fdac8bec7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x5bf8706fdac8bece expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788574078.658133:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c85faea3200/0x5bf8706fdac8bec7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x5bf8706fdac8bece expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788574078.658138:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788574078.658153:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9c85faea3200/0x5bf8706fdac8bec7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bece expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574078.658159:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788574078.658166:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c85faea3200/0x5bf8706fdac8bec7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bece expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574078.658172:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c85faea3200/0x5bf8706fdac8bec7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bece expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574078.658206:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788574078.658210:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7200/0x5bf8706fdac8be2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8be34 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574078.658215:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d7200 already unused, calling callback (ffffffffc1472c20) 10000000:00010000:0.0:1788574078.658218:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7200/0x5bf8706fdac8be2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5bf8706fdac8be34 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574078.658225:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7200/0x5bf8706fdac8be2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5bf8706fdac8be34 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788574078.658232:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7200/0x5bf8706fdac8be2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5bf8706fdac8be34 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788574078.658237:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788574078.658250:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7200/0x5bf8706fdac8be2d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8be34 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574078.658256:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788574078.658261:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7200/0x5bf8706fdac8be2d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8be34 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574078.658267:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7200/0x5bf8706fdac8be2d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8be34 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574078.658276:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788574078.658279:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c85fa32f400/0x5bf8706fdac8be1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8be26 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574078.658295:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32f400 already unused, calling callback (ffffffffc1472c20) 10000000:00010000:0.0:1788574078.658298:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c85fa32f400/0x5bf8706fdac8be1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5bf8706fdac8be26 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574078.658305:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c85fa32f400/0x5bf8706fdac8be1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5bf8706fdac8be26 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788574078.658311:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c85fa32f400/0x5bf8706fdac8be1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5bf8706fdac8be26 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788574078.658315:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788574078.658329:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9c85fa32f400/0x5bf8706fdac8be1f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8be26 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574078.658335:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788574078.658345:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c85fa32f400/0x5bf8706fdac8be1f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8be26 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574078.658351:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c85fa32f400/0x5bf8706fdac8be1f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8be26 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574078.658360:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788574078.658363:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c85c152e600/0x5bf8706fdac8bde0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8bde7 expref: -99 pid: 9485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574078.658368:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85c152e600 already unused, calling callback (ffffffffc1472c20) 10000000:00010000:0.0:1788574078.658371:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c85c152e600/0x5bf8706fdac8bde0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5bf8706fdac8bde7 expref: -99 pid: 9485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574078.658386:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c85c152e600/0x5bf8706fdac8bde0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5bf8706fdac8bde7 expref: -99 pid: 9485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788574078.658393:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c85c152e600/0x5bf8706fdac8bde0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5bf8706fdac8bde7 expref: -99 pid: 9485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788574078.658398:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788574078.658424:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9c85c152e600/0x5bf8706fdac8bde0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bde7 expref: -99 pid: 9485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574078.658431:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788574078.658435:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c85c152e600/0x5bf8706fdac8bde0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bde7 expref: -99 pid: 9485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574078.658442:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c85c152e600/0x5bf8706fdac8bde0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bde7 expref: -99 pid: 9485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574078.658451:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574078.658453:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574078.658454:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574078.658466:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3723b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:69505170-06bc-41d1-9626-ab1a3c7f32a0:3618:1875455681554432:0@lo:103: 00000100:00100000:0.0:1788574078.658494:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574078.658510:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788574078.658514:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3721180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:69505170-06bc-41d1-9626-ab1a3c7f32a0:3618:1875455681554304:0@lo:103: 00000100:00100000:0.0:1788574078.658534:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574078.658553:0:7433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681554432 00000100:00100000:0.0:1788574078.658557:0:7433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681554432 00010000:00010000:0.0:1788574078.658573:0:7433:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c85faea3400/0x5bf8706fdac8bde7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8bde0 expref: 28 pid: 6487 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574078.658600:0:7433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681554304 00000100:00100000:0.0:1788574078.658603:0:7433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681554304 00010000:00010000:0.0:1788574078.658615:0:7433:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c85fa32e600/0x5bf8706fdac8be26 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8be1f expref: 29 pid: 6486 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574078.658625:0:7433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788574078.658629:0:7433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf3c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:69505170-06bc-41d1-9626-ab1a3c7f32a0+29:3619:x1875455681553664:12345-0@lo:103: 00010000:00010000:0.0:1788574078.658637:0:7433:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574078.658641:0:7433:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c85faea3c00/0x5bf8706fdac8be88 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8be81 expref: 29 pid: 6487 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574078.658649:0:7433:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c85faea3c00/0x5bf8706fdac8be88 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5bf8706fdac8be81 expref: 29 pid: 6487 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574078.658662:0:7433:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574078.658685:0:7433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf3c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:69505170-06bc-41d1-9626-ab1a3c7f32a0+29:3619:x1875455681553664:12345-0@lo:103: Request processed in 56us (1510us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574078.658691:0:7433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788574078.658703:0:7433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788574078.658709:0:7433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:69505170-06bc-41d1-9626-ab1a3c7f32a0+28:3617:x1875455681553792:12345-0@lo:103: 00010000:00010000:0.0:1788574078.658716:0:7433:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574078.658806:0:7433:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c85c152e000/0x5bf8706fdac8be5e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8be57 expref: 28 pid: 6486 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574078.658815:0:7433:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c85c152e000/0x5bf8706fdac8be5e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5bf8706fdac8be57 expref: 28 pid: 6486 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574078.658825:0:7433:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574078.658854:0:7433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:69505170-06bc-41d1-9626-ab1a3c7f32a0+28:3617:x1875455681553792:12345-0@lo:103: Request processed in 146us (1599us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574078.658860:0:7433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788574078.658873:0:7433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788574078.658879:0:7433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3009500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:69505170-06bc-41d1-9626-ab1a3c7f32a0+27:3617:x1875455681553920:12345-0@lo:103: 00010000:00010000:0.0:1788574078.658887:0:7433:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574078.658891:0:7433:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c85d20d7400/0x5bf8706fdac8be42 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8be3b expref: 27 pid: 6485 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574078.658899:0:7433:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c85d20d7400/0x5bf8706fdac8be42 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5bf8706fdac8be3b expref: 27 pid: 6485 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574078.658909:0:7433:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574078.658929:0:7433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3009500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:69505170-06bc-41d1-9626-ab1a3c7f32a0+27:3617:x1875455681553920:12345-0@lo:103: Request processed in 50us (1425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574078.658934:0:7433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788574078.658947:0:7433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788574078.658952:0:7433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3722a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:69505170-06bc-41d1-9626-ab1a3c7f32a0+26:3618:x1875455681554432:12345-0@lo:103: 00010000:00010000:0.0:1788574078.658959:0:7433:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574078.658963:0:7433:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c85faea3400/0x5bf8706fdac8bde7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8bde0 expref: 26 pid: 6487 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574078.658971:0:7433:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c85faea3400/0x5bf8706fdac8bde7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5bf8706fdac8bde0 expref: 26 pid: 6487 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574078.658981:0:7433:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574078.659010:0:7433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3722a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:69505170-06bc-41d1-9626-ab1a3c7f32a0+26:3618:x1875455681554432:12345-0@lo:103: Request processed in 58us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574078.659016:0:7433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788574078.659033:0:7433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788574078.659038:0:7433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3723480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:69505170-06bc-41d1-9626-ab1a3c7f32a0+25:3618:x1875455681554304:12345-0@lo:103: 00010000:00010000:0.0:1788574078.659045:0:7433:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574078.659050:0:7433:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c85fa32e600/0x5bf8706fdac8be26 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8be1f expref: 25 pid: 6486 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574078.659056:0:7433:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c85fa32e600/0x5bf8706fdac8be26 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5bf8706fdac8be1f expref: 25 pid: 6486 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574078.659065:0:7433:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574078.659085:0:7433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3723480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:69505170-06bc-41d1-9626-ab1a3c7f32a0+25:3618:x1875455681554304:12345-0@lo:103: Request processed in 48us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574078.659090:0:7433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788574078.659128:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3721180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:69505170-06bc-41d1-9626-ab1a3c7f32a0:3618:1875455681554304:0@lo:103: 00000100:00100000:0.0:1788574078.659137:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3723b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:69505170-06bc-41d1-9626-ab1a3c7f32a0:3618:1875455681554432:0@lo:103: 00000100:00100000:0.0:1788574078.659165:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c300bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:69505170-06bc-41d1-9626-ab1a3c7f32a0:3617:1875455681553920:0@lo:103: 00000100:00100000:0.0:1788574078.659172:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:69505170-06bc-41d1-9626-ab1a3c7f32a0:3617:1875455681553792:0@lo:103: 00000100:00100000:1.0:1788574078.659262:0:10305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574078.659288:0:10305:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c3653c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788574078.659302:0:10305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c8601837800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10305:1875455681552384:0@lo:104: 00010000:00010000:1.0:1788574078.659313:0:10305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85fa32fe00/0x5bf8706fdac8bea4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5bf8706fdac8be9d expref: 24 pid: 6485 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574078.659323:0:10305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c8601834000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10305:1875455681552512:0@lo:104: 00010000:00010000:1.0:1788574078.659332:0:10305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85faea3c00/0x5bf8706fdac8be88 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5bf8706fdac8be81 expref: 23 pid: 6487 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574078.659339:0:10305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c8601834700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10305:1875455681552640:0@lo:104: 00010000:00010000:1.0:1788574078.659349:0:10305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85c152e000/0x5bf8706fdac8be5e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5bf8706fdac8be57 expref: 22 pid: 6486 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574078.659357:0:10305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c8601836680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10305:1875455681552768:0@lo:104: 00010000:00010000:1.0:1788574078.659365:0:10305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85d20d7400/0x5bf8706fdac8be42 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5bf8706fdac8be3b expref: 21 pid: 6485 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574078.659372:0:10305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c8601836300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10305:1875455681552896:0@lo:104: 00000100:00100000:1.0:1788574078.659380:0:10305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c8601836d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10305:1875455681553024:0@lo:104: 00010000:00010000:1.0:1788574078.659388:0:10305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85fa32e600/0x5bf8706fdac8be26 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5bf8706fdac8be1f expref: 20 pid: 6486 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574078.659421:0:10305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c8601835f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10305:1875455681553152:0@lo:104: 00010000:00010000:1.0:1788574078.659434:0:10305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85faea3400/0x5bf8706fdac8bde7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5bf8706fdac8bde0 expref: 19 pid: 6487 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574078.659442:0:10305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c8601835880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10305:1875455681553280:0@lo:104: 00000100:00100000:3.0:1788574078.659553:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681553408 00000100:00100000:3.0:1788574078.659560:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681553408 00000100:00100000:3.0:1788574078.659638:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788574078.659646:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601835500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:69505170-06bc-41d1-9626-ab1a3c7f32a0+3:10305:x1875455681553408:12345-0@lo:104: 00010000:00010000:3.0:1788574078.659657:0:6475:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7c00/0x5bf8706fdac8bdb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8bdbd expref: -99 pid: 9485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574078.659697:0:6475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788574078.659702:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601835500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:69505170-06bc-41d1-9626-ab1a3c7f32a0+3:10305:x1875455681553408:12345-0@lo:104: Request processed in 58us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574078.659708:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:0.0:1788574078.659863:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788574078.659870:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7c00/0x5bf8706fdac8bdb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8bdbd expref: -99 pid: 9485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574078.659876:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d7c00 already unused, calling callback (ffffffffc1472c20) 10000000:00010000:0.0:1788574078.659880:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7c00/0x5bf8706fdac8bdb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5bf8706fdac8bdbd expref: -99 pid: 9485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574078.659887:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7c00/0x5bf8706fdac8bdb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5bf8706fdac8bdbd expref: -99 pid: 9485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788574078.659905:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7c00/0x5bf8706fdac8bdb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5bf8706fdac8bdbd expref: -99 pid: 9485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788574078.659911:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788574078.659939:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7c00/0x5bf8706fdac8bdb6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bdbd expref: -99 pid: 9485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574078.659945:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788574078.659951:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7c00/0x5bf8706fdac8bdb6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bdbd expref: -99 pid: 9485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574078.659957:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7c00/0x5bf8706fdac8bdb6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bdbd expref: -99 pid: 9485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574078.659970:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574078.659972:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574078.659974:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574078.659980:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574078.660459:0:10305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c8601837100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10305:1875455681553408:0@lo:104: 00010000:00010000:2.0:1788574078.660524:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574078.660540:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3721500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:69505170-06bc-41d1-9626-ab1a3c7f32a0:3620:1875455681554176:0@lo:103: 00000100:00100000:2.0:1788574078.660579:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574078.660625:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788574078.660632:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3723100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:69505170-06bc-41d1-9626-ab1a3c7f32a0:3620:1875455681554048:0@lo:103: 00000100:00100000:2.0:1788574078.660655:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574078.660671:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3723b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:69505170-06bc-41d1-9626-ab1a3c7f32a0:3620:1875455681554560:0@lo:103: 00000100:00100000:2.0:1788574078.660690:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574078.660716:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681554176 00000100:00100000:0.0:1788574078.660817:0:7433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681554048 00000100:00100000:0.0:1788574078.660822:0:7433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681554048 00010000:00010000:0.0:1788574078.660843:0:7433:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c85fa32ee00/0x5bf8706fdac8bece lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8bec7 expref: 18 pid: 6485 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574078.660858:0:7433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681554560 00000100:00100000:0.0:1788574078.660861:0:7433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681554560 00010000:00010000:0.0:1788574078.660869:0:7433:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c85c152f200/0x5bf8706fdac8bdbd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8bdb6 expref: 19 pid: 6487 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574078.660880:0:7433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788574078.660894:0:7433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e0b79c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:69505170-06bc-41d1-9626-ab1a3c7f32a0+19:3620:x1875455681554048:12345-0@lo:103: 00010000:00010000:0.0:1788574078.660905:0:7433:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574078.660910:0:7433:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c85fa32ee00/0x5bf8706fdac8bece lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8bec7 expref: 19 pid: 6485 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574078.660920:0:7433:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c85fa32ee00/0x5bf8706fdac8bece lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5bf8706fdac8bec7 expref: 19 pid: 6485 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574078.660932:0:7433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85fa32ee00/0x5bf8706fdac8bece lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5bf8706fdac8bec7 expref: 19 pid: 6485 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574078.660943:0:7433:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574078.660982:0:7433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e0b79c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:69505170-06bc-41d1-9626-ab1a3c7f32a0+18:3620:x1875455681554048:12345-0@lo:103: Request processed in 89us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574078.660988:0:7433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788574078.661000:0:7433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788574078.661006:0:7433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3725c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:69505170-06bc-41d1-9626-ab1a3c7f32a0+17:3620:x1875455681554560:12345-0@lo:103: 00010000:00010000:0.0:1788574078.661013:0:7433:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574078.661018:0:7433:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c85c152f200/0x5bf8706fdac8bdbd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8bdb6 expref: 17 pid: 6487 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574078.661026:0:7433:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c85c152f200/0x5bf8706fdac8bdbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5bf8706fdac8bdb6 expref: 17 pid: 6487 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574078.661035:0:7433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85c152f200/0x5bf8706fdac8bdbd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5bf8706fdac8bdb6 expref: 17 pid: 6487 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574078.661043:0:7433:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574078.661064:0:7433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3725c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:69505170-06bc-41d1-9626-ab1a3c7f32a0+16:3620:x1875455681554560:12345-0@lo:103: Request processed in 58us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574078.661078:0:7433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788574078.661116:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681554176 00010000:00010000:2.0:1788574078.661135:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c85d20d7e00/0x5bf8706fdac8be34 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8be2d expref: 16 pid: 6485 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574078.661161:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788574078.661168:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3724700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69505170-06bc-41d1-9626-ab1a3c7f32a0+16:3620:x1875455681554176:12345-0@lo:103: 00010000:00010000:2.0:1788574078.661175:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788574078.661178:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c85d20d7e00/0x5bf8706fdac8be34 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8be2d expref: 16 pid: 6485 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574078.661186:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c85d20d7e00/0x5bf8706fdac8be34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5bf8706fdac8be2d expref: 16 pid: 6485 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574078.661228:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85d20d7e00/0x5bf8706fdac8be34 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5bf8706fdac8be2d expref: 16 pid: 6485 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574078.661238:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788574078.661262:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3724700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69505170-06bc-41d1-9626-ab1a3c7f32a0+15:3620:x1875455681554176:12345-0@lo:103: Request processed in 96us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574078.661268:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788574078.661316:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3723100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:69505170-06bc-41d1-9626-ab1a3c7f32a0:3620:1875455681554048:0@lo:103: 00000100:00100000:2.0:1788574078.661325:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3723b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:69505170-06bc-41d1-9626-ab1a3c7f32a0:3620:1875455681554560:0@lo:103: 00000100:00100000:2.0:1788574078.661331:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3721500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:69505170-06bc-41d1-9626-ab1a3c7f32a0:3620:1875455681554176:0@lo:103: 00000100:00100000:3.0:1788574078.661661:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69505170-06bc-41d1-9626-ab1a3c7f32a0:3619:1875455681553664:0@lo:103: 00000100:00100000:3.0:1788574078.661671:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69505170-06bc-41d1-9626-ab1a3c7f32a0:3619:1875455681553536:0@lo:103: 00000100:00100000:1.0:1788574078.668864:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574078.668889:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574078.668914:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668916992 00000100:00100000:1.0:1788574078.668922:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668916992 00010000:00010000:1.0:1788574078.668957:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c85d20d6600/0x5bf8706fdac8bee3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6605 expref: 10 pid: 6486 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574078.668985:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668917120 00000100:00100000:1.0:1788574078.668989:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668917120 00010000:00010000:1.0:1788574078.668999:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c85d20d6400/0x5bf8706fdac8bedc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d65fe expref: 11 pid: 6487 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574078.669019:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 33 00000100:00100000:1.0:1788574078.669027:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601835180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+11:2394:x1875455668916992:12345-192.168.204.51@tcp:103: 00010000:00010000:1.0:1788574078.669040:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574078.669045:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c85d20d6600/0x5bf8706fdac8bee3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6605 expref: 11 pid: 6486 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574078.669056:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c85d20d6600/0x5bf8706fdac8bee3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6605 expref: 11 pid: 6486 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574078.669075:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788574078.669132:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601835180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+11:2394:x1875455668916992:12345-192.168.204.51@tcp:103: Request processed in 106us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574078.669140:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 33 00000100:00100000:1.0:1788574078.669158:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 34 00000100:00100000:1.0:1788574078.669163:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601835c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+10:2394:x1875455668917120:12345-192.168.204.51@tcp:103: 00010000:00010000:1.0:1788574078.669170:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574078.669174:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c85d20d6400/0x5bf8706fdac8bedc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d65fe expref: 10 pid: 6487 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574078.669182:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c85d20d6400/0x5bf8706fdac8bedc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d65fe expref: 10 pid: 6487 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574078.669218:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c85faea3e00/0x5bf8706fdac8bf22 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574078.669226:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85faea3e00/0x5bf8706fdac8bf22 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574078.669241:0:6479:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c85faea3e00/0x5bf8706fdac8bf22 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574078.669248:0:6479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c85faea3e00/0x5bf8706fdac8bf22 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574078.669254:0:6479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c85faea3e00/0x5bf8706fdac8bf22 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574078.669260:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c85faea3e00/0x5bf8706fdac8bf22 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574078.669265:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85faea3e00 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:1.0:1788574078.669274:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c85faea3e00/0x5bf8706fdac8bf22 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574078.669282:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c85faea3e00/0x5bf8706fdac8bf22 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574078.669290:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c85faea3e00/0x5bf8706fdac8bf22 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574078.669301:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788574078.669319:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601835c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+10:2394:x1875455668917120:12345-192.168.204.51@tcp:103: Request processed in 155us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574078.669324:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 34 00010000:00010000:2.0:1788574078.669509:0:10305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85d20d6600/0x5bf8706fdac8bee3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6605 expref: 9 pid: 6486 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574078.669522:0:10305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c8601836a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10305:1875455681552128:192.168.204.51@tcp:104: 00010000:00010000:2.0:1788574078.669531:0:10305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85d20d6400/0x5bf8706fdac8bedc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d65fe expref: 8 pid: 6487 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574078.669538:0:10305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c8601834380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10305:1875455681552256:192.168.204.51@tcp:104: 00010000:00010000:2.0:1788574078.669573:0:10305:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c85faea3e00/0x5bf8706fdac8bf22 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574078.669581:0:10305:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c85faea3e00/0x5bf8706fdac8bf22 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574078.669586:0:10305:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c85faea3e00/0x5bf8706fdac8bf22 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574078.669615:0:10305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85faea3e00/0x5bf8706fdac8bf22 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10305 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574079.635427:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788574079.763601:0:6490:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788574079.763609:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c85f7fb1000 from 48 10000000:01000000:1.0:1788574079.763614:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788574079.763666:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85faea3c00/0x5bf8706fdac8bf29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574079.763677:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c85faea3c00/0x5bf8706fdac8bf29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574079.763689:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c85faea3c00/0x5bf8706fdac8bf29 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574079.763714:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c8601834e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681554688:0@lo:101: 00000100:00100000:1.0:1788574079.763787:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574079.763928:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681554688 00000100:00100000:3.0:1788574079.763935:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681554688 00000100:00100000:1.0:1788574079.764065:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c3653780 going to sleep for 11 seconds 00000100:00100000:3.0:1788574079.764319:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1788574079.764330:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5675050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+15:6490:x1875455681554688:12345-0@lo:101: 00010000:00010000:3.0:1788574079.764345:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574079.764360:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c860204ac00/0x5bf8706fdac8bf30 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8bf29 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574079.764394:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c860204ac00/0x5bf8706fdac8bf30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8bf29 expref: 16 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574079.764406:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c860204ac00/0x5bf8706fdac8bf30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8bf29 expref: 16 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574079.764416:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c860204ac00, rc 0) 00000100:00100000:3.0:1788574079.764493:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5675050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+16:6490:x1875455681554688:12345-0@lo:101: Request processed in 165us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574079.764500:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1788574079.764573:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c8601834e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681554688:0@lo:101: 00010000:00010000:1.0:1788574079.764588:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c85faea3c00/0x5bf8706fdac8bf29 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bf30 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574079.764604:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c85faea3c00/0x5bf8706fdac8bf29 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8bf30 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574079.764661:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c8601834e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681554816:0@lo:501: 00000100:00100000:1.0:1788574079.764684:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574079.765542:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c3653780 going to sleep for 11 seconds 00000100:00100000:2.0:1788574079.765665:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681554816 00000100:00100000:2.0:1788574079.765674:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681554816 00000100:00100000:2.0:1788574079.765711:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1788574079.765717:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5675c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+16:6490:x1875455681554816:12345-0@lo:501: 00000100:00100000:2.0:1788574079.765879:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5675c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+16:6490:x1875455681554816:12345-0@lo:501: Request processed in 161us (1193us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574079.765886:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1788574079.766185:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c8601834e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681554816:0@lo:501: 00000100:00100000:1.0:1788574079.766398:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c8601834e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681554944:0@lo:503: 00000100:00100000:1.0:1788574079.766521:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574079.766544:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c3653780 going to sleep for 11 seconds 00000100:00100000:2.0:1788574079.766601:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681554944 00000100:00100000:2.0:1788574079.766606:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681554944 00000100:00100000:2.0:1788574079.766635:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1788574079.766642:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5675450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+16:6490:x1875455681554944:12345-0@lo:503: 00000100:00100000:2.0:1788574079.766771:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5675450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+16:6490:x1875455681554944:12345-0@lo:503: Request processed in 129us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574079.766778:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1788574079.767148:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c8601834e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681554944:0@lo:503: 00000100:00100000:2.0:1788574079.769726:0:10323:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3724700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:10323:1875455681555072:0@lo:502: 00000100:00100000:2.0:1788574079.769888:0:10323:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574079.770077:0:10323:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c26bd180 going to sleep for 11 seconds 00000100:00100000:0.0:1788574079.770600:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681555072 00000100:00100000:0.0:1788574079.770609:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681555072 00000100:00100000:0.0:1788574079.770696:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1788574079.770706:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5676850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+16:10323:x1875455681555072:12345-0@lo:502: 00000100:00100000:0.0:1788574079.771027:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5676850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+16:10323:x1875455681555072:12345-0@lo:502: Request processed in 322us (1202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574079.771035:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1788574079.771821:0:10323:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3724700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:10323:1875455681555072:0@lo:502: 00000100:00100000:2.0:1788574079.771897:0:10323:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3724700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:10323:1875455681555200:0@lo:502: 00000100:00100000:2.0:1788574079.771946:0:10323:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574079.774966:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681555200 00000100:00100000:1.0:1788574079.775135:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681555200 00000100:00100000:1.0:1788574079.775211:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1788574079.775416:0:10323:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c26bd180 going to sleep for 11 seconds 00000100:00100000:1.0:1788574079.775508:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5677050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+16:10323:x1875455681555200:12345-0@lo:502: 00000100:00100000:1.0:1788574079.775665:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5677050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+16:10323:x1875455681555200:12345-0@lo:502: Request processed in 445us (3718us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574079.775672:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1788574079.775775:0:10323:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3724700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:10323:1875455681555200:0@lo:502: 00000040:00080000:2.0:1788574079.775814:0:10323:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1788574079.776175:0:6490:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1788574079.776517:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788574079.776528:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85faea3c00/0x5bf8706fdac8bf29 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bf30 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574079.776540:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c85faea3c00/0x5bf8706fdac8bf29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bf30 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788574079.776564:0:6490:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1788574079.776567:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1788574079.776570:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788574079.776600:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85faea2a00/0x5bf8706fdac8bf37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574079.776608:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c85faea2a00/0x5bf8706fdac8bf37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574079.776617:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c85faea2a00/0x5bf8706fdac8bf37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574079.776634:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c8601834e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681555328:0@lo:101: 00000100:00100000:1.0:1788574079.776678:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574079.776712:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c3653180 going to sleep for 11 seconds 00000100:00100000:0.0:1788574079.776764:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681555328 00000100:00100000:0.0:1788574079.776770:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681555328 00000100:00100000:0.0:1788574079.776810:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1788574079.776819:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5675850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+16:6490:x1875455681555328:12345-0@lo:101: 00010000:00010000:0.0:1788574079.776829:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574079.776840:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c860217e400/0x5bf8706fdac8bf3e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8bf37 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574079.776865:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c860217e400/0x5bf8706fdac8bf3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8bf37 expref: 17 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574079.776875:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c860217e400/0x5bf8706fdac8bf3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8bf37 expref: 17 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574079.776894:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c860217e400, rc 0) 00000100:00100000:0.0:1788574079.776938:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5675850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+17:6490:x1875455681555328:12345-0@lo:101: Request processed in 121us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574079.776944:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1788574079.777106:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c8601834e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681555328:0@lo:101: 00010000:00010000:1.0:1788574079.777120:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c85faea2a00/0x5bf8706fdac8bf37 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bf3e expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574079.777131:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c85faea2a00/0x5bf8706fdac8bf37 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8bf3e expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574079.777687:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c8601834e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681555456:0@lo:501: 00000100:00100000:1.0:1788574079.777721:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574079.777745:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c3653180 going to sleep for 11 seconds 00000100:00100000:0.0:1788574079.777809:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681555456 00000100:00100000:0.0:1788574079.777825:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681555456 00000100:00100000:0.0:1788574079.777916:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1788574079.777923:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5677450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+17:6490:x1875455681555456:12345-0@lo:501: 00000100:00100000:0.0:1788574079.778071:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5677450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+17:6490:x1875455681555456:12345-0@lo:501: Request processed in 148us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574079.778078:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1788574079.778140:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c8601834e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681555456:0@lo:501: 00000100:00100000:1.0:1788574079.778181:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c8601834e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681555584:0@lo:503: 00000100:00100000:1.0:1788574079.778244:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574079.778570:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c3653180 going to sleep for 11 seconds 00000100:00100000:3.0:1788574079.778615:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681555584 00000100:00100000:3.0:1788574079.778620:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681555584 00000100:00100000:3.0:1788574079.778646:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1788574079.778653:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5674850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+17:6490:x1875455681555584:12345-0@lo:503: 00000100:00100000:3.0:1788574079.778746:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5674850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+17:6490:x1875455681555584:12345-0@lo:503: Request processed in 93us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574079.778752:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1788574079.778837:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c8601834e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681555584:0@lo:503: 00000100:00100000:1.0:1788574079.779239:0:10324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c8601834e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:10324:1875455681555712:0@lo:502: 00000100:00100000:1.0:1788574079.779277:0:10324:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574079.779296:0:10324:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c3653cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788574079.779518:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681555712 00000100:00100000:2.0:1788574079.779524:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681555712 00000100:00100000:2.0:1788574079.779604:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1788574079.779613:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5676c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+17:10324:x1875455681555712:12345-0@lo:502: 00000100:00100000:2.0:1788574079.779713:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5676c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+17:10324:x1875455681555712:12345-0@lo:502: Request processed in 101us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574079.779719:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1788574079.779784:0:10324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c8601834e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:10324:1875455681555712:0@lo:502: 00000020:01000000:1.0:1788574079.779807:0:10324:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788574079.779816:0:10324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574079.779818:0:10324:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788574079.779822:0:10324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788574079.779843:0:10324:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c8601834e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:10324:1875455681555840:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788574079.779873:0:10324:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574079.781875:0:10324:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c3653cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788574079.782700:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681555840 00000100:00100000:3.0:1788574079.782711:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681555840 00000100:00100000:3.0:1788574079.782765:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1788574079.782774:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5674c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+17:10324:x1875455681555840:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788574079.785643:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5674c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+17:10324:x1875455681555840:12345-0@lo:502:llog_process_th.0 Request processed in 2861us (5759us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574079.785656:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1788574079.785979:0:10324:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c8601834e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:10324:1875455681555840:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788574079.786209:0:10324:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788574079.786230:0:10324:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574079.786232:0:10324:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788574079.786237:0:10324:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:3.0:1788574079.786587:0:6490:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:3.0:1788574079.786608:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788574079.786618:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85faea2a00/0x5bf8706fdac8bf37 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bf3e expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574079.786629:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c85faea2a00/0x5bf8706fdac8bf37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bf3e expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788574079.786638:0:6490:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788574079.786641:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c85fad3f000 from 48 10000000:01000000:3.0:1788574079.786643:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788574079.786687:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c860204bc00/0x5bf8706fdac8bf45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574079.786695:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c860204bc00/0x5bf8706fdac8bf45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574079.786704:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c860204bc00/0x5bf8706fdac8bf45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574079.786724:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3009880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681555968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788574079.786780:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574079.786816:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c357f540 going to sleep for 11 seconds 00000100:00100000:0.0:1788574079.786898:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681555968 00000100:00100000:0.0:1788574079.786905:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681555968 00000100:00100000:0.0:1788574079.786952:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1788574079.786967:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5677c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+17:6490:x1875455681555968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788574079.786979:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574079.786991:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c860217ec00/0x5bf8706fdac8bf4c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8bf45 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574079.787015:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c860217ec00/0x5bf8706fdac8bf4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8bf45 expref: 18 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574079.787472:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c860217ec00/0x5bf8706fdac8bf4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8bf45 expref: 18 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574079.787482:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c860217ec00, rc 0) 00000100:00100000:0.0:1788574079.787527:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5677c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+18:6490:x1875455681555968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 567us (748us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574079.787534:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1788574079.787710:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3009880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681555968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788574079.787725:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c860204bc00/0x5bf8706fdac8bf45 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bf4c expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574079.787733:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c860204bc00/0x5bf8706fdac8bf45 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8bf4c expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574079.787804:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3009880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681556096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788574079.787830:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574079.787862:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c357f540 going to sleep for 11 seconds 00000100:00100000:2.0:1788574079.787905:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681556096 00000100:00100000:2.0:1788574079.787911:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681556096 00000100:00100000:2.0:1788574079.787948:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1788574079.787956:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5673850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+18:6490:x1875455681556096:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788574079.788647:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5673850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+18:6490:x1875455681556096:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 690us (814us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574079.788655:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1788574079.789605:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3009880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681556096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788574079.789679:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3009880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681556224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788574079.789729:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574079.789770:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c357f540 going to sleep for 11 seconds 00000100:00100000:0.0:1788574079.789828:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681556224 00000100:00100000:0.0:1788574079.789834:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681556224 00000100:00100000:0.0:1788574079.789921:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1788574079.789929:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5672050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+18:6490:x1875455681556224:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788574079.790292:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5672050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+18:6490:x1875455681556224:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 362us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574079.790301:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1788574079.790409:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3009880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681556224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788574079.792532:0:10325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c8601834e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:10325:1875455681556352:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788574079.792613:0:10325:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574079.793050:0:10325:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c3653b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788574079.797983:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681556352 00000100:00100000:3.0:1788574079.798031:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681556352 00000100:00100000:3.0:1788574079.803016:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1788574079.803112:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5671050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+18:10325:x1875455681556352:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788574079.805942:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5671050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+18:10325:x1875455681556352:12345-0@lo:502:llog_process_th.0 Request processed in 2833us (13318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574079.805957:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1788574079.806553:0:10325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c8601834e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:10325:1875455681556352:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788574079.806627:0:10325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c8601834e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:10325:1875455681556480:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788574079.806694:0:10325:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574079.806747:0:10325:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c3653b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788574079.806806:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681556480 00000100:00100000:3.0:1788574079.806813:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681556480 00000100:00100000:3.0:1788574079.806852:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1788574079.806861:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5671c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+18:10325:x1875455681556480:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788574079.806958:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5671c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+18:10325:x1875455681556480:12345-0@lo:502:llog_process_th.0 Request processed in 98us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574079.806965:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1788574079.807051:0:10325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c8601834e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:10325:1875455681556480:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788574079.807070:0:10325:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1788574079.807321:0:6490:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1788574079.807356:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788574079.807366:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c860204bc00/0x5bf8706fdac8bf45 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bf4c expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574079.807387:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c860204bc00/0x5bf8706fdac8bf45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bf4c expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788574079.807399:0:6490:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1788574079.807401:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1788574079.807405:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788574079.807433:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85fa32fc00/0x5bf8706fdac8bf53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574079.807609:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c85fa32fc00/0x5bf8706fdac8bf53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574079.807619:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c85fa32fc00/0x5bf8706fdac8bf53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574079.807639:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3724700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681556608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788574079.807679:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574079.807751:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c26bd240 going to sleep for 11 seconds 00000100:00100000:3.0:1788574079.808412:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681556608 00000100:00100000:3.0:1788574079.808420:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681556608 00000100:00100000:3.0:1788574079.808462:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1788574079.808472:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5671450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+18:6490:x1875455681556608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788574079.808609:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574079.808629:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c860204a200/0x5bf8706fdac8bf5a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8bf53 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574079.808662:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c860204a200/0x5bf8706fdac8bf5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8bf53 expref: 19 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574079.808674:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c860204a200/0x5bf8706fdac8bf5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8bf53 expref: 19 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574079.808683:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c860204a200, rc 0) 00000100:00100000:3.0:1788574079.808758:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5671450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+19:6490:x1875455681556608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 288us (1079us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574079.808765:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1788574079.808894:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3724700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681556608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788574079.808911:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c85fa32fc00/0x5bf8706fdac8bf53 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bf5a expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574079.808922:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c85fa32fc00/0x5bf8706fdac8bf53 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8bf5a expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574079.808994:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3724700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681556736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788574079.809030:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574079.809064:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c26bd240 going to sleep for 11 seconds 00000100:00100000:0.0:1788574079.809115:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681556736 00000100:00100000:0.0:1788574079.809121:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681556736 00000100:00100000:0.0:1788574079.809165:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1788574079.809181:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5672850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+19:6490:x1875455681556736:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788574079.809349:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5672850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+19:6490:x1875455681556736:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 177us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574079.809355:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1788574079.809792:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3724700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681556736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788574079.809951:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3724700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681556864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788574079.810013:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574079.810051:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c26bd240 going to sleep for 11 seconds 00000100:00100000:0.0:1788574079.810156:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681556864 00000100:00100000:0.0:1788574079.810162:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681556864 00000100:00100000:0.0:1788574079.810213:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1788574079.810221:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5673050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+19:6490:x1875455681556864:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788574079.810329:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5673050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+19:6490:x1875455681556864:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 109us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574079.810337:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1788574079.810365:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3724700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681556864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788574079.811124:0:10326:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3008700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:10326:1875455681556992:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788574079.811175:0:10326:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574079.811238:0:10326:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c357ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1788574079.811313:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681556992 00000100:00100000:0.0:1788574079.811318:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681556992 00000100:00100000:0.0:1788574079.811354:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1788574079.811362:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5671850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+19:10326:x1875455681556992:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788574079.811472:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5671850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+19:10326:x1875455681556992:12345-0@lo:502:llog_process_th.0 Request processed in 110us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574079.811479:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1788574079.811665:0:10326:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3008700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:10326:1875455681556992:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788574079.811693:0:10326:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788574079.811703:0:10326:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574079.811705:0:10326:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788574079.811710:0:10326:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788574079.811731:0:10326:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3008700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:10326:1875455681557120:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788574079.811762:0:10326:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574079.811786:0:10326:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c357ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1788574079.811877:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681557120 00000100:00100000:2.0:1788574079.811898:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681557120 00000100:00100000:2.0:1788574079.811931:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1788574079.811938:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5673450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+19:10326:x1875455681557120:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788574079.812018:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5673450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+19:10326:x1875455681557120:12345-0@lo:502:llog_process_th.0 Request processed in 80us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574079.812025:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1788574079.812159:0:10326:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3008700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:10326:1875455681557120:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788574079.812179:0:10326:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788574079.812183:0:10326:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574079.812185:0:10326:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788574079.812217:0:10326:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:2.0:1788574079.812680:0:6490:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1788574079.812702:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788574079.812712:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85fa32fc00/0x5bf8706fdac8bf53 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bf5a expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574079.812724:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c85fa32fc00/0x5bf8706fdac8bf53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bf5a expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788574079.812735:0:6490:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788574079.812738:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c85fa390800 from 48 10000000:01000000:2.0:1788574079.812741:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788574079.812770:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85fa32f600/0x5bf8706fdac8bf61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574079.812780:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c85fa32f600/0x5bf8706fdac8bf61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574079.812789:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c85fa32f600/0x5bf8706fdac8bf61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574079.812806:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3724700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681557248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788574079.812840:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574079.812865:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c26bdb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788574079.813268:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681557248 00000100:00100000:0.0:1788574079.813274:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681557248 00000100:00100000:0.0:1788574079.813338:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1788574079.813346:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5670850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+19:6490:x1875455681557248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788574079.813356:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574079.813370:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c860217fe00/0x5bf8706fdac8bf68 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8bf61 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574079.813401:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c860217fe00/0x5bf8706fdac8bf68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8bf61 expref: 20 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574079.813416:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c860217fe00/0x5bf8706fdac8bf68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8bf61 expref: 20 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574079.813424:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c860217fe00, rc 0) 00000100:00100000:0.0:1788574079.813464:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5670850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+20:6490:x1875455681557248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574079.813470:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1788574079.813682:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3724700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681557248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788574079.813701:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c85fa32f600/0x5bf8706fdac8bf61 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bf68 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574079.813710:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c85fa32f600/0x5bf8706fdac8bf61 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8bf68 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574079.813772:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3724700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681557376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788574079.813796:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574079.813854:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c26bdb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788574079.814121:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681557376 00000100:00100000:3.0:1788574079.814126:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681557376 00000100:00100000:3.0:1788574079.814218:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1788574079.814226:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5670c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+20:6490:x1875455681557376:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788574079.814550:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5670c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+20:6490:x1875455681557376:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 325us (752us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574079.814558:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1788574079.814656:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3724700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681557376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788574079.814689:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3724700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681557504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788574079.814730:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574079.814830:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c26bdb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788574079.814954:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681557504 00000100:00100000:0.0:1788574079.814959:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681557504 00000100:00100000:1.0:1788574079.815102:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1788574079.815112:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5672c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+20:6490:x1875455681557504:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788574079.815260:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5672c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+20:6490:x1875455681557504:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 150us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574079.815266:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1788574079.815545:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3724700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681557504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788574079.816333:0:10327:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3008700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:10327:1875455681557632:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788574079.816402:0:10327:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574079.816479:0:10327:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c357f240 going to sleep for 11 seconds 00000100:00100000:1.0:1788574079.816571:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681557632 00000100:00100000:1.0:1788574079.816577:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681557632 00000100:00100000:1.0:1788574079.816644:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1788574079.816652:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5673c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+20:10327:x1875455681557632:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788574079.816778:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5673c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+20:10327:x1875455681557632:12345-0@lo:502:llog_process_th.0 Request processed in 126us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574079.816785:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1788574079.816871:0:10327:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3008700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:10327:1875455681557632:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788574079.816925:0:10327:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3721180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:10327:1875455681557760:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788574079.816958:0:10327:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574079.820223:0:10327:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c2568240 going to sleep for 11 seconds 00000100:00100000:3.0:1788574079.820972:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681557760 00000100:00100000:3.0:1788574079.820984:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681557760 00000100:00100000:3.0:1788574079.821364:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1788574079.821375:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5672450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+20:10327:x1875455681557760:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788574079.821555:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5672450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+20:10327:x1875455681557760:12345-0@lo:502:llog_process_th.0 Request processed in 182us (4595us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574079.821563:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1788574079.821740:0:10327:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3721180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:10327:1875455681557760:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788574079.821777:0:10327:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1788574079.822213:0:6490:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1788574079.822248:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788574079.822259:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85fa32f600/0x5bf8706fdac8bf61 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bf68 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574079.822270:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c85fa32f600/0x5bf8706fdac8bf61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bf68 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788574079.822281:0:6490:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1788574079.822283:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:3.0:1788574079.822286:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1788574079.822318:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c860204a800/0x5bf8706fdac8bf6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574079.822325:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c860204a800/0x5bf8706fdac8bf6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574079.822334:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c860204a800/0x5bf8706fdac8bf6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574079.822365:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c300a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681557888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788574079.822414:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574079.822456:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c357f300 going to sleep for 11 seconds 00000100:00100000:0.0:1788574079.822796:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681557888 00000100:00100000:0.0:1788574079.822802:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681557888 00000100:00100000:0.0:1788574079.822852:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1788574079.822860:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5670450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+20:6490:x1875455681557888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788574079.822879:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574079.822899:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c860217e000/0x5bf8706fdac8bf76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8bf6f expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574079.822920:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c860217e000/0x5bf8706fdac8bf76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8bf6f expref: 21 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574079.822931:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c860217e000/0x5bf8706fdac8bf76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8bf6f expref: 21 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574079.822939:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c860217e000, rc 0) 00000100:00100000:0.0:1788574079.822974:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5670450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+21:6490:x1875455681557888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574079.822981:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1788574079.823235:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c300a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681557888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788574079.823250:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c860204a800/0x5bf8706fdac8bf6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bf76 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574079.823260:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c860204a800/0x5bf8706fdac8bf6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8bf76 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574079.823319:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c300a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681558016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788574079.823360:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574079.823378:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c357f300 going to sleep for 11 seconds 00000100:00100000:0.0:1788574079.823872:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681558016 00000100:00100000:0.0:1788574079.823880:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681558016 00000100:00100000:0.0:1788574079.823923:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1788574079.823930:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5670050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+21:6490:x1875455681558016:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788574079.824074:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5670050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+21:6490:x1875455681558016:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 144us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574079.824081:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1788574079.824500:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c300a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681558016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788574079.824544:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c300a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681558144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788574079.824593:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574079.824619:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c357f300 going to sleep for 11 seconds 00000100:00100000:0.0:1788574079.824660:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681558144 00000100:00100000:0.0:1788574079.824664:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681558144 00000100:00100000:0.0:1788574079.824695:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1788574079.824702:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e564fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+21:6490:x1875455681558144:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788574079.824794:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e564fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+21:6490:x1875455681558144:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 92us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574079.824809:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1788574079.824984:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c300a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681558144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788574079.825792:0:10328:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c300a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:10328:1875455681558272:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788574079.825859:0:10328:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574079.825906:0:10328:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c357fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1788574079.826096:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681558272 00000100:00100000:0.0:1788574079.826103:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681558272 00000100:00100000:0.0:1788574079.826142:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1788574079.826149:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e564e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+21:10328:x1875455681558272:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788574079.826300:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e564e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+21:10328:x1875455681558272:12345-0@lo:502:llog_process_th.0 Request processed in 151us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574079.826308:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1788574079.826480:0:10328:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c300a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:10328:1875455681558272:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788574079.826508:0:10328:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788574079.826521:0:10328:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574079.826524:0:10328:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788574079.826530:0:10328:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788574079.826555:0:10328:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c300a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:10328:1875455681558400:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788574079.826588:0:10328:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574079.826611:0:10328:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c357fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1788574079.826648:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681558400 00000100:00100000:0.0:1788574079.826652:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681558400 00000100:00100000:0.0:1788574079.826681:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1788574079.826687:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e564c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+21:10328:x1875455681558400:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788574079.826747:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e564c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+21:10328:x1875455681558400:12345-0@lo:502:llog_process_th.0 Request processed in 59us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574079.826753:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1788574079.827041:0:10328:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c300a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:10328:1875455681558400:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788574079.827060:0:10328:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788574079.827064:0:10328:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574079.827066:0:10328:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788574079.827070:0:10328:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:0.0:1788574079.827360:0:6490:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:0.0:1788574079.827395:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1788574079.827406:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c860204a800/0x5bf8706fdac8bf6f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bf76 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574079.827417:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c860204a800/0x5bf8706fdac8bf6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bf76 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788574079.827428:0:6490:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788574079.827430:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c85c2bfb800 from 48 10000000:01000000:0.0:1788574079.827434:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788574079.827460:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c860217f200/0x5bf8706fdac8bf7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574079.827474:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c860217f200/0x5bf8706fdac8bf7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574079.827484:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c860217f200/0x5bf8706fdac8bf7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574079.827499:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3721180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681558528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788574079.827533:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574079.827559:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85e57d63c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788574079.827606:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681558528 00000100:00100000:3.0:1788574079.827612:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681558528 00000100:00100000:3.0:1788574079.827679:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1788574079.827687:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e564c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+21:6490:x1875455681558528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788574079.827696:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574079.827708:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c860204ba00/0x5bf8706fdac8bf84 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8bf7d expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574079.827728:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c860204ba00/0x5bf8706fdac8bf84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8bf7d expref: 22 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574079.827738:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c860204ba00/0x5bf8706fdac8bf84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8bf7d expref: 22 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574079.827746:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c860204ba00, rc 0) 00000100:00100000:3.0:1788574079.827779:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e564c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+22:6490:x1875455681558528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 93us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574079.827785:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1788574079.831486:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3721180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681558528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788574079.831521:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c860217f200/0x5bf8706fdac8bf7d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bf84 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574079.831536:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c860217f200/0x5bf8706fdac8bf7d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8bf84 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574079.831628:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3721180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681558656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788574079.831691:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574079.831739:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85e57d63c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788574079.831758:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681558656 00000100:00100000:0.0:1788574079.831764:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681558656 00000100:00100000:0.0:1788574079.831801:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1788574079.831809:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e564e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+22:6490:x1875455681558656:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788574079.833647:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e564e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+22:6490:x1875455681558656:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1832us (1950us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574079.833660:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1788574079.833731:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3721180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681558656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788574079.833775:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3721180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681558784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788574079.833818:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574079.833865:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85e57d63c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788574079.834529:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681558784 00000100:00100000:2.0:1788574079.834538:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681558784 00000100:00100000:2.0:1788574079.834591:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1788574079.834688:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e564f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+22:6490:x1875455681558784:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788574079.834801:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e564f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+22:6490:x1875455681558784:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 201us (982us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574079.834809:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1788574079.836363:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3721180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681558784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788574079.837058:0:10329:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c300a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:10329:1875455681558912:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788574079.837129:0:10329:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574079.837176:0:10329:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c357fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788574079.837551:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681558912 00000100:00100000:2.0:1788574079.837558:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681558912 00000100:00100000:2.0:1788574079.837607:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1788574079.837616:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e564d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+22:10329:x1875455681558912:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788574079.838155:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e564d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+22:10329:x1875455681558912:12345-0@lo:502:llog_process_th.0 Request processed in 538us (1023us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574079.838165:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1788574079.845484:0:10329:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c300a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:10329:1875455681558912:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788574079.845667:0:10329:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3724700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:10329:1875455681559040:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788574079.845759:0:10329:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574079.846101:0:10329:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c26bd480 going to sleep for 11 seconds 00000100:00100000:1.0:1788574079.847546:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681559040 00000100:00100000:1.0:1788574079.847559:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681559040 00000100:00100000:1.0:1788574079.847619:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1788574079.847629:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e564dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+22:10329:x1875455681559040:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788574079.847803:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e564dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+22:10329:x1875455681559040:12345-0@lo:502:llog_process_th.0 Request processed in 174us (2043us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574079.847810:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1788574079.848247:0:10329:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3724700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:10329:1875455681559040:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788574079.848283:0:10329:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1788574079.848477:0:6490:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1788574079.848501:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788574079.848513:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c860217f200/0x5bf8706fdac8bf7d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bf84 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574079.848523:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c860217f200/0x5bf8706fdac8bf7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bf84 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788574079.848532:0:6490:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788574079.848535:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:0.0:1788574079.848538:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788574079.848568:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c860217ee00/0x5bf8706fdac8bf8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574079.848575:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c860217ee00/0x5bf8706fdac8bf8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574079.848584:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c860217ee00/0x5bf8706fdac8bf8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574079.848605:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3721180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681559168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788574079.848646:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574079.848688:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85e57d63c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788574079.848783:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681559168 00000100:00100000:3.0:1788574079.848789:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681559168 00000100:00100000:3.0:1788574079.848817:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1788574079.848836:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e564d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+22:6490:x1875455681559168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788574079.848846:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574079.848859:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c860204a000/0x5bf8706fdac8bf92 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8bf8b expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574079.848881:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c860204a000/0x5bf8706fdac8bf92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8bf8b expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574079.850108:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c860204a000/0x5bf8706fdac8bf92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8bf8b expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574079.850120:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c860204a000, rc 0) 00000100:00100000:3.0:1788574079.850723:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e564d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+23:6490:x1875455681559168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1896us (2073us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574079.850731:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1788574079.851313:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3721180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681559168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788574079.851340:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c860217ee00/0x5bf8706fdac8bf8b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bf92 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574079.851353:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c860217ee00/0x5bf8706fdac8bf8b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8bf92 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574079.851446:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3721180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681559296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788574079.851487:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574079.851522:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85e57d63c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788574079.851589:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681559296 00000100:00100000:1.0:1788574079.851595:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681559296 00000100:00100000:1.0:1788574079.851689:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1788574079.851698:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e564e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+23:6490:x1875455681559296:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788574079.851866:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e564e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+23:6490:x1875455681559296:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 170us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574079.851873:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1788574079.851942:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3721180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681559296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788574079.851967:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3721180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681559424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788574079.852007:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574079.852682:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85e57d63c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788574079.852944:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681559424 00000100:00100000:3.0:1788574079.852951:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681559424 00000100:00100000:3.0:1788574079.852987:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1788574079.852995:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e564f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+23:6490:x1875455681559424:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788574079.853113:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e564f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+23:6490:x1875455681559424:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 119us (1106us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574079.853127:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1788574079.853304:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3721180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681559424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788574079.853575:0:10330:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3721180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:10330:1875455681559552:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788574079.853614:0:10330:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574079.853640:0:10330:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85e57d6000 going to sleep for 11 seconds 00000100:00100000:3.0:1788574079.853695:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681559552 00000100:00100000:3.0:1788574079.853700:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681559552 00000100:00100000:3.0:1788574079.853718:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1788574079.853783:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e564d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+23:10330:x1875455681559552:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788574079.854038:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e564d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+23:10330:x1875455681559552:12345-0@lo:502:llog_process_th.0 Request processed in 313us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574079.854045:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1788574079.854121:0:10330:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3721180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:10330:1875455681559552:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788574079.854143:0:10330:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788574079.854152:0:10330:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788574079.854154:0:10330:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788574079.854160:0:10330:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788574079.854218:0:10330:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3721180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:10330:1875455681559680:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788574079.854252:0:10330:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574079.854281:0:10330:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85e57d6000 going to sleep for 11 seconds 00000100:00100000:3.0:1788574079.854375:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681559680 00000100:00100000:3.0:1788574079.854390:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681559680 00000100:00100000:3.0:1788574079.854409:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1788574079.854415:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e564c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+23:10330:x1875455681559680:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788574079.854487:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e564c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+23:10330:x1875455681559680:12345-0@lo:502:llog_process_th.0 Request processed in 71us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574079.854493:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1788574079.854603:0:10330:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3721180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:10330:1875455681559680:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788574079.854620:0:10330:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788574079.854624:0:10330:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788574079.854625:0:10330:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788574079.854629:0:10330:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1788574079.854849:0:6490:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:1.0:1788574079.854872:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788574079.854882:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c860217ee00/0x5bf8706fdac8bf8b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bf92 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574079.854989:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c860217ee00/0x5bf8706fdac8bf8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bf92 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788574079.855000:0:6490:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788574079.855002:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9c85e56999c0 from 1 10000000:01000000:1.0:1788574079.855005:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788574079.855030:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85faea2400/0x5bf8706fdac8bf99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574079.855038:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c85faea2400/0x5bf8706fdac8bf99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574079.855047:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c85faea2400/0x5bf8706fdac8bf99 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574079.855061:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c8601834e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681559808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788574079.855089:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574079.855110:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c3653840 going to sleep for 11 seconds 00000100:00100000:3.0:1788574079.855153:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681559808 00000100:00100000:3.0:1788574079.855158:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681559808 00000100:00100000:3.0:1788574079.855252:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1788574079.855259:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e564cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+23:6490:x1875455681559808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788574079.855267:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574079.855279:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c860204b000/0x5bf8706fdac8bfa0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8bf99 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574079.855300:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c860204b000/0x5bf8706fdac8bfa0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8bf99 expref: 24 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574079.855310:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c860204b000/0x5bf8706fdac8bfa0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8bf99 expref: 24 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574079.855326:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c860204b000, rc 0) 00000100:00100000:3.0:1788574079.855355:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e564cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:6490:x1875455681559808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 97us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574079.855361:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1788574079.856881:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c8601834e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681559808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788574079.856976:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c85faea2400/0x5bf8706fdac8bf99 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bfa0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574079.856988:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c85faea2400/0x5bf8706fdac8bf99 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8bfa0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574079.857059:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c8601834e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681559936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788574079.857106:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574079.857228:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c3653840 going to sleep for 11 seconds 00000100:00100000:2.0:1788574079.857344:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681559936 00000100:00100000:2.0:1788574079.857350:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681559936 00000100:00100000:3.0:1788574079.857502:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1788574079.857511:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e564ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:6490:x1875455681559936:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788574079.857602:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e564ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:6490:x1875455681559936:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 93us (496us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788574079.857609:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1788574079.857954:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c8601834e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681559936:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1788574079.857985:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788574079.857992:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85faea2400/0x5bf8706fdac8bf99 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bfa0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574079.858002:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c85faea2400/0x5bf8706fdac8bf99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bfa0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574080.074681:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574080.074765:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574080.074802:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574080.074849:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574080.074908:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668917248 00000100:00100000:1.0:1788574080.074917:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668917248 00000100:00100000:1.0:1788574080.074982:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 242 00000100:00100000:1.0:1788574080.074993:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c5362850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+8:2393:x1875455668917248:12345-192.168.204.51@tcp:400: 00000100:00100000:1.0:1788574080.075077:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c5362850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+8:2393:x1875455668917248:12345-192.168.204.51@tcp:400: Request processed in 75us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574080.075085:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 242 00000100:00100000:3.0:1788574080.078183:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668917632 00000100:00100000:3.0:1788574080.078222:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668917632 00000100:00100000:0.0:1788574080.078246:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668917376 00000100:00100000:0.0:1788574080.078254:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668917376 00000100:00100000:3.0:1788574080.078301:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 21 00000100:00100000:2.0:1788574080.078306:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574080.078319:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3724e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:659467ff-94af-418e-92fe-11e4323a48aa+5:2393:x1875455668917632:12345-192.168.204.51@tcp:400: 00000100:00100000:2.0:1788574080.078342:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668917760 00000100:00100000:2.0:1788574080.078347:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668917760 00000100:00100000:2.0:1788574080.078398:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 22 00000100:00100000:2.0:1788574080.078407:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3727480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:659467ff-94af-418e-92fe-11e4323a48aa+5:2393:x1875455668917760:12345-192.168.204.51@tcp:400: 00000100:00100000:3.0:1788574080.078413:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3724e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:659467ff-94af-418e-92fe-11e4323a48aa+5:2393:x1875455668917632:12345-192.168.204.51@tcp:400: Request processed in 97us (3644us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574080.078422:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 21 00000100:00100000:2.0:1788574080.078443:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3727480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:659467ff-94af-418e-92fe-11e4323a48aa+5:2393:x1875455668917760:12345-192.168.204.51@tcp:400: Request processed in 37us (140us total) trans 0 rc 0/0 00000100:00080000:3.0:1788574080.078445:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788574080.078452:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788574080.078453:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 22 00000100:00080000:3.0:1788574080.078457:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788574080.078712:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668917504 00000100:00100000:1.0:1788574080.078719:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668917504 00000100:00100000:0.0:1788574080.078720:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 64 00000100:00100000:0.0:1788574080.078733:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3724700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+6:2393:x1875455668917376:12345-192.168.204.51@tcp:400: 00000100:00100000:0.0:1788574080.078774:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3724700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+6:2393:x1875455668917376:12345-192.168.204.51@tcp:400: Request processed in 45us (4104us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574080.078779:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 64 00000100:00100000:1.0:1788574080.079065:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 65 00000100:00100000:1.0:1788574080.079087:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3724000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+5:2393:x1875455668917504:12345-192.168.204.51@tcp:400: 00000100:00100000:1.0:1788574080.079137:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3724000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+5:2393:x1875455668917504:12345-192.168.204.51@tcp:400: Request processed in 54us (4296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574080.079144:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 65 00000100:00080000:2.0:1788574080.086717:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788574080.660605:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788574080.660630:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3724a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681560064:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788574080.660702:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574080.661227:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681560064 00000100:00100000:0.0:1788574080.661235:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681560064 00010000:00010000:1.0:1788574080.661511:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574080.664166:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788574080.664204:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3721180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681560064:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788574080.664254:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788574080.664335:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3721180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681560064:12345-0@lo:41:osp-pre-0-1.0 Request processed in 155us (3632us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574080.664342:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788574080.664495:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3724a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681560064:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788574081.684719:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574082.195604:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3720380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681560192:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788574082.195680:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574082.196102:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681560192 00000100:00100000:2.0:1788574082.196110:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681560192 00000100:00100000:2.0:1788574082.196226:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788574082.196237:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c300a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681560192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788574082.196277:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788574082.196332:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c300a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681560192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574082.196351:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1788574082.196545:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788574082.196574:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3720380 x1875455681560192/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574098 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574082.196592:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3720380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681560192:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788574082.196870:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788574082.196881:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3008000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681560320:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788574082.196923:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574082.197098:0:7533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681560320 00000100:00100000:3.0:1788574082.197103:0:7533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681560320 00000100:00100000:3.0:1788574082.197144:0:7533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788574082.197151:0:7533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3720380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681560320:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788574082.197176:0:7533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788574082.197393:0:7533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3720380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681560320:12345-0@lo:41:osp-pre-1-0.0 Request processed in 241us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574082.197400:0:7533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788574082.197468:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3008000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681560320:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788574082.199131:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3724a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681560448:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788574082.199225:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574082.199470:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681560448 00000100:00100000:2.0:1788574082.199478:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681560448 00000100:00100000:2.0:1788574082.199549:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788574082.199558:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3721500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681560448:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788574082.199579:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788574082.199631:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3721500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681560448:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574082.199638:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1788574082.199672:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3724a80 x1875455681560448/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574098 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574082.199688:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3724a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681560448:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788574082.199901:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788574082.707867:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574083.144713:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574083.145185:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668917888 00000100:00100000:0.0:1788574083.145241:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668917888 00000100:00100000:0.0:1788574083.145324:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 243 00000100:00100000:0.0:1788574083.145338:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e564f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+8:6164:x1875455668917888:12345-192.168.204.51@tcp:101: 00010000:00010000:0.0:1788574083.145361:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574083.145387:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85c152f200/0x5bf8706fdac8bfa7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6675 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574083.145424:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85c152f200/0x5bf8706fdac8bfa7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6675 expref: 9 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574083.145439:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85c152f200/0x5bf8706fdac8bfa7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6675 expref: 9 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574083.145450:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85c152f200, rc 0) 00000100:00100000:0.0:1788574083.145538:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e564f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+9:6164:x1875455668917888:12345-192.168.204.51@tcp:101: Request processed in 203us (844us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574083.145546:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 243 00000100:00100000:1.0:1788574083.157129:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574083.157538:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668918016 00000100:00100000:2.0:1788574083.157548:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668918016 00000100:00100000:2.0:1788574083.157604:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 244 00000100:00100000:2.0:1788574083.157613:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c820f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+9:6164:x1875455668918016:12345-192.168.204.51@tcp:501: 00000100:00100000:2.0:1788574083.157816:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c820f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+9:6164:x1875455668918016:12345-192.168.204.51@tcp:501: Request processed in 203us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574083.157826:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 244 00000100:00100000:2.0:1788574083.166133:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574083.166282:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668918144 00000100:00100000:1.0:1788574083.166293:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668918144 00000100:00100000:1.0:1788574083.166361:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 245 00000100:00100000:1.0:1788574083.166371:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c820d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+9:6164:x1875455668918144:12345-192.168.204.51@tcp:503: 00000100:00100000:1.0:1788574083.166544:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c820d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+9:6164:x1875455668918144:12345-192.168.204.51@tcp:503: Request processed in 173us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574083.166552:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 245 00000100:00100000:3.0:1788574083.195854:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574083.196433:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668918272 00000100:00100000:0.0:1788574083.196449:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668918272 00000100:00100000:0.0:1788574083.196550:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 246 00000100:00100000:0.0:1788574083.196563:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c820f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+9:6660:x1875455668918272:12345-192.168.204.51@tcp:502: 00000100:00100000:0.0:1788574083.196786:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c820f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+9:6660:x1875455668918272:12345-192.168.204.51@tcp:502: Request processed in 225us (948us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574083.196795:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 246 00000100:00100000:3.0:1788574083.201337:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574083.201568:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668918400 00000100:00100000:2.0:1788574083.201603:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668918400 00000100:00100000:2.0:1788574083.201680:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 247 00000100:00100000:2.0:1788574083.201693:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c820c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+9:6660:x1875455668918400:12345-192.168.204.51@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788574083.201900:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c820c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+9:6660:x1875455668918400:12345-192.168.204.51@tcp:502:llog_process_th.0 Request processed in 209us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574083.201909:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 247 00000100:00100000:2.0:1788574083.211513:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574083.212171:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668918528 00000100:00100000:1.0:1788574083.212210:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668918528 00000100:00100000:1.0:1788574083.212288:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 248 00000100:00100000:1.0:1788574083.212300:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c820ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+9:6164:x1875455668918528:12345-192.168.204.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788574083.212335:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574083.212361:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85faea3000/0x5bf8706fdac8bfae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x652b547cf44d667c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574083.212401:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85faea3000/0x5bf8706fdac8bfae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d667c expref: 10 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574083.212415:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85faea3000/0x5bf8706fdac8bfae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d667c expref: 10 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574083.212450:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85faea3000, rc 0) 00000100:00100000:1.0:1788574083.212544:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c820ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+10:6164:x1875455668918528:12345-192.168.204.51@tcp:101:ll_cfg_requeue.0 Request processed in 246us (1048us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574083.212552:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 248 00000100:00100000:0.0:1788574083.219650:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3724a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681560576:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788574083.219751:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574083.219888:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3723b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681560704:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788574083.219917:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574083.219959:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681560576 00000100:00100000:0.0:1788574083.219970:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681560576 00000100:00100000:0.0:1788574083.220030:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681560704 00000100:00100000:0.0:1788574083.220033:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681560704 00000100:00100000:0.0:1788574083.220332:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788574083.220344:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3723100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681560576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788574083.220382:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788574083.220438:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3723100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681560576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574083.220446:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788574083.220466:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788574083.220473:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3722a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681560704:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788574083.220483:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788574083.220511:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3722a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681560704:12345-0@lo:13:osp-pre-1-1.0 Request processed in 39us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574083.220516:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1788574083.220536:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788574083.220574:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3724a80 x1875455681560576/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574099 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574083.220621:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3724a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681560576:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1788574083.220660:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3723b80 x1875455681560704/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574099 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574083.220672:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3723b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681560704:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788574083.221217:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681561088:0@lo:400:kworker.0 00000100:00100000:2.0:1788574083.221267:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574083.221294:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3620:1875455681561600:0@lo:400:kworker.0 00000100:00100000:2.0:1788574083.221332:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574083.221348:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faff3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3620:1875455681562112:0@lo:400:kworker.0 00000100:00100000:2.0:1788574083.221366:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574083.221385:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788574083.221391:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875455681560960:0@lo:400:kworker.0 00000100:00100000:2.0:1788574083.221412:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574083.221427:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3620:1875455681561472:0@lo:400:kworker.0 00000100:00100000:2.0:1788574083.221444:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574083.221459:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faff1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3620:1875455681561984:0@lo:400:kworker.0 00000100:00100000:2.0:1788574083.221750:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574083.221779:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681561088 00000100:00100000:2.0:1788574083.221786:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681561088 00000100:00100000:2.0:1788574083.221991:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788574083.222003:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faff1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681561088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574083.222122:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faff1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681561088:12345-0@lo:400:kworker.0 Request processed in 121us (854us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574083.222138:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788574083.222159:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681561600 00000100:00100000:2.0:1788574083.222162:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681561600 00000100:00100000:2.0:1788574083.222213:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681562112 00000100:00100000:2.0:1788574083.222217:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681562112 00000100:00100000:2.0:1788574083.222231:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681560960 00000100:00100000:2.0:1788574083.222234:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681560960 00000100:00100000:2.0:1788574083.222243:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681561472 00000100:00100000:2.0:1788574083.222245:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681561472 00000100:00100000:2.0:1788574083.222256:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681561984 00000100:00100000:2.0:1788574083.222258:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681561984 00000100:00100000:2.0:1788574083.222270:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788574083.222276:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faff1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875455681561600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574083.222308:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faff1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875455681561600:12345-0@lo:400:kworker.0 Request processed in 32us (975us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574083.222325:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788574083.222337:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788574083.222343:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faff3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875455681562112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574083.222370:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faff3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875455681562112:12345-0@lo:400:kworker.0 Request processed in 27us (1003us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574083.222376:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788574083.222387:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788574083.222393:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faff2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875455681560960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574083.222417:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faff2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875455681560960:12345-0@lo:400:kworker.0 Request processed in 25us (1004us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574083.222422:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788574083.222431:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788574083.222443:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faff3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875455681561472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574083.222467:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faff3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875455681561472:12345-0@lo:400:kworker.0 Request processed in 25us (1022us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574083.222473:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788574083.222484:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788574083.222489:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faff0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875455681561984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574083.222510:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faff0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875455681561984:12345-0@lo:400:kworker.0 Request processed in 22us (760us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574083.222516:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788574083.222564:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875455681560960:0@lo:400:kworker.0 00000100:00100000:2.0:1788574083.222575:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3620:1875455681561472:0@lo:400:kworker.0 00000100:00100000:2.0:1788574083.222586:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faff1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3620:1875455681561984:0@lo:400:kworker.0 00000100:00100000:2.0:1788574083.222597:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681561088:0@lo:400:kworker.0 00010000:00080000:2.0:1788574083.222610:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c1be0a80 x1875455681561600/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574099 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574083.222620:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3620:1875455681561600:0@lo:400:kworker.0 00010000:00080000:2.0:1788574083.222630:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85faff3100 x1875455681562112/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574099 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574083.222638:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faff3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3620:1875455681562112:0@lo:400:kworker.0 00000100:00100000:1.0:1788574083.227343:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3724a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:69505170-06bc-41d1-9626-ab1a3c7f32a0:3618:1875455681560832:0@lo:400:kworker.0 00000100:00100000:1.0:1788574083.227476:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574083.227559:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681561344:0@lo:400:kworker.0 00000100:00100000:1.0:1788574083.227593:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574083.227615:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681561856:0@lo:400:kworker.0 00000100:00100000:1.0:1788574083.227640:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574083.227668:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788574083.227676:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875455681561216:0@lo:400:kworker.0 00000100:00100000:1.0:1788574083.227703:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574083.227723:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681561728:0@lo:400:kworker.0 00000100:00100000:1.0:1788574083.227740:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574083.227784:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681561856 00000100:00100000:1.0:1788574083.227793:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681561856 00000100:00100000:1.0:1788574083.227861:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681561728 00000100:00100000:1.0:1788574083.227927:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681561728 00000100:00100000:1.0:1788574083.227954:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788574083.227962:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601834a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681561856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574083.228024:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601834a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681561856:12345-0@lo:400:kworker.0 Request processed in 62us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574083.228031:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788574083.228068:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788574083.228074:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601836a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681561728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574083.228101:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601836a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681561728:12345-0@lo:400:kworker.0 Request processed in 27us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574083.228107:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788574083.228140:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681561216 00000100:00100000:1.0:1788574083.228144:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681561216 00000100:00100000:1.0:1788574083.228164:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788574083.228169:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601834380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875455681561216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574083.228231:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601834380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875455681561216:12345-0@lo:400:kworker.0 Request processed in 61us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574083.228237:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788574083.228281:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875455681561216:0@lo:400:kworker.0 00010000:00080000:1.0:1788574083.228294:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c1be1c00 x1875455681561728/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574099 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574083.228305:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681561728:0@lo:400:kworker.0 00010000:00080000:1.0:1788574083.228326:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c1be1180 x1875455681561856/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574099 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574083.228335:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681561856:0@lo:400:kworker.0 00000100:00100000:1.0:1788574083.228363:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681560832 00000100:00100000:1.0:1788574083.228367:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681560832 00000100:00100000:1.0:1788574083.228396:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1788574083.228403:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c820fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:3618:x1875455681560832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574083.228436:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c820fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:3618:x1875455681560832:12345-0@lo:400:kworker.0 Request processed in 34us (972us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574083.228453:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1788574083.228492:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3724a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:69505170-06bc-41d1-9626-ab1a3c7f32a0:3618:1875455681560832:0@lo:400:kworker.0 00000100:00080000:0.0:1788574083.230145:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788574083.230159:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788574083.230231:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681561344 00000100:00100000:0.0:1788574083.230242:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681561344 00000100:00100000:0.0:1788574083.230322:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788574083.230334:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601834e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681561344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574083.230429:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601834e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681561344:12345-0@lo:400:kworker.0 Request processed in 98us (2834us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574083.230436:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788574083.231428:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681561344:0@lo:400:kworker.0 00000100:00100000:3.0:1788574083.234592:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574083.234769:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668918656 00000100:00100000:2.0:1788574083.234784:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668918656 00000100:00100000:2.0:1788574083.234880:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 250 00000100:00100000:2.0:1788574083.234892:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c820cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+10:6164:x1875455668918656:12345-192.168.204.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788574083.235086:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c820cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+10:6164:x1875455668918656:12345-192.168.204.51@tcp:501:ll_cfg_requeue.0 Request processed in 196us (508us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788574083.235096:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 250 00010000:00010000:1.0:1788574083.736105:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788574084.188143:0:10368:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe23833e60 20000000:00000080:0.0:1788574084.188160:0:10368:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c8601805000 uarg=0000000000000000 20000000:01000000:0.0:1788574084.188329:0:10368:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788574084.188336:0:10368:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788574084.188340:0:10368:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788574084.188858:0:10369:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1788574084.189157:0:10368:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1788574084.204668:0:10368:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1788574084.204711:0:10368:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1788574084.204730:0:10368:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1788574084.204751:0:10368:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788574084.204772:0:10368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c85c152e600/0x5bf8706fdac8bfb5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574084.204792:0:10368:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c860217e800/0x5bf8706fdac8bc51 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8bc4a expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574084.204816:0:10368:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c860217e200/0x5bf8706fdac8bc5f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8bc58 expref: 23 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574084.204823:0:10368:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c85d20d7a00/0x5bf8706fdac8bcb3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8bcac expref: 23 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574084.204830:0:10368:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c85faea2e00/0x5bf8706fdac8bdd9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8bdd2 expref: 23 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574084.204840:0:10368:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c85fa32e000/0x5bf8706fdac8bef1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d663d expref: 9 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574084.204859:0:10368:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c85c152e600/0x5bf8706fdac8bfb5 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574084.204902:0:10368:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c85fa32e000/0x5bf8706fdac8bef1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d663d expref: 9 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574084.204916:0:10368:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c85fa32e000/0x5bf8706fdac8bef1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d663d expref: 9 pid: 6487 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574084.204943:0:10368:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3723b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10368:1875455681562240:192.168.204.51@tcp:104: 00010000:00010000:0.0:1788574084.205062:0:10368:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c85faea2e00/0x5bf8706fdac8bdd9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5bf8706fdac8bdd2 expref: 23 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574084.205071:0:10368:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c85faea2e00/0x5bf8706fdac8bdd9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5bf8706fdac8bdd2 expref: 23 pid: 6487 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574084.205079:0:10368:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3723480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10368:1875455681562368:0@lo:104: 00000100:00100000:0.0:1788574084.205129:0:10368:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788574084.205174:0:10368:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c85d20d7a00/0x5bf8706fdac8bcb3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5bf8706fdac8bcac expref: 23 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574084.205224:0:10368:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c85d20d7a00/0x5bf8706fdac8bcb3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5bf8706fdac8bcac expref: 23 pid: 6487 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574084.205234:0:10368:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3720a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10368:1875455681562496:0@lo:104: 00000100:00100000:0.0:1788574084.205479:0:10368:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788574084.205513:0:10368:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c860217e200/0x5bf8706fdac8bc5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5bf8706fdac8bc58 expref: 23 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574084.205521:0:10368:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c860217e200/0x5bf8706fdac8bc5f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5bf8706fdac8bc58 expref: 23 pid: 6487 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574084.205529:0:10368:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3721c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10368:1875455681562624:0@lo:104: 00010000:00010000:0.0:1788574084.205554:0:10368:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c860217e800/0x5bf8706fdac8bc51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5bf8706fdac8bc4a expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574084.205562:0:10368:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c860217e800/0x5bf8706fdac8bc51 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5bf8706fdac8bc4a expref: 23 pid: 6486 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574084.205570:0:10368:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3720700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10368:1875455681562752:0@lo:104: 00000100:00100000:0.0:1788574084.205587:0:10368:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85e57d6600 going to sleep for 11 seconds 00000100:00100000:2.0:1788574084.207450:0:6476:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788574084.207504:0:6476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574084.207545:0:6476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574084.207556:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681562368 00000100:00100000:2.0:1788574084.207563:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681562368 00000100:00100000:2.0:1788574084.207608:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681562496 00000100:00100000:2.0:1788574084.207612:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681562496 00000100:00100000:2.0:1788574084.207625:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681562624 00000100:00100000:2.0:1788574084.207627:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681562624 00000100:00100000:2.0:1788574084.207637:0:6476:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681562752 00000100:00100000:2.0:1788574084.207639:0:6476:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681562752 00000100:00100000:2.0:1788574084.207650:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788574084.207658:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3720000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:69505170-06bc-41d1-9626-ab1a3c7f32a0+6:10368:x1875455681562368:12345-0@lo:104: 00010000:00010000:2.0:1788574084.207673:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff9c85c152f600/0x5bf8706fdac8bdd2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8bdd9 expref: -99 pid: 9485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574084.207747:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788574084.207754:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3720000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:69505170-06bc-41d1-9626-ab1a3c7f32a0+6:10368:x1875455681562368:12345-0@lo:104: Request processed in 97us (2625us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574084.207761:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788574084.207777:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788574084.207783:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3728450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:69505170-06bc-41d1-9626-ab1a3c7f32a0+5:10368:x1875455681562496:12345-0@lo:104: 00010000:00010000:2.0:1788574084.207791:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff9c85c152f400/0x5bf8706fdac8bcac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8bcb3 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574084.207844:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788574084.207849:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3728450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:69505170-06bc-41d1-9626-ab1a3c7f32a0+5:10368:x1875455681562496:12345-0@lo:104: Request processed in 67us (2371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574084.207856:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788574084.207886:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788574084.207893:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faff3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:69505170-06bc-41d1-9626-ab1a3c7f32a0+4:10368:x1875455681562624:12345-0@lo:104: 00010000:00010000:2.0:1788574084.207901:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff9c85c152ee00/0x5bf8706fdac8bc58 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8bc5f expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574084.207952:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788574084.207958:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faff3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:69505170-06bc-41d1-9626-ab1a3c7f32a0+4:10368:x1875455681562624:12345-0@lo:104: Request processed in 66us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574084.207963:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788574084.207976:0:6476:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788574084.207982:0:6476:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faff1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:69505170-06bc-41d1-9626-ab1a3c7f32a0+3:10368:x1875455681562752:12345-0@lo:104: 00010000:00010000:2.0:1788574084.207990:0:6476:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff9c85faea2000/0x5bf8706fdac8bc4a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8bc51 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574084.208014:0:6476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788574084.208019:0:6476:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faff1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:69505170-06bc-41d1-9626-ab1a3c7f32a0+3:10368:x1875455681562752:12345-0@lo:104: Request processed in 38us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574084.208025:0:6476:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:2.0:1788574084.208042:0:7444:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788574084.208047:0:7444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c85c152f600/0x5bf8706fdac8bdd2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8bdd9 expref: -99 pid: 9485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574084.208064:0:7444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85c152f600 already unused, calling callback (ffffffffc1472c20) 10000000:00010000:2.0:1788574084.208069:0:7444:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c85c152f600/0x5bf8706fdac8bdd2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5bf8706fdac8bdd9 expref: -99 pid: 9485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574084.208079:0:7444:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c85c152f600/0x5bf8706fdac8bdd2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5bf8706fdac8bdd9 expref: -99 pid: 9485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788574084.208085:0:7444:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c85c152f600/0x5bf8706fdac8bdd2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5bf8706fdac8bdd9 expref: -99 pid: 9485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788574084.208091:0:7444:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788574084.208125:0:7444:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9c85c152f600/0x5bf8706fdac8bdd2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bdd9 expref: -99 pid: 9485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574084.208132:0:7444:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788574084.208153:0:7444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c85c152f600/0x5bf8706fdac8bdd2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bdd9 expref: -99 pid: 9485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574084.208161:0:7444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c85c152f600/0x5bf8706fdac8bdd2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bdd9 expref: -99 pid: 9485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574084.208177:0:7444:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788574084.208223:0:7444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c85c152f400/0x5bf8706fdac8bcac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8bcb3 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574084.208229:0:7444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85c152f400 already unused, calling callback (ffffffffc1472c20) 10000000:00010000:2.0:1788574084.208232:0:7444:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c85c152f400/0x5bf8706fdac8bcac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5bf8706fdac8bcb3 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574084.208248:0:7444:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c85c152f400/0x5bf8706fdac8bcac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5bf8706fdac8bcb3 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788574084.208255:0:7444:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c85c152f400/0x5bf8706fdac8bcac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5bf8706fdac8bcb3 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788574084.208260:0:7444:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788574084.208275:0:7444:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9c85c152f400/0x5bf8706fdac8bcac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bcb3 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574084.208280:0:7444:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788574084.208287:0:7444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c85c152f400/0x5bf8706fdac8bcac lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bcb3 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574084.208305:0:7444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c85c152f400/0x5bf8706fdac8bcac lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bcb3 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574084.208316:0:7444:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788574084.208319:0:7444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c85c152ee00/0x5bf8706fdac8bc58 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8bc5f expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574084.208325:0:7444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85c152ee00 already unused, calling callback (ffffffffc1472c20) 10000000:00010000:2.0:1788574084.208328:0:7444:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c85c152ee00/0x5bf8706fdac8bc58 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5bf8706fdac8bc5f expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574084.208334:0:7444:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c85c152ee00/0x5bf8706fdac8bc58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5bf8706fdac8bc5f expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788574084.208340:0:7444:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c85c152ee00/0x5bf8706fdac8bc58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5bf8706fdac8bc5f expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788574084.208352:0:7444:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788574084.208365:0:7444:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9c85c152ee00/0x5bf8706fdac8bc58 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bc5f expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574084.208372:0:7444:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788574084.208389:0:7444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c85c152ee00/0x5bf8706fdac8bc58 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bc5f expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574084.208396:0:7444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c85c152ee00/0x5bf8706fdac8bc58 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bc5f expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574084.208405:0:7444:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788574084.208407:0:7444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c85faea2000/0x5bf8706fdac8bc4a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8bc51 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574084.208412:0:7444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85faea2000 already unused, calling callback (ffffffffc1472c20) 10000000:00010000:2.0:1788574084.208415:0:7444:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c85faea2000/0x5bf8706fdac8bc4a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5bf8706fdac8bc51 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574084.208421:0:7444:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c85faea2000/0x5bf8706fdac8bc4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5bf8706fdac8bc51 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788574084.208427:0:7444:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c85faea2000/0x5bf8706fdac8bc4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5bf8706fdac8bc51 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788574084.208432:0:7444:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788574084.208444:0:7444:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9c85faea2000/0x5bf8706fdac8bc4a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bc51 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574084.208449:0:7444:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788574084.208461:0:7444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c85faea2000/0x5bf8706fdac8bc4a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bc51 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574084.208468:0:7444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c85faea2000/0x5bf8706fdac8bc4a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bc51 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574084.208481:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574084.208483:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574084.208484:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574084.208491:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574084.208495:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574084.208514:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faff3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:69505170-06bc-41d1-9626-ab1a3c7f32a0:3617:1875455681562880:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788574084.208551:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574084.208592:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788574084.208598:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faff0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:69505170-06bc-41d1-9626-ab1a3c7f32a0:3617:1875455681563008:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788574084.208619:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574084.208649:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faff0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69505170-06bc-41d1-9626-ab1a3c7f32a0:3619:1875455681563136:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788574084.208671:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574084.208688:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788574084.208694:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faff1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69505170-06bc-41d1-9626-ab1a3c7f32a0:3619:1875455681563264:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788574084.208716:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574084.208743:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681562880 00000100:00100000:2.0:1788574084.208748:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681562880 00010000:00010000:2.0:1788574084.208769:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c85faea2e00/0x5bf8706fdac8bdd9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8bdd2 expref: 24 pid: 6487 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574084.208785:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681563008 00000100:00100000:2.0:1788574084.208787:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681563008 00010000:00010000:2.0:1788574084.208798:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c85d20d7a00/0x5bf8706fdac8bcb3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8bcac expref: 25 pid: 6487 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574084.208816:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681563136 00000100:00100000:2.0:1788574084.208820:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681563136 00010000:00010000:2.0:1788574084.208832:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c860217e200/0x5bf8706fdac8bc5f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8bc58 expref: 26 pid: 6487 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574084.208841:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681563264 00000100:00100000:2.0:1788574084.208843:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681563264 00010000:00010000:2.0:1788574084.208853:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c860217e800/0x5bf8706fdac8bc51 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8bc4a expref: 27 pid: 6486 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574084.208863:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788574084.208869:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faff0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69505170-06bc-41d1-9626-ab1a3c7f32a0+27:3617:x1875455681562880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788574084.208879:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788574084.208885:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c85faea2e00/0x5bf8706fdac8bdd9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8bdd2 expref: 27 pid: 6487 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574084.208894:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c85faea2e00/0x5bf8706fdac8bdd9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5bf8706fdac8bdd2 expref: 27 pid: 6487 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574084.208910:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788574084.208939:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faff0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69505170-06bc-41d1-9626-ab1a3c7f32a0+27:3617:x1875455681562880:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574084.208946:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788574084.208958:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788574084.208963:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faff0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69505170-06bc-41d1-9626-ab1a3c7f32a0+26:3617:x1875455681563008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788574084.208971:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788574084.208975:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c85d20d7a00/0x5bf8706fdac8bcb3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8bcac expref: 26 pid: 6487 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574084.208993:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c85d20d7a00/0x5bf8706fdac8bcb3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5bf8706fdac8bcac expref: 26 pid: 6487 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574084.209002:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788574084.209025:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faff0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69505170-06bc-41d1-9626-ab1a3c7f32a0+26:3617:x1875455681563008:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574084.209031:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788574084.209043:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788574084.209048:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faff2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69505170-06bc-41d1-9626-ab1a3c7f32a0+25:3619:x1875455681563136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788574084.209054:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788574084.209058:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c860217e200/0x5bf8706fdac8bc5f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8bc58 expref: 25 pid: 6487 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574084.209065:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c860217e200/0x5bf8706fdac8bc5f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5bf8706fdac8bc58 expref: 25 pid: 6487 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574084.209073:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788574084.209093:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faff2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69505170-06bc-41d1-9626-ab1a3c7f32a0+25:3619:x1875455681563136:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574084.209098:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788574084.209108:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788574084.209113:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e0b79450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:3619:x1875455681563264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788574084.209120:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788574084.209124:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c860217e800/0x5bf8706fdac8bc51 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8bc4a expref: 24 pid: 6486 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574084.209131:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c860217e800/0x5bf8706fdac8bc51 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5bf8706fdac8bc4a expref: 24 pid: 6486 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574084.209146:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788574084.209169:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e0b79450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:3619:x1875455681563264:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574084.209175:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788574084.209261:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faff1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69505170-06bc-41d1-9626-ab1a3c7f32a0:3619:1875455681563264:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788574084.209271:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faff0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69505170-06bc-41d1-9626-ab1a3c7f32a0:3619:1875455681563136:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788574084.209308:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faff0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:69505170-06bc-41d1-9626-ab1a3c7f32a0:3617:1875455681563008:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788574084.209316:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faff3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:69505170-06bc-41d1-9626-ab1a3c7f32a0:3617:1875455681562880:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788574084.209713:0:10368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85faea2e00/0x5bf8706fdac8bdd9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5bf8706fdac8bdd2 expref: 23 pid: 6487 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574084.209727:0:10368:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3723480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10368:1875455681562368:0@lo:104: 00010000:00010000:1.0:1788574084.209738:0:10368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85d20d7a00/0x5bf8706fdac8bcb3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5bf8706fdac8bcac expref: 22 pid: 6487 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574084.209746:0:10368:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3720a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10368:1875455681562496:0@lo:104: 00010000:00010000:1.0:1788574084.209755:0:10368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c860217e200/0x5bf8706fdac8bc5f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5bf8706fdac8bc58 expref: 21 pid: 6487 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574084.209763:0:10368:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3721c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10368:1875455681562624:0@lo:104: 00010000:00010000:1.0:1788574084.209772:0:10368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c860217e800/0x5bf8706fdac8bc51 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5bf8706fdac8bc4a expref: 20 pid: 6486 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574084.209778:0:10368:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3720700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10368:1875455681562752:0@lo:104: 00000100:00100000:0.0:1788574084.217088:0:10368:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3723b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10368:1875455681562240:192.168.204.51@tcp:104: 00010000:00010000:0.0:1788574084.217134:0:10368:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c85c152e600/0x5bf8706fdac8bfb5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574084.219707:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574084.219796:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668918784 00000100:00100000:2.0:1788574084.219806:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668918784 00010000:00010000:2.0:1788574084.219845:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c85fa32e000/0x5bf8706fdac8bef1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d663d expref: 10 pid: 6487 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574084.219890:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 39 00000100:00100000:2.0:1788574084.219901:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3723b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+10:2394:x1875455668918784:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788574084.219915:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788574084.219936:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c85fa32e000/0x5bf8706fdac8bef1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d663d expref: 10 pid: 6487 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574084.219950:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c85fa32e000/0x5bf8706fdac8bef1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d663d expref: 10 pid: 6487 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574084.219970:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85fa32e000/0x5bf8706fdac8bef1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d663d expref: 10 pid: 6487 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574084.219999:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c85c152e600/0x5bf8706fdac8bfb5 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574084.220008:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85c152e600/0x5bf8706fdac8bfb5 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574084.220024:0:6479:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c85c152e600/0x5bf8706fdac8bfb5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574084.220031:0:6479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c85c152e600/0x5bf8706fdac8bfb5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574084.220039:0:6479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c85c152e600/0x5bf8706fdac8bfb5 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574084.220046:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c85c152e600/0x5bf8706fdac8bfb5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574084.220053:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85c152e600 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:2.0:1788574084.220057:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c85c152e600/0x5bf8706fdac8bfb5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574084.220066:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c85c152e600/0x5bf8706fdac8bfb5 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574084.220089:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c85c152e600/0x5bf8706fdac8bfb5 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574084.220100:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788574084.220164:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3723b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+9:2394:x1875455668918784:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 264us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574084.220179:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 39 00010000:00010000:0.0:1788574084.220433:0:10368:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c85c152e600/0x5bf8706fdac8bfb5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574084.220443:0:10368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c85c152e600/0x5bf8706fdac8bfb5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574084.220450:0:10368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85c152e600/0x5bf8706fdac8bfb5 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574084.755524:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574084.879957:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574084.880133:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668918912 00000100:00100000:1.0:1788574084.880143:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668918912 00000100:00100000:1.0:1788574084.880240:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 251 00000100:00100000:1.0:1788574084.880252:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c820e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+9:6164:x1875455668918912:12345-192.168.204.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788574084.880269:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574084.880298:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85faea2e00/0x5bf8706fdac8bfbc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6683 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574084.880342:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85faea2e00/0x5bf8706fdac8bfbc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6683 expref: 10 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574084.880353:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85faea2e00/0x5bf8706fdac8bfbc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6683 expref: 10 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574084.880363:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85faea2e00, rc 0) 00000100:00100000:1.0:1788574084.880775:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c820e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+10:6164:x1875455668918912:12345-192.168.204.51@tcp:101:ll_cfg_requeue.0 Request processed in 523us (825us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574084.880783:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 251 00000100:00100000:3.0:1788574084.883266:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574084.889564:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668919040 00000100:00100000:1.0:1788574084.889584:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668919040 00000100:00100000:2.0:1788574084.889750:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 252 00000100:00100000:2.0:1788574084.889761:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c820c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+10:6164:x1875455668919040:12345-192.168.204.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788574084.889951:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c820c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+10:6164:x1875455668919040:12345-192.168.204.51@tcp:501:ll_cfg_requeue.0 Request processed in 191us (6699us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574084.889959:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 252 00000100:00100000:0.0:1788574084.902032:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574084.902894:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668919168 00000100:00100000:1.0:1788574084.902908:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668919168 00000100:00100000:1.0:1788574084.902993:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 253 00000100:00100000:1.0:1788574084.903006:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c820c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+10:6164:x1875455668919168:12345-192.168.204.51@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788574084.903255:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c820c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+10:6164:x1875455668919168:12345-192.168.204.51@tcp:503:ll_cfg_requeue.0 Request processed in 250us (1240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574084.903265:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 253 00000100:00100000:3.0:1788574084.909098:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574084.911312:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668919296 00000100:00100000:0.0:1788574084.911336:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668919296 00000100:00100000:2.0:1788574084.922278:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 254 00000100:00100000:2.0:1788574084.922307:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c820e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+10:6708:x1875455668919296:12345-192.168.204.51@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788574084.923405:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c820e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+10:6708:x1875455668919296:12345-192.168.204.51@tcp:502:llog_process_th.0 Request processed in 1095us (14314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574084.923421:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 254 00000100:00100000:3.0:1788574084.937532:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574084.937789:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668919424 00000100:00100000:2.0:1788574084.937804:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668919424 00000100:00100000:2.0:1788574084.938046:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 255 00000100:00100000:2.0:1788574084.938059:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c820f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+10:6708:x1875455668919424:12345-192.168.204.51@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788574084.944455:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c820f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+10:6708:x1875455668919424:12345-192.168.204.51@tcp:502:llog_process_th.0 Request processed in 6380us (6922us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574084.944473:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 255 00000100:00100000:0.0:1788574085.206112:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574085.206265:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574085.206309:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574085.206410:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668919936 00000100:00100000:2.0:1788574085.206426:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668919936 00000100:00080000:3.0:1788574085.206498:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788574085.206589:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574085.206625:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668919808 00000100:00100000:0.0:1788574085.206629:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668919808 00000100:00100000:0.0:1788574085.206687:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 25 00000100:00100000:0.0:1788574085.206698:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3723480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:659467ff-94af-418e-92fe-11e4323a48aa+5:2395:x1875455668919808:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1788574085.206728:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 26 00000100:00100000:2.0:1788574085.206740:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3721c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:659467ff-94af-418e-92fe-11e4323a48aa+5:2395:x1875455668919936:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1788574085.206792:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3723480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:659467ff-94af-418e-92fe-11e4323a48aa+5:2395:x1875455668919808:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 95us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574085.206800:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 25 00000100:00100000:2.0:1788574085.206813:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3721c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:659467ff-94af-418e-92fe-11e4323a48aa+5:2395:x1875455668919936:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 76us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574085.206822:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 26 00000100:00100000:1.0:1788574085.207321:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668919680 00000100:00100000:1.0:1788574085.207327:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668919680 00000100:00100000:1.0:1788574085.207364:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668919552 00000100:00100000:1.0:1788574085.207366:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668919552 00000100:00100000:1.0:1788574085.207396:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 72 00000100:00100000:1.0:1788574085.207403:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3720700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+5:2395:x1875455668919680:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788574085.207440:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3720700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+5:2395:x1875455668919680:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 38us (1343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574085.207455:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 72 00000100:00100000:1.0:1788574085.207469:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 73 00000100:00100000:1.0:1788574085.207475:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3720a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+6:2395:x1875455668919552:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788574085.207500:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3720a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+6:2395:x1875455668919552:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 26us (1192us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574085.207506:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 73 00000100:00080000:3.0:1788574085.208949:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788574085.208958:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788574085.208963:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788574085.780343:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574085.782772:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faff3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681563392:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788574085.782883:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574085.783126:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681563392 00000100:00100000:2.0:1788574085.783137:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681563392 00000100:00100000:2.0:1788574085.783225:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788574085.783237:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3008000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681563392:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788574085.783290:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788574085.783352:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3008000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681563392:12345-0@lo:41:osp-pre-0-1.0 Request processed in 117us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574085.783360:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788574085.783579:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faff3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681563392:0@lo:41:osp-pre-0-1.0 10000000:01000000:2.0:1788574086.227595:0:6490:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788574086.227605:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c85f7fb1000 from 4 10000000:01000000:2.0:1788574086.227612:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788574086.227683:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85fa32f800/0x5bf8706fdac8bfc3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574086.227698:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c85fa32f800/0x5bf8706fdac8bfc3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574086.227712:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c85fa32f800/0x5bf8706fdac8bfc3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574086.227814:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faff0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681563520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788574086.228012:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574086.228173:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c3277cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788574086.228954:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681563520 00000100:00100000:0.0:1788574086.228966:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681563520 00000100:00100000:0.0:1788574086.229034:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1788574086.229044:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c860022b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+20:6490:x1875455681563520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788574086.229064:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574086.229082:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85c152ee00/0x5bf8706fdac8bfca lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8bfc3 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574086.229132:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85c152ee00/0x5bf8706fdac8bfca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8bfc3 expref: 21 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574086.229146:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85c152ee00/0x5bf8706fdac8bfca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8bfc3 expref: 21 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574086.229158:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85c152ee00, rc 0) 00000100:00100000:0.0:1788574086.229245:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c860022b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+21:6490:x1875455681563520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 201us (1234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574086.229928:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faff0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681563520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788574086.229955:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c85fa32f800/0x5bf8706fdac8bfc3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bfca expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574086.229979:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c85fa32f800/0x5bf8706fdac8bfc3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8bfca expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574086.230077:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faff0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681563648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788574086.230124:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574086.230242:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1788574086.230467:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c3277cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788574086.236962:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681563648 00000100:00100000:1.0:1788574086.236983:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681563648 00000100:00100000:1.0:1788574086.237113:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1788574086.237126:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8600229850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+21:6490:x1875455681563648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788574086.237754:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8600229850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+21:6490:x1875455681563648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 628us (7627us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574086.237764:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1788574086.237874:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faff0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681563648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788574086.237955:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faff0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681563776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788574086.238021:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574086.239559:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c3277cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788574086.242395:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681563776 00000100:00100000:3.0:1788574086.242417:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681563776 00000100:00100000:2.0:1788574086.244387:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1788574086.244404:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c860022b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+21:6490:x1875455681563776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788574086.244646:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c860022b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+21:6490:x1875455681563776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 245us (6624us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574086.244654:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1788574086.246065:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faff0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681563776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788574086.247855:0:10436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c8601837100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:10436:1875455681563904:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788574086.248034:0:10436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574086.248148:0:10436:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c60dc3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788574086.248313:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681563904 00000100:00100000:2.0:1788574086.248323:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681563904 00000100:00100000:2.0:1788574086.248540:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1788574086.248551:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5676450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+21:10436:x1875455681563904:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788574086.248717:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5676450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+21:10436:x1875455681563904:12345-0@lo:502:llog_process_th.0 Request processed in 167us (682us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574086.248831:0:10436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c8601837100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:10436:1875455681563904:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788574086.248877:0:10436:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788574086.248892:0:10436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574086.248894:0:10436:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788574086.248915:0:10436:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c85f7fb1000 00000020:00000080:1.0:1788574086.248918:0:10436:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788574086.249021:0:10436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c8601837100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:10436:1875455681564032:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788574086.249060:0:10436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574086.249090:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1788574086.256964:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681564032 00000100:00100000:2.0:1788574086.256982:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681564032 00000100:00100000:2.0:1788574086.257039:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1788574086.257049:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5674450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+21:10436:x1875455681564032:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788574086.257279:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5674450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+21:10436:x1875455681564032:12345-0@lo:502:llog_process_th.0 Request processed in 231us (8217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574086.257288:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1788574086.259642:0:10436:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8600c45180 going to sleep for 11 seconds 00000100:00100000:0.0:1788574086.259970:0:10436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c8601837100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:10436:1875455681564032:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788574086.260023:0:10436:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788574086.260034:0:10436:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788574086.260037:0:10436:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788574086.260042:0:10436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788574086.267014:0:6490:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788574086.267064:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788574086.267078:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85fa32f800/0x5bf8706fdac8bfc3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bfca expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574086.267094:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c85fa32f800/0x5bf8706fdac8bfc3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bfca expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788574086.267107:0:6490:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788574086.267110:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c85fad3f000 from 4 10000000:01000000:2.0:1788574086.267112:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788574086.267165:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85fa32e800/0x5bf8706fdac8bfd1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574086.267173:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c85fa32e800/0x5bf8706fdac8bfd1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574086.269830:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c85fa32e800/0x5bf8706fdac8bfd1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574086.269889:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faff0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681564160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788574086.270138:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574086.272023:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c3277780 going to sleep for 11 seconds 00000100:00100000:3.0:1788574086.277030:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681564160 00000100:00100000:3.0:1788574086.277051:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681564160 00000100:00100000:3.0:1788574086.277168:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1788574086.277181:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5674050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+21:6490:x1875455681564160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788574086.277216:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574086.277240:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c860204b800/0x5bf8706fdac8bfd8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8bfd1 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574086.277289:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c860204b800/0x5bf8706fdac8bfd8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8bfd1 expref: 22 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574086.277303:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c860204b800/0x5bf8706fdac8bfd8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8bfd1 expref: 22 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574086.277315:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c860204b800, rc 0) 00000100:00100000:3.0:1788574086.280989:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5674050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+22:6490:x1875455681564160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 3800us (10840us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574086.281004:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1788574086.281083:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faff0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681564160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788574086.281117:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c85fa32e800/0x5bf8706fdac8bfd1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bfd8 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574086.281134:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c85fa32e800/0x5bf8706fdac8bfd1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8bfd8 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574086.281268:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3008700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681564288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788574086.281315:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574086.281367:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c353ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1788574086.281973:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681564288 00000100:00100000:0.0:1788574086.281983:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681564288 00000100:00100000:0.0:1788574086.282027:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1788574086.282037:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5676050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+22:6490:x1875455681564288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788574086.282223:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5676050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+22:6490:x1875455681564288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 187us (907us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574086.282231:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1788574086.283248:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3008700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681564288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788574086.283316:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3008700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681564416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788574086.290526:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574086.290616:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c353ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1788574086.292879:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681564416 00000100:00100000:2.0:1788574086.292972:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681564416 00000100:00100000:2.0:1788574086.293041:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788574086.293052:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5677850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+22:6490:x1875455681564416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788574086.296579:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3008700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681564416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788574086.297544:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5677850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+22:6490:x1875455681564416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 4487us (7021us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574086.297561:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788574086.300224:0:10439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3008700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:10439:1875455681564544:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788574086.300349:0:10439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574086.302058:0:10439:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c353b780 going to sleep for 11 seconds 00000100:00100000:2.0:1788574086.302149:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681564544 00000100:00100000:2.0:1788574086.302160:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681564544 00000100:00100000:2.0:1788574086.302309:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788574086.302321:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5675050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+22:10439:x1875455681564544:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788574086.303161:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5675050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+22:10439:x1875455681564544:12345-0@lo:502:llog_process_th.0 Request processed in 838us (2809us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574086.303174:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788574086.304026:0:10439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3008700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:10439:1875455681564544:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788574086.304086:0:10439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788574086.304104:0:10439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574086.304107:0:10439:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788574086.304116:0:10439:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c85fad3f000 00000020:00000080:3.0:1788574086.304118:0:10439:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788574086.309236:0:10439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faff1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:10439:1875455681564672:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788574086.310218:0:10439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574086.310289:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681564672 00000100:00100000:2.0:1788574086.310298:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681564672 00000100:00100000:2.0:1788574086.311568:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788574086.311590:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5675c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+22:10439:x1875455681564672:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788574086.312608:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5675c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+22:10439:x1875455681564672:12345-0@lo:502:llog_process_th.0 Request processed in 1020us (2413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574086.312620:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788574086.315478:0:10439:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c3277d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788574086.315556:0:10439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faff1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:10439:1875455681564672:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788574086.315610:0:10439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788574086.315631:0:10439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574086.315634:0:10439:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788574086.315639:0:10439:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788574086.316013:0:6490:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788574086.316040:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788574086.316054:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85fa32e800/0x5bf8706fdac8bfd1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bfd8 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574086.316078:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c85fa32e800/0x5bf8706fdac8bfd1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bfd8 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788574086.316091:0:6490:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788574086.316094:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c85fa390800 from 4 10000000:01000000:3.0:1788574086.316098:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788574086.316144:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c860204b400/0x5bf8706fdac8bfdf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574086.316164:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c860204b400/0x5bf8706fdac8bfdf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574086.316174:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c860204b400/0x5bf8706fdac8bfdf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574086.316227:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3008700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681564800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788574086.316311:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574086.316353:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c353b780 going to sleep for 11 seconds 00000100:00100000:2.0:1788574086.316608:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681564800 00000100:00100000:2.0:1788574086.316616:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681564800 00000100:00100000:2.0:1788574086.316671:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788574086.316681:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5675450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+22:6490:x1875455681564800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788574086.316696:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574086.316712:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85fa32e000/0x5bf8706fdac8bfe6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8bfdf expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574086.316753:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85fa32e000/0x5bf8706fdac8bfe6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8bfdf expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574086.316766:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85fa32e000/0x5bf8706fdac8bfe6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8bfdf expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574086.316777:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85fa32e000, rc 0) 00000100:00100000:2.0:1788574086.316827:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5675450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+23:6490:x1875455681564800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574086.316834:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1788574086.317099:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3008700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681564800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788574086.317117:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c860204b400/0x5bf8706fdac8bfdf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bfe6 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574086.317130:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c860204b400/0x5bf8706fdac8bfdf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8bfe6 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574086.317228:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3008700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681564928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788574086.317269:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574086.317297:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c353b780 going to sleep for 11 seconds 00000100:00100000:3.0:1788574086.317312:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681564928 00000100:00100000:3.0:1788574086.317316:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681564928 00000100:00100000:3.0:1788574086.317341:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1788574086.317348:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5676850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+23:6490:x1875455681564928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788574086.317643:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5676850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+23:6490:x1875455681564928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 294us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574086.317651:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1788574086.317701:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3008700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681564928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788574086.317738:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3008700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681565056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788574086.317783:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574086.317795:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c353b780 going to sleep for 11 seconds 00000100:00100000:3.0:1788574086.317807:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681565056 00000100:00100000:3.0:1788574086.317810:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681565056 00000100:00100000:3.0:1788574086.317829:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1788574086.317836:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5677050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+23:6490:x1875455681565056:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788574086.318039:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5677050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+23:6490:x1875455681565056:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 202us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574086.318046:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1788574086.318143:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3008700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681565056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788574086.318952:0:10441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faff1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:10441:1875455681565184:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788574086.319014:0:10441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574086.319072:0:10441:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c3277900 going to sleep for 11 seconds 00000100:00100000:3.0:1788574086.319267:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681565184 00000100:00100000:3.0:1788574086.319274:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681565184 00000100:00100000:3.0:1788574086.319319:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1788574086.319327:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5675850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+23:10441:x1875455681565184:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788574086.319465:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5675850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+23:10441:x1875455681565184:12345-0@lo:502:llog_process_th.0 Request processed in 139us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574086.319473:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1788574086.319667:0:10441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faff1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:10441:1875455681565184:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788574086.319709:0:10441:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788574086.319729:0:10441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574086.319732:0:10441:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788574086.319741:0:10441:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c85fa390800 00000020:00000080:2.0:1788574086.319751:0:10441:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788574086.319847:0:10441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faff1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:10441:1875455681565312:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788574086.319886:0:10441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574086.319926:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681565312 00000100:00100000:2.0:1788574086.319931:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681565312 00000100:00100000:2.0:1788574086.319957:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1788574086.319965:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5677450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+23:10441:x1875455681565312:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788574086.320043:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5677450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+23:10441:x1875455681565312:12345-0@lo:502:llog_process_th.0 Request processed in 78us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574086.320051:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1788574086.320100:0:10441:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c3277900 going to sleep for 11 seconds 00000100:00100000:2.0:1788574086.320118:0:10441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faff1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:10441:1875455681565312:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788574086.320133:0:10441:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788574086.320137:0:10441:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574086.320139:0:10441:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788574086.320142:0:10441:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788574086.321524:0:6490:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788574086.321565:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788574086.321579:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c860204b400/0x5bf8706fdac8bfdf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bfe6 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574086.321594:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c860204b400/0x5bf8706fdac8bfdf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bfe6 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788574086.321619:0:6490:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788574086.321627:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c85c2bfb800 from 4 10000000:01000000:3.0:1788574086.321630:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788574086.321671:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c860204a600/0x5bf8706fdac8bfed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574086.321680:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c860204a600/0x5bf8706fdac8bfed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574086.321691:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c860204a600/0x5bf8706fdac8bfed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574086.321713:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3008700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681565440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788574086.321982:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574086.322030:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c353bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788574086.325775:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681565440 00000100:00100000:2.0:1788574086.325794:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681565440 00000100:00100000:2.0:1788574086.325864:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1788574086.325874:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5674850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+23:6490:x1875455681565440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788574086.325906:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574086.325933:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85fa32fa00/0x5bf8706fdac8bff4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8bfed expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574086.325968:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85fa32fa00/0x5bf8706fdac8bff4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8bfed expref: 24 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574086.325982:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85fa32fa00/0x5bf8706fdac8bff4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8bfed expref: 24 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574086.326006:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85fa32fa00, rc 0) 00000100:00100000:2.0:1788574086.326449:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5674850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:6490:x1875455681565440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 575us (4465us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574086.326457:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1788574086.326517:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3008700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681565440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788574086.326540:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c860204a600/0x5bf8706fdac8bfed lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bff4 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574086.326552:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c860204a600/0x5bf8706fdac8bfed lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8bff4 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574086.326644:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faff1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681565568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788574086.326685:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574086.326929:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c3277900 going to sleep for 11 seconds 00000100:00100000:2.0:1788574086.326949:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681565568 00000100:00100000:2.0:1788574086.326954:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681565568 00000100:00100000:2.0:1788574086.326977:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1788574086.326984:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5676c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:6490:x1875455681565568:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788574086.327238:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5676c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:6490:x1875455681565568:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 253us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574086.327246:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1788574086.327289:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faff1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681565568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788574086.327321:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faff1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681565696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788574086.327466:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574086.327493:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c3277900 going to sleep for 11 seconds 00000100:00100000:2.0:1788574086.327505:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681565696 00000100:00100000:2.0:1788574086.327508:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681565696 00000100:00100000:2.0:1788574086.327523:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1788574086.327529:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5674c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:6490:x1875455681565696:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788574086.327605:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5674c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:6490:x1875455681565696:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 75us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574086.327612:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1788574086.327649:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faff1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681565696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788574086.336081:0:10443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3009880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:10443:1875455681565824:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788574086.336224:0:10443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574086.336296:0:10443:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c353b480 going to sleep for 11 seconds 00000100:00100000:0.0:1788574086.336561:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681565824 00000100:00100000:0.0:1788574086.336572:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681565824 00000100:00100000:0.0:1788574086.336628:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1788574086.336639:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5677c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:10443:x1875455681565824:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788574086.336919:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5677c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:10443:x1875455681565824:12345-0@lo:502:llog_process_th.0 Request processed in 281us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574086.336930:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1788574086.337321:0:10443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3009880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:10443:1875455681565824:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788574086.337486:0:10443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788574086.337502:0:10443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574086.337505:0:10443:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788574086.337515:0:10443:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c85c2bfb800 00000020:00000080:3.0:1788574086.337518:0:10443:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788574086.337667:0:10443:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3009880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:10443:1875455681565952:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788574086.337736:0:10443:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574086.337768:0:10443:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c353b480 going to sleep for 11 seconds 00000100:00100000:2.0:1788574086.339777:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681565952 00000100:00100000:2.0:1788574086.339796:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681565952 00000100:00100000:2.0:1788574086.339865:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1788574086.339877:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5673850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:10443:x1875455681565952:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788574086.340077:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5673850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:10443:x1875455681565952:12345-0@lo:502:llog_process_th.0 Request processed in 203us (2341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574086.340087:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1788574086.340515:0:10443:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3009880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:10443:1875455681565952:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788574086.340556:0:10443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788574086.340569:0:10443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574086.340571:0:10443:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788574086.340578:0:10443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788574086.347491:0:6490:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788574086.347545:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788574086.347559:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c860204a600/0x5bf8706fdac8bfed lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bff4 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574086.347576:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c860204a600/0x5bf8706fdac8bfed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bff4 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574086.804130:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574087.315635:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788574087.315665:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faff1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681566080:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788574087.315821:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574087.316011:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788574087.316023:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faff0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681566208:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788574087.316056:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574087.316142:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681566080 00000100:00100000:1.0:1788574087.316153:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681566080 00000100:00100000:1.0:1788574087.316255:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681566208 00000100:00100000:1.0:1788574087.316259:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681566208 00000100:00100000:1.0:1788574087.316285:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788574087.316296:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3009880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681566080:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788574087.316335:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1788574087.316748:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788574087.316903:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3009500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681566336:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788574087.316943:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574087.317033:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3009880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681566080:12345-0@lo:13:osp-pre-0-1.0 Request processed in 738us (1211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574087.317041:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788574087.317065:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788574087.317073:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faff0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681566208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788574087.317087:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788574087.317218:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faff0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681566208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 146us (1159us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574087.317225:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1788574087.317283:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85faff1c00 x1875455681566080/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574103 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574087.317305:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faff1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681566080:0@lo:13:osp-pre-0-1.0 00010000:00080000:2.0:1788574087.317470:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85faff0700 x1875455681566208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574103 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574087.317485:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faff0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681566208:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788574087.317577:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681566336 00000100:00100000:0.0:1788574087.317585:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681566336 00000100:00100000:0.0:1788574087.317628:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788574087.317636:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faff2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681566336:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788574087.317666:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788574087.317862:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faff2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681566336:12345-0@lo:41:osp-pre-1-0.0 Request processed in 226us (917us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574087.317869:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788574087.317950:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3009500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681566336:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788574087.829294:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574088.339471:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faff0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:69505170-06bc-41d1-9626-ab1a3c7f32a0:3617:1875455681566464:0@lo:400:kworker.0 00000100:00100000:2.0:1788574088.339548:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574088.339602:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faff1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681566976:0@lo:400:kworker.0 00000100:00100000:2.0:1788574088.339629:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574088.339648:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681567488:0@lo:400:kworker.0 00000100:00100000:2.0:1788574088.339686:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574088.339716:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681568000:0@lo:400:kworker.0 00000100:00100000:2.0:1788574088.339738:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574088.339764:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788574088.339781:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faff2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875455681566592:0@lo:400:kworker.0 00000100:00100000:2.0:1788574088.339828:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574088.339889:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faff2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681566720:0@lo:400:kworker.0 00000100:00100000:3.0:1788574088.339921:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574088.339943:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faff0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1875455681567232:0@lo:400:kworker.0 00000100:00100000:3.0:1788574088.339974:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681566464 00000100:00100000:3.0:1788574088.339982:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681566464 00000100:00100000:3.0:1788574088.340029:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1788574088.340038:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5672050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:3617:x1875455681566464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574088.340097:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5672050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:3617:x1875455681566464:12345-0@lo:400:kworker.0 Request processed in 59us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574088.340104:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1788574088.340139:0:7533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681566976 00000100:00100000:3.0:1788574088.340143:0:7533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681566976 00000100:00100000:3.0:1788574088.340165:0:7533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681566720 00000100:00100000:3.0:1788574088.340169:0:7533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681566720 00000100:00100000:3.0:1788574088.340183:0:7533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788574088.340206:0:7533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681566976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574088.340251:0:7533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681566976:12345-0@lo:400:kworker.0 Request processed in 62us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574088.340258:0:7533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788574088.340278:0:7533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788574088.340284:0:7533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c300bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681566720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574088.340317:0:7533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c300bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681566720:12345-0@lo:400:kworker.0 Request processed in 33us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574088.340323:0:7533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788574088.340364:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faff1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875455681566848:0@lo:400:kworker.0 00000100:00100000:3.0:1788574088.340405:0:8815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681567488 00000100:00100000:3.0:1788574088.340408:0:8815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681567488 00000100:00100000:3.0:1788574088.340431:0:8815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681568000 00000100:00100000:3.0:1788574088.340434:0:8815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681568000 00000100:00100000:3.0:1788574088.340460:0:8815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788574088.340465:0:8815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681567488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574088.340494:0:8815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681567488:12345-0@lo:400:kworker.0 Request processed in 29us (821us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574088.340500:0:8815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788574088.340509:0:8815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788574088.340514:0:8815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681568000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574088.340535:0:8815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681568000:12345-0@lo:400:kworker.0 Request processed in 21us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574088.340540:0:8815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1788574088.340556:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788574088.343206:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3723800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681568128:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788574088.343321:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574088.343379:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681568128 00000100:00100000:3.0:1788574088.343386:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681568128 00000100:00100000:3.0:1788574088.343429:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788574088.343437:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3008700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681568128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788574088.343477:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788574088.343521:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3008700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681568128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574088.343528:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:3.0:1788574088.343568:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3723800 x1875455681568128/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574104 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574088.343586:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3723800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681568128:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788574088.350296:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574088.350351:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faff3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681567360:0@lo:400:kworker.0 00000100:00100000:2.0:1788574088.350410:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574088.350431:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681567872:0@lo:400:kworker.0 00000100:00100000:2.0:1788574088.350453:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574088.350482:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788574088.350488:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3009500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681568256:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788574088.350510:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574088.350539:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574088.350560:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1875455681567744:0@lo:400:kworker.0 00000100:00100000:2.0:1788574088.350583:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574088.350627:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faff2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681566720:0@lo:400:kworker.0 00000100:00100000:2.0:1788574088.350668:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681566592 00000100:00100000:2.0:1788574088.350694:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681566592 00000100:00100000:2.0:1788574088.352340:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681566848 00000100:00100000:2.0:1788574088.352349:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681566848 00000100:00100000:2.0:1788574088.352363:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681567232 00000100:00100000:2.0:1788574088.352366:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681567232 00000100:00100000:2.0:1788574088.352392:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681567744 00000100:00100000:2.0:1788574088.352395:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681567744 00000100:00100000:2.0:1788574088.352411:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788574088.352419:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3649f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875455681566592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574088.352494:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3649f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875455681566592:12345-0@lo:400:kworker.0 Request processed in 75us (12664us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574088.352501:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788574088.352519:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788574088.352524:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3649880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875455681566848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574088.352557:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3649880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875455681566848:12345-0@lo:400:kworker.0 Request processed in 33us (2270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574088.352563:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788574088.352574:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788574088.352580:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c364bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875455681567232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574088.352612:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c364bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875455681567232:12345-0@lo:400:kworker.0 Request processed in 32us (2073us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574088.352618:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788574088.352629:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788574088.352635:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c364aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875455681567744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574088.354915:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c364aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875455681567744:12345-0@lo:400:kworker.0 Request processed in 2271us (4323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574088.354929:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788574088.354979:0:8815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681567360 00000100:00100000:2.0:1788574088.354987:0:8815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681567360 00000100:00100000:2.0:1788574088.355022:0:8815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681567872 00000100:00100000:2.0:1788574088.355025:0:8815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681567872 00000100:00100000:2.0:1788574088.355063:0:8815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788574088.355071:0:8815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c364b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681567360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574088.355122:0:8815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c364b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681567360:12345-0@lo:400:kworker.0 Request processed in 53us (4712us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574088.355128:0:8815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788574088.355139:0:8815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788574088.355145:0:8815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3649500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681567872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574088.355171:0:8815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3649500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681567872:12345-0@lo:400:kworker.0 Request processed in 26us (4717us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574088.355176:0:8815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788574088.355213:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681568256 00000100:00100000:2.0:1788574088.355231:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681568256 00000100:00100000:2.0:1788574088.355255:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788574088.355261:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3649180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681568256:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788574088.355276:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788574088.355307:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3649180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681568256:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (4796us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574088.355313:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:2.0:1788574088.355343:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788574088.355347:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1788574088.355383:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3009500 x1875455681568256/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574104 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574088.355405:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3009500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681568256:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788574088.355433:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faff1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875455681566848:0@lo:400:kworker.0 00010000:00080000:2.0:1788574088.355445:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85faff3800 x1875455681567360/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574104 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574088.355453:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faff3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681567360:0@lo:400:kworker.0 00010000:00080000:2.0:1788574088.355461:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c1be2300 x1875455681567872/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574104 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574088.355470:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681567872:0@lo:400:kworker.0 00010000:00080000:2.0:1788574088.355513:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85faff0a80 x1875455681567232/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574104 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574088.355523:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faff0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1875455681567232:0@lo:400:kworker.0 00010000:00080000:2.0:1788574088.355534:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c1be1c00 x1875455681567744/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574104 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574088.355540:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1875455681567744:0@lo:400:kworker.0 00000100:00100000:2.0:1788574088.355595:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faff2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875455681566592:0@lo:400:kworker.0 00000100:00100000:2.0:1788574088.355606:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faff0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1875455681567104:0@lo:400:kworker.0 00000100:00100000:2.0:1788574088.355640:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574088.355663:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3617:1875455681567616:0@lo:400:kworker.0 00000100:00100000:2.0:1788574088.355697:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574088.355715:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681567104 00000100:00100000:2.0:1788574088.355719:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681567104 00000100:00100000:3.0:1788574088.357035:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faff0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:69505170-06bc-41d1-9626-ab1a3c7f32a0:3617:1875455681566464:0@lo:400:kworker.0 00000100:00100000:3.0:1788574088.357055:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faff1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681566976:0@lo:400:kworker.0 00010000:00080000:3.0:1788574088.357069:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c1be3800 x1875455681567488/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574104 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574088.357078:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681567488:0@lo:400:kworker.0 00010000:00080000:3.0:1788574088.357089:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c1be0a80 x1875455681568000/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574104 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574088.357097:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681568000:0@lo:400:kworker.0 00000100:00100000:2.0:1788574088.359942:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681567616 00000100:00100000:2.0:1788574088.359956:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681567616 00000100:00100000:2.0:1788574088.360003:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788574088.360013:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c364b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875455681567104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574088.360107:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c364b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875455681567104:12345-0@lo:400:kworker.0 Request processed in 95us (4465us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574088.360115:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788574088.360129:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788574088.360135:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3648380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875455681567616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574088.360161:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3648380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875455681567616:12345-0@lo:400:kworker.0 Request processed in 26us (4463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574088.360167:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:3.0:1788574088.360864:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788574088.360908:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faff0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1875455681567104:0@lo:400:kworker.0 00000100:00100000:3.0:1788574088.360922:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3617:1875455681567616:0@lo:400:kworker.0 00010000:00010000:3.0:1788574088.855480:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574089.888759:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574090.316448:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574090.316500:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574090.316533:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574090.316563:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574090.316586:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574090.316611:0:8815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668920576 00000100:00100000:3.0:1788574090.316621:0:8815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668920576 00000100:00100000:3.0:1788574090.316677:0:8815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668920448 00000100:00100000:3.0:1788574090.316681:0:8815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668920448 00000100:00100000:3.0:1788574090.316705:0:8815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 31 00000100:00100000:3.0:1788574090.316714:0:8815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c335d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:659467ff-94af-418e-92fe-11e4323a48aa+5:2394:x1875455668920576:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1788574090.316787:0:8815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c335d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:659467ff-94af-418e-92fe-11e4323a48aa+5:2394:x1875455668920576:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 74us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574090.316794:0:8815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 31 00000100:00100000:3.0:1788574090.316811:0:8815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 32 00000100:00100000:3.0:1788574090.316818:0:8815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de93a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:659467ff-94af-418e-92fe-11e4323a48aa+5:2394:x1875455668920448:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1788574090.316841:0:8815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de93a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:659467ff-94af-418e-92fe-11e4323a48aa+5:2394:x1875455668920448:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 24us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574090.316970:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668920064 00000100:00100000:1.0:1788574090.316974:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668920064 00000100:00100000:1.0:1788574090.317006:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 277 00000100:00100000:2.0:1788574090.317007:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668920320 00000100:00100000:2.0:1788574090.317011:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668920320 00000100:00100000:1.0:1788574090.317013:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5671050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+10:2394:x1875455668920064:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1788574090.317039:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668920192 00000100:00100000:1.0:1788574090.317040:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5671050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+10:2394:x1875455668920064:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 28us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574090.317041:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668920192 00000100:00100000:1.0:1788574090.317052:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 277 00000100:00100000:2.0:1788574090.317060:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 80 00000100:00100000:2.0:1788574090.317066:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3009500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+5:2394:x1875455668920320:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788574090.317087:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 81 00000100:00100000:1.0:1788574090.317093:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c335d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+6:2394:x1875455668920192:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1788574090.317094:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3009500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+5:2394:x1875455668920320:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 28us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574090.317100:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 80 00000100:00100000:1.0:1788574090.317115:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c335d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+6:2394:x1875455668920192:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 23us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574090.317121:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 81 00000100:00100000:3.0:1788574090.317165:0:8815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 32 00000100:00080000:3.0:1788574090.317225:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788574090.317230:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788574090.317232:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788574090.317235:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788574090.899765:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574090.900405:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788574090.900430:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c364b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681568384:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788574090.900506:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574090.900630:0:7533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681568384 00000100:00100000:2.0:1788574090.900638:0:7533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681568384 00000100:00100000:2.0:1788574090.900692:0:7533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788574090.900701:0:7533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601835880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681568384:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788574090.900738:0:7533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788574090.900786:0:7533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601835880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681568384:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574090.900801:0:7533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788574090.900879:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c364b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681568384:0@lo:41:osp-pre-0-1.0 00000001:02000400:0.0:1788574091.663400:0:10669:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg451-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:3.0:1788574091.925400:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574092.435515:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788574092.435549:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3723800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681568768:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788574092.435657:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574092.435711:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681568768 00000100:00100000:2.0:1788574092.435723:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681568768 00000100:00100000:1.0:1788574092.435740:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85de939880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681568640:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788574092.435803:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3648a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681568512:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788574092.435828:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574092.435848:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574092.435894:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681568640 00000100:00100000:1.0:1788574092.435900:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681568640 00000100:00100000:2.0:1788574092.447007:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681568512 00000100:00100000:2.0:1788574092.447029:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681568512 00000100:00100000:2.0:1788574092.447127:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788574092.447154:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3720000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681568768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788574092.447228:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788574092.447336:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3720000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681568768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 197us (11679us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574092.447346:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788574092.447372:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788574092.447380:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681568512:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788574092.447392:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788574092.447436:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681568512:12345-0@lo:13:osp-pre-0-1.0 Request processed in 58us (11589us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574092.447443:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1788574092.447502:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3723800 x1875455681568768/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574108 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574092.447530:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3723800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681568768:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1788574092.447576:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3648a80 x1875455681568512/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574108 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574092.447592:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3648a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681568512:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788574092.448014:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788574092.449173:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788574092.449210:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601835f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681568640:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788574092.449256:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788574092.449340:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601835f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681568640:12345-0@lo:41:osp-pre-1-0.0 Request processed in 154us (13516us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574092.449348:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788574092.449907:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85de939880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681568640:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788574092.949440:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574093.460791:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681568896:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788574093.460893:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574093.460991:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681568896 00000100:00100000:2.0:1788574093.460999:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681568896 00000100:00100000:2.0:1788574093.461065:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788574093.461075:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3648a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681568896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788574093.461103:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788574093.461160:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3648a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681568896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574093.461168:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:2.0:1788574093.461225:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85faf3f480 x1875455681568896/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574109 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574093.461245:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681568896:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788574093.461476:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788574093.461486:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788574093.461496:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85de939880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681569024:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788574093.461526:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574093.461676:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:69505170-06bc-41d1-9626-ab1a3c7f32a0:3618:1875455681569152:0@lo:400:kworker.0 00000100:00100000:0.0:1788574093.461703:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574093.461721:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681569664:0@lo:400:kworker.0 00000100:00100000:0.0:1788574093.461741:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574093.461753:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85ffaf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681570176:0@lo:400:kworker.0 00000100:00100000:0.0:1788574093.461770:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574093.461783:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788574093.461788:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875455681569536:0@lo:400:kworker.0 00000100:00100000:0.0:1788574093.461806:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574093.461836:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85ffaf7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681570048:0@lo:400:kworker.0 00000100:00100000:0.0:1788574093.461857:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574093.461880:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681569536 00000100:00100000:0.0:1788574093.461885:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681569536 00000100:00100000:0.0:1788574093.461915:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788574093.461922:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffaf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875455681569536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574093.461958:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffaf4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875455681569536:12345-0@lo:400:kworker.0 Request processed in 37us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574093.461965:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788574093.461994:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875455681569536:0@lo:400:kworker.0 00000100:00100000:3.0:1788574093.462177:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681569152 00000100:00100000:3.0:1788574093.462182:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681569152 00000100:00100000:3.0:1788574093.462234:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1788574093.462241:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5671c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:3618:x1875455681569152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574093.462281:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5671c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:3618:x1875455681569152:12345-0@lo:400:kworker.0 Request processed in 42us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574093.462294:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1788574093.462326:0:8815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681570176 00000100:00100000:3.0:1788574093.462330:0:8815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681570176 00000100:00100000:3.0:1788574093.462352:0:8815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681570048 00000100:00100000:3.0:1788574093.462354:0:8815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681570048 00000100:00100000:3.0:1788574093.462372:0:8815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788574093.462378:0:8815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffaf7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681570176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574093.462410:0:8815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffaf7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681570176:12345-0@lo:400:kworker.0 Request processed in 32us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574093.462416:0:8815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788574093.462427:0:8815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788574093.462432:0:8815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601b68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681570048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574093.462455:0:8815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601b68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681570048:12345-0@lo:400:kworker.0 Request processed in 23us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574093.462461:0:8815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788574093.462603:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681569024 00000100:00100000:3.0:1788574093.462607:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681569024 00000100:00100000:3.0:1788574093.462633:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788574093.462639:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681569024:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788574093.462650:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788574093.462677:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681569024:12345-0@lo:13:osp-pre-1-1.0 Request processed in 39us (1150us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574093.462682:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1788574093.462695:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788574093.462712:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85ffaf7100 x1875455681570048/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574109 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574093.462733:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85ffaf7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681570048:0@lo:400:kworker.0 00000100:00100000:3.0:1788574093.462744:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:69505170-06bc-41d1-9626-ab1a3c7f32a0:3618:1875455681569152:0@lo:400:kworker.0 00010000:00080000:3.0:1788574093.462753:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85ffaf5500 x1875455681570176/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574109 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574093.462759:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85ffaf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681570176:0@lo:400:kworker.0 00010000:00080000:3.0:1788574093.462768:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85de939880 x1875455681569024/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574109 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574093.462779:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85de939880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681569024:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788574093.462991:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875455681569280:0@lo:400:kworker.0 00000100:00100000:1.0:1788574093.463038:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574093.463067:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3619:1875455681569792:0@lo:400:kworker.0 00000100:00100000:1.0:1788574093.463103:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574093.463133:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85ffaf5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1875455681570304:0@lo:400:kworker.0 00000100:00100000:1.0:1788574093.463154:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574093.463177:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788574093.463183:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681569408:0@lo:400:kworker.0 00000100:00100000:1.0:1788574093.463234:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574093.463252:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1875455681569920:0@lo:400:kworker.0 00000100:00100000:1.0:1788574093.463271:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574093.463288:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85ffaf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1875455681570432:0@lo:400:kworker.0 00000100:00100000:1.0:1788574093.463306:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574093.463329:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681569664 00000100:00100000:1.0:1788574093.463333:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681569664 00000100:00100000:1.0:1788574093.463361:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681569408 00000100:00100000:1.0:1788574093.463364:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681569408 00000100:00100000:1.0:1788574093.463377:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788574093.463384:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffaf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681569664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574093.463425:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffaf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681569664:12345-0@lo:400:kworker.0 Request processed in 41us (1682us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574093.463431:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788574093.463444:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788574093.463450:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601834700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681569408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574093.463478:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601834700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681569408:12345-0@lo:400:kworker.0 Request processed in 29us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574093.463484:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788574093.463499:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681569280 00000100:00100000:1.0:1788574093.463502:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681569280 00000100:00100000:1.0:1788574093.463523:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681569792 00000100:00100000:1.0:1788574093.463525:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681569792 00000100:00100000:1.0:1788574093.463543:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681570304 00000100:00100000:1.0:1788574093.463546:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681570304 00000100:00100000:1.0:1788574093.463557:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681569920 00000100:00100000:1.0:1788574093.463560:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681569920 00000100:00100000:1.0:1788574093.463569:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681570432 00000100:00100000:1.0:1788574093.463571:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681570432 00000100:00100000:1.0:1788574093.463584:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788574093.463590:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601836d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875455681569280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574093.463618:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601836d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875455681569280:12345-0@lo:400:kworker.0 Request processed in 28us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574093.463624:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788574093.463635:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788574093.463641:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601836300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875455681569792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574093.463667:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601836300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875455681569792:12345-0@lo:400:kworker.0 Request processed in 27us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574093.463673:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788574093.463684:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788574093.463689:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601836680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875455681570304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574093.463716:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601836680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875455681570304:12345-0@lo:400:kworker.0 Request processed in 27us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574093.463722:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788574093.463731:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788574093.463737:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601834000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875455681569920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574093.463760:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601834000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875455681569920:12345-0@lo:400:kworker.0 Request processed in 23us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574093.463774:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788574093.463786:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788574093.463792:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601837800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875455681570432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574093.464110:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681569408:0@lo:400:kworker.0 00010000:00080000:3.0:1788574093.464136:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85faf3f480 x1875455681569920/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574109 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574093.464147:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1875455681569920:0@lo:400:kworker.0 00000100:00100000:3.0:1788574093.464158:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875455681569280:0@lo:400:kworker.0 00000100:00100000:3.0:1788574093.464167:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3619:1875455681569792:0@lo:400:kworker.0 00000100:00100000:3.0:1788574093.464175:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85ffaf5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1875455681570304:0@lo:400:kworker.0 00000100:00100000:3.0:1788574093.464235:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681569664:0@lo:400:kworker.0 00000100:00080000:3.0:1788574093.464258:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788574093.464262:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788574093.464570:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601837800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875455681570432:12345-0@lo:400:kworker.0 Request processed in 776us (1261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574093.464577:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00080000:3.0:1788574093.464957:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85ffaf7b80 x1875455681570432/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574109 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574093.464984:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85ffaf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1875455681570432:0@lo:400:kworker.0 00010000:00010000:2.0:1788574093.972370:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574095.004774:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574095.454774:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574095.454830:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574095.454854:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574095.454874:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574095.454897:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574095.454927:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668920704 00000100:00100000:0.0:1788574095.454938:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668920704 00000100:00100000:0.0:1788574095.454990:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 279 00000100:00100000:0.0:1788574095.455209:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5671450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+10:2396:x1875455668920704:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1788574095.455292:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5671450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+10:2396:x1875455668920704:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 292us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574095.455300:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 279 00000100:00100000:0.0:1788574095.455336:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668920960 00000100:00100000:0.0:1788574095.455340:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668920960 00000100:00100000:0.0:1788574095.455379:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668920832 00000100:00100000:0.0:1788574095.455382:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668920832 00000100:00100000:0.0:1788574095.455407:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 88 00000100:00100000:0.0:1788574095.455414:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffaf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+5:2396:x1875455668920960:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1788574095.455448:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffaf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+5:2396:x1875455668920960:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 34us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574095.455454:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 88 00000100:00100000:0.0:1788574095.455466:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 89 00000100:00100000:0.0:1788574095.455472:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffaf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+6:2396:x1875455668920832:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1788574095.455496:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffaf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+6:2396:x1875455668920832:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 24us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574095.455585:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 89 00000100:00100000:0.0:1788574095.455608:0:8815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668921088 00000100:00100000:0.0:1788574095.455613:0:8815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668921088 00000100:00100000:0.0:1788574095.455636:0:8815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668921216 00000100:00100000:0.0:1788574095.455640:0:8815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668921216 00000100:00100000:0.0:1788574095.455659:0:8815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 18 00000100:00100000:0.0:1788574095.455665:0:8815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffaf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:659467ff-94af-418e-92fe-11e4323a48aa+5:2392:x1875455668921088:12345-192.168.204.51@tcp:9:kworker.0 00000020:00000080:0.0:1788574095.455691:0:8815:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8bf06 00000100:00080000:0.0:1788574095.455701:0:8815:0:(import.c:65:import_set_state_nolock()) ffff9c84c3020000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788574095.455743:0:8815:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1788574095.455945:0:8815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffaf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:659467ff-94af-418e-92fe-11e4323a48aa+2:2392:x1875455668921088:12345-192.168.204.51@tcp:9:kworker.0 Request processed in 279us (1069us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574095.455953:0:8815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 18 00000100:00100000:0.0:1788574095.455965:0:8815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 19 00000100:00100000:0.0:1788574095.455971:0:8815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffaf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:659467ff-94af-418e-92fe-11e4323a48aa+5:2392:x1875455668921216:12345-192.168.204.51@tcp:9:kworker.0 00000020:00000080:0.0:1788574095.455984:0:8815:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8bf0d 00000100:00080000:0.0:1788574095.455990:0:8815:0:(import.c:65:import_set_state_nolock()) ffff9c84c3027000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788574095.456101:0:8815:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1788574095.456175:0:8815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffaf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:659467ff-94af-418e-92fe-11e4323a48aa+2:2392:x1875455668921216:12345-192.168.204.51@tcp:9:kworker.0 Request processed in 203us (1276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574095.456182:0:8815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 19 00000100:00080000:0.0:1788574095.456354:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788574095.456358:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788574095.456361:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788574095.456363:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1788574095.456440:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574095.456455:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574096.021422:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788574096.021445:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3648000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681570560:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788574096.021516:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574096.021655:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681570560 00000100:00100000:2.0:1788574096.021665:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681570560 00000100:00100000:2.0:1788574096.021712:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788574096.021720:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3649c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681570560:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788574096.021755:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788574096.021803:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3649c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681570560:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574096.021809:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788574096.021856:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3648000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681570560:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788574096.022851:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574097.054698:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788574097.344529:0:10913:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg451-server.virtnet: executing yml_node 00000100:00100000:2.0:1788574097.556856:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3648000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681570688:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788574097.556936:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574097.560390:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85de939880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681570944:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788574097.560458:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574097.560487:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788574097.560495:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c8601834a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681570816:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788574097.560520:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574097.560749:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681570688 00000100:00100000:2.0:1788574097.560757:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681570688 00000100:00100000:2.0:1788574097.560877:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681570816 00000100:00100000:2.0:1788574097.560881:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681570816 00000100:00100000:3.0:1788574097.560960:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788574097.560971:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3648700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681570688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788574097.561003:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788574097.561165:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3648700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681570688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 196us (4227us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574097.561173:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788574097.561216:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681570944 00000100:00100000:3.0:1788574097.561221:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681570944 00000100:00100000:3.0:1788574097.561247:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788574097.561253:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffaf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681570944:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788574097.561288:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788574097.561324:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffaf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681570944:12345-0@lo:41:osp-pre-1-0.0 Request processed in 72us (867us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574097.561330:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00080000:3.0:1788574097.561370:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3648000 x1875455681570688/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574113 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574097.561390:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3648000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681570688:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788574097.561425:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85de939880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681570944:0@lo:41:osp-pre-1-0.0 00000100:00080000:1.0:1788574097.564003:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788574097.564420:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788574097.564433:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffaf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681570816:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788574097.564457:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788574097.564533:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffaf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681570816:12345-0@lo:13:osp-pre-0-1.0 Request processed in 103us (4011us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574097.564540:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:1.0:1788574097.566314:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c8601834a80 x1875455681570816/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574113 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574097.566340:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c8601834a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681570816:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788574098.072892:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574098.579366:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788574098.579389:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85de939880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681571072:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788574098.579456:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574098.579638:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681571072 00000100:00100000:0.0:1788574098.579648:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681571072 00000100:00100000:0.0:1788574098.579706:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788574098.579716:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de93aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681571072:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788574098.579746:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788574098.579799:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de93aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681571072:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574098.579808:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788574098.579961:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85ffaf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875455681571584:0@lo:400:kworker.0 00000100:00100000:0.0:1788574098.579994:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574098.580016:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85ffaf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681572096:0@lo:400:kworker.0 00000100:00100000:0.0:1788574098.580053:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574098.580071:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681572608:0@lo:400:kworker.0 00000100:00100000:0.0:1788574098.580092:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574098.580110:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788574098.580116:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85ffaf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:69505170-06bc-41d1-9626-ab1a3c7f32a0:3617:1875455681571200:0@lo:400:kworker.0 00000100:00100000:0.0:1788574098.580143:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574098.580168:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85ffaf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681571712:0@lo:400:kworker.0 00000100:00100000:0.0:1788574098.580215:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574098.580244:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85ffaf7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681572224:0@lo:400:kworker.0 00000100:00100000:0.0:1788574098.580267:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574098.580293:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85ffaf6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875455681571328:0@lo:400:kworker.0 00000100:00100000:0.0:1788574098.580317:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574098.580333:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85ffaf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3619:1875455681571840:0@lo:400:kworker.0 00000100:00100000:0.0:1788574098.580350:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574098.580363:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85ffaf7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1875455681572352:0@lo:400:kworker.0 00000100:00100000:0.0:1788574098.580378:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574098.580393:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788574098.580397:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85ffaf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681571456:0@lo:400:kworker.0 00000100:00100000:0.0:1788574098.580432:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574098.580451:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85ffaf5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1875455681571968:0@lo:400:kworker.0 00000100:00100000:0.0:1788574098.580483:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574098.580496:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1875455681572480:0@lo:400:kworker.0 00000100:00100000:0.0:1788574098.580513:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574098.580534:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681571584 00000100:00100000:0.0:1788574098.580539:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681571584 00000100:00100000:0.0:1788574098.580561:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681571328 00000100:00100000:0.0:1788574098.580564:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681571328 00000100:00100000:0.0:1788574098.580573:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681571840 00000100:00100000:0.0:1788574098.580575:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681571840 00000100:00100000:0.0:1788574098.580587:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681572352 00000100:00100000:0.0:1788574098.580589:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681572352 00000100:00100000:0.0:1788574098.580600:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681571968 00000100:00100000:0.0:1788574098.580602:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681571968 00000100:00100000:0.0:1788574098.580611:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681572480 00000100:00100000:0.0:1788574098.580614:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681572480 00000100:00100000:0.0:1788574098.580626:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788574098.580640:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875455681571584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574098.580684:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875455681571584:12345-0@lo:400:kworker.0 Request processed in 44us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574098.580690:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788574098.580704:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788574098.580710:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875455681571328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574098.580741:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875455681571328:12345-0@lo:400:kworker.0 Request processed in 31us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574098.580746:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788574098.580756:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788574098.580761:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875455681571840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574098.580786:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875455681571840:12345-0@lo:400:kworker.0 Request processed in 25us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574098.580792:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788574098.580802:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788574098.580808:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875455681572352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574098.580831:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875455681572352:12345-0@lo:400:kworker.0 Request processed in 24us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574098.580837:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788574098.580845:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788574098.580850:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875455681571968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574098.580872:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875455681571968:12345-0@lo:400:kworker.0 Request processed in 22us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574098.580877:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788574098.580887:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788574098.580899:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875455681572480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574098.580924:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875455681572480:12345-0@lo:400:kworker.0 Request processed in 26us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574098.580929:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788574098.580947:0:8815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681572096 00000100:00100000:0.0:1788574098.580950:0:8815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681572096 00000100:00100000:0.0:1788574098.580970:0:8815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681572608 00000100:00100000:0.0:1788574098.580973:0:8815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681572608 00000100:00100000:0.0:1788574098.580985:0:8815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681572224 00000100:00100000:0.0:1788574098.580987:0:8815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681572224 00000100:00100000:0.0:1788574098.580997:0:8815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788574098.581002:0:8815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681572096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574098.581043:0:8815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681572096:12345-0@lo:400:kworker.0 Request processed in 40us (989us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574098.581049:0:8815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788574098.581060:0:8815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788574098.581066:0:8815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681572608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574098.581091:0:8815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681572608:12345-0@lo:400:kworker.0 Request processed in 26us (998us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574098.581096:0:8815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788574098.581108:0:8815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788574098.581113:0:8815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681572224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574098.581138:0:8815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681572224:12345-0@lo:400:kworker.0 Request processed in 26us (871us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574098.581144:0:8815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788574098.581165:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681571200 00000100:00100000:0.0:1788574098.581168:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681571200 00000100:00100000:0.0:1788574098.581228:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1788574098.581235:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5672850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:3617:x1875455681571200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574098.581265:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5672850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:3617:x1875455681571200:12345-0@lo:400:kworker.0 Request processed in 32us (1121us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574098.581272:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1788574098.581298:0:7533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681571712 00000100:00100000:0.0:1788574098.581302:0:7533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681571712 00000100:00100000:0.0:1788574098.581325:0:7533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681571456 00000100:00100000:0.0:1788574098.581327:0:7533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681571456 00000100:00100000:0.0:1788574098.581340:0:7533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788574098.581345:0:7533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681571712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574098.581375:0:7533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681571712:12345-0@lo:400:kworker.0 Request processed in 29us (1159us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574098.581380:0:7533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788574098.581391:0:7533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788574098.581396:0:7533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681571456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574098.581421:0:7533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681571456:12345-0@lo:400:kworker.0 Request processed in 25us (988us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574098.581426:0:7533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00080000:0.0:1788574098.581492:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85de939880 x1875455681571072/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574114 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574098.581512:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85de939880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681571072:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788574098.581542:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85ffaf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681571456:0@lo:400:kworker.0 00010000:00080000:0.0:1788574098.581552:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85ffaf5180 x1875455681571968/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574114 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574098.581573:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85ffaf5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1875455681571968:0@lo:400:kworker.0 00010000:00080000:0.0:1788574098.581586:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85faf3ce00 x1875455681572480/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574114 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574098.581593:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1875455681572480:0@lo:400:kworker.0 00000100:00100000:0.0:1788574098.581602:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85ffaf6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875455681571328:0@lo:400:kworker.0 00000100:00100000:0.0:1788574098.581611:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85ffaf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3619:1875455681571840:0@lo:400:kworker.0 00000100:00100000:0.0:1788574098.581620:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85ffaf7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1875455681572352:0@lo:400:kworker.0 00000100:00100000:0.0:1788574098.581652:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85ffaf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:69505170-06bc-41d1-9626-ab1a3c7f32a0:3617:1875455681571200:0@lo:400:kworker.0 00000100:00100000:0.0:1788574098.581661:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85ffaf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681571712:0@lo:400:kworker.0 00010000:00080000:0.0:1788574098.581670:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85ffaf7100 x1875455681572224/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574114 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574098.581678:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85ffaf7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681572224:0@lo:400:kworker.0 00000100:00100000:0.0:1788574098.581687:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85ffaf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875455681571584:0@lo:400:kworker.0 00010000:00080000:0.0:1788574098.581696:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85ffaf5500 x1875455681572096/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574114 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574098.581704:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85ffaf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681572096:0@lo:400:kworker.0 00010000:00080000:0.0:1788574098.581713:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85faf3dc00 x1875455681572608/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574114 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574098.581720:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681572608:0@lo:400:kworker.0 00000100:00080000:0.0:1788574098.584112:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788574098.584122:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788574098.584125:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788574098.587378:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788574098.587402:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681572736:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788574098.587478:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574098.587527:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681572736 00000100:00100000:0.0:1788574098.587535:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681572736 00000100:00100000:0.0:1788574098.587584:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788574098.587594:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681572736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788574098.587617:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788574098.587663:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681572736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574098.587671:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:0.0:1788574098.587714:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c36efb80 x1875455681572736/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574114 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574098.587735:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681572736:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788574099.091474:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574100.116956:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574100.554809:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574100.554855:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574100.554900:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668921344 00000100:00100000:0.0:1788574100.554914:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668921344 00000100:00100000:3.0:1788574100.554949:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574100.554993:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 281 00000100:00100000:0.0:1788574100.555006:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5673050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+10:2395:x1875455668921344:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1788574100.555098:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5673050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+10:2395:x1875455668921344:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 95us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574100.555107:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 281 00000100:00100000:1.0:1788574100.555227:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668921600 00000100:00100000:1.0:1788574100.555233:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668921600 00000100:00100000:1.0:1788574100.555283:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668921472 00000100:00100000:1.0:1788574100.555287:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668921472 00000100:00100000:1.0:1788574100.555307:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 96 00000100:00100000:1.0:1788574100.555318:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de93a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+5:2395:x1875455668921600:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1788574100.555325:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 97 00000100:00100000:2.0:1788574100.555338:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de939880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+6:2395:x1875455668921472:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788574100.555362:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de93a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+5:2395:x1875455668921600:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 46us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574100.555370:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 96 00000100:00100000:2.0:1788574100.555389:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de939880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+6:2395:x1875455668921472:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 41us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574100.555397:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 97 00000100:00080000:0.0:1788574100.555491:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788574100.555496:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788574101.140483:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3648e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681572864:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788574101.140569:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574101.140679:0:7533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681572864 00000100:00100000:0.0:1788574101.140688:0:7533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681572864 00000100:00100000:0.0:1788574101.140745:0:7533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788574101.140755:0:7533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681572864:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788574101.140794:0:7533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788574101.140849:0:7533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681572864:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574101.140856:0:7533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788574101.141034:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3648e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681572864:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788574101.141453:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788574101.142512:0:8404:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 659467ff-94af-418e-92fe-11e4323a48aa 00000020:00000080:1.0:1788574101.142529:0:8404:0:(genops.c:885:class_export_put()) final put ffff9c84c3024800/659467ff-94af-418e-92fe-11e4323a48aa 00000020:00000080:0.0:1788574101.142590:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c84c3024800/659467ff-94af-418e-92fe-11e4323a48aa for lustre-OST0000 00000020:00000080:0.0:1788574101.142642:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c84c3020000 for lustre-OST0000 00000001:00100000:1.0:1788574101.143165:0:9487:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 659467ff-94af-418e-92fe-11e4323a48aa 00000020:00000080:1.0:1788574101.143220:0:9487:0:(genops.c:885:class_export_put()) final put ffff9c84c3026800/659467ff-94af-418e-92fe-11e4323a48aa 00000020:00000080:0.0:1788574101.146389:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c84c3026800/659467ff-94af-418e-92fe-11e4323a48aa for lustre-OST0001 00000020:00000080:0.0:1788574101.146441:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c84c3027000 for lustre-OST0001 00010000:00010000:3.0:1788574102.167846:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788574102.524366:0:11097:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.3 00000100:00100000:2.0:1788574102.675667:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c8601834a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681572992:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788574102.675770:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574102.675899:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c8601836a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681573120:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788574102.675937:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574102.677642:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681572992 00000100:00100000:2.0:1788574102.677658:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681572992 00000100:00100000:2.0:1788574102.677750:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788574102.677765:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c364a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681572992:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788574102.677809:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788574102.677900:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c364a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681572992:12345-0@lo:13:osp-pre-0-1.0 Request processed in 140us (2130us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574102.677919:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:2.0:1788574102.677990:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c8601834a80 x1875455681572992/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574118 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574102.678011:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c8601834a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681572992:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788574102.678211:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788574102.682031:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c364a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681573248:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788574102.682138:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574102.682432:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681573248 00000100:00100000:2.0:1788574102.682445:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681573248 00000100:00100000:2.0:1788574102.682537:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788574102.682547:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681573248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788574102.682580:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788574102.682639:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681573248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574102.682647:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788574102.682832:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681573120 00000100:00100000:1.0:1788574102.682838:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681573120 00000100:00100000:1.0:1788574102.682869:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788574102.682876:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601837100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681573120:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788574102.682907:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788574102.682958:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601837100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681573120:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (7021us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574102.682965:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788574102.683012:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c8601836a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681573120:0@lo:41:osp-pre-1-0.0 00000100:00080000:0.0:1788574102.683082:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788574102.683111:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c364a300 x1875455681573248/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574118 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574102.683127:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c364a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681573248:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788574103.190090:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574103.699404:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788574103.699429:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681573376:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788574103.699510:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574103.699684:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681573376 00000100:00100000:2.0:1788574103.699691:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681573376 00000100:00100000:2.0:1788574103.699747:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788574103.699757:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681573376:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788574103.699785:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788574103.699828:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681573376:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574103.699834:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:2.0:1788574103.699855:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788574103.700152:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3648e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875455681573760:0@lo:400:kworker.0 00000100:00100000:0.0:1788574103.700227:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574103.700254:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c364b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3618:1875455681574272:0@lo:400:kworker.0 00000100:00100000:0.0:1788574103.700288:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574103.700312:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3618:1875455681574784:0@lo:400:kworker.0 00000100:00100000:0.0:1788574103.700335:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574103.700354:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788574103.700360:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c364a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:69505170-06bc-41d1-9626-ab1a3c7f32a0:3618:1875455681573632:0@lo:400:kworker.0 00000100:00100000:0.0:1788574103.700387:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574103.700414:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3649500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681574144:0@lo:400:kworker.0 00000100:00100000:0.0:1788574103.700436:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574103.700454:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3723800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681574656:0@lo:400:kworker.0 00000100:00100000:0.0:1788574103.700477:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574103.700505:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681573760 00000100:00100000:0.0:1788574103.700510:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681573760 00000100:00100000:0.0:1788574103.700536:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681574272 00000100:00100000:0.0:1788574103.700538:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681574272 00000100:00100000:0.0:1788574103.700556:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681574784 00000100:00100000:0.0:1788574103.700558:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681574784 00000100:00100000:0.0:1788574103.700570:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788574103.700576:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875455681573760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574103.700611:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875455681573760:12345-0@lo:400:kworker.0 Request processed in 35us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574103.700617:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788574103.700627:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788574103.700632:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875455681574272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574103.700654:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875455681574272:12345-0@lo:400:kworker.0 Request processed in 23us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574103.700660:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788574103.700678:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788574103.700682:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875455681574784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574103.700708:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875455681574784:12345-0@lo:400:kworker.0 Request processed in 25us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574103.700713:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788574103.700731:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681573632 00000100:00100000:0.0:1788574103.700735:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681573632 00000100:00100000:0.0:1788574103.700759:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1788574103.700765:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5671850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:3618:x1875455681573632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574103.700791:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5671850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:3618:x1875455681573632:12345-0@lo:400:kworker.0 Request processed in 26us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574103.700796:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1788574103.700821:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681574144 00000100:00100000:0.0:1788574103.700825:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681574144 00000100:00100000:0.0:1788574103.700849:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788574103.700856:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681574144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574103.700889:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681574144:12345-0@lo:400:kworker.0 Request processed in 33us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574103.700896:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788574103.700912:0:8815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681574656 00000100:00100000:0.0:1788574103.700915:0:8815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681574656 00000100:00100000:0.0:1788574103.700952:0:8815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788574103.700959:0:8815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681574656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574103.700987:0:8815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681574656:12345-0@lo:400:kworker.0 Request processed in 29us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574103.700993:0:8815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788574103.701025:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3648000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681573888:0@lo:400:kworker.0 00000100:00100000:0.0:1788574103.701154:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574103.701176:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3723480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1875455681574400:0@lo:400:kworker.0 00000100:00100000:0.0:1788574103.701217:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574103.701233:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1875455681574912:0@lo:400:kworker.0 00000100:00100000:0.0:1788574103.701253:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574103.701272:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1788574103.701278:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c364ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681573504:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788574103.701299:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574103.701317:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c364b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875455681574016:0@lo:400:kworker.0 00000100:00100000:0.0:1788574103.701337:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574103.701352:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3721c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681574528:0@lo:400:kworker.0 00000100:00100000:0.0:1788574103.701372:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574103.701386:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681575040:0@lo:400:kworker.0 00000100:00100000:0.0:1788574103.701403:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574103.701425:0:7533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681573888 00000100:00100000:0.0:1788574103.701429:0:7533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681573888 00000100:00100000:0.0:1788574103.701453:0:7533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788574103.701459:0:7533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681573888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574103.701492:0:7533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681573888:12345-0@lo:400:kworker.0 Request processed in 33us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574103.701499:0:7533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788574103.701514:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681574528 00000100:00100000:0.0:1788574103.701518:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681574528 00000100:00100000:0.0:1788574103.701535:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681575040 00000100:00100000:0.0:1788574103.701538:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681575040 00000100:00100000:0.0:1788574103.701557:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788574103.701572:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681574528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574103.701606:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681574528:12345-0@lo:400:kworker.0 Request processed in 35us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574103.701612:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788574103.701624:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788574103.701630:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681575040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574103.702151:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681574400 00000100:00100000:2.0:1788574103.702158:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681574400 00000100:00100000:2.0:1788574103.702183:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681574912 00000100:00100000:2.0:1788574103.702201:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681574912 00000100:00100000:2.0:1788574103.702216:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681574016 00000100:00100000:2.0:1788574103.702228:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681574016 00000100:00100000:2.0:1788574103.702243:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788574103.702249:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875455681574400:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1788574103.704786:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85faf5ce00 x1875455681573376/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574119 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574103.704817:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681573376:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1788574103.706266:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788574103.706276:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788574103.706279:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788574103.707323:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875455681574400:12345-0@lo:400:kworker.0 Request processed in 5066us (6097us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574103.707339:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788574103.707374:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788574103.707387:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875455681574912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574103.707439:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875455681574912:12345-0@lo:400:kworker.0 Request processed in 57us (6185us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574103.707445:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788574103.707455:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788574103.707462:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875455681574016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574103.707502:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875455681574016:12345-0@lo:400:kworker.0 Request processed in 41us (6164us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574103.707508:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788574103.707536:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681573504 00000100:00100000:2.0:1788574103.707545:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681573504 00000100:00100000:2.0:1788574103.707584:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788574103.707591:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3619:x1875455681573504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788574103.707608:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788574103.707641:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3619:x1875455681573504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (6341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574103.707648:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788574103.709009:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681575040:12345-0@lo:400:kworker.0 Request processed in 7370us (7595us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574103.709022:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:0.0:1788574103.709117:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c364ad80 x1875455681573504/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574119 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574103.709141:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c364ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681573504:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788574103.709156:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c364b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875455681574016:0@lo:400:kworker.0 00010000:00080000:0.0:1788574103.709169:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3721c00 x1875455681574528/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574119 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574103.709177:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3721c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681574528:0@lo:400:kworker.0 00010000:00080000:0.0:1788574103.709289:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c1be2d80 x1875455681575040/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574119 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574103.709300:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681575040:0@lo:400:kworker.0 00000100:00100000:0.0:1788574103.709314:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3648000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681573888:0@lo:400:kworker.0 00010000:00080000:0.0:1788574103.709324:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3723480 x1875455681574400/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574119 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574103.709331:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3723480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1875455681574400:0@lo:400:kworker.0 00010000:00080000:0.0:1788574103.709361:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c1be3100 x1875455681574912/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574119 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574103.709369:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1875455681574912:0@lo:400:kworker.0 00000100:00100000:0.0:1788574103.709430:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c364a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:69505170-06bc-41d1-9626-ab1a3c7f32a0:3618:1875455681573632:0@lo:400:kworker.0 00000100:00100000:0.0:1788574103.709443:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3649500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681574144:0@lo:400:kworker.0 00010000:00080000:0.0:1788574103.709455:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3723800 x1875455681574656/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574119 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574103.709464:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3723800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681574656:0@lo:400:kworker.0 00000100:00100000:0.0:1788574103.709813:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3648e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875455681573760:0@lo:400:kworker.0 00000100:00100000:0.0:1788574103.709827:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c364b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3618:1875455681574272:0@lo:400:kworker.0 00000100:00100000:0.0:1788574103.709839:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3618:1875455681574784:0@lo:400:kworker.0 00010000:00010000:1.0:1788574104.211356:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574105.236664:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788574105.431595:0:11194:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.3 00000100:00100000:0.0:1788574105.671816:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574105.671880:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574105.671928:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574105.671967:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668921856 00000100:00100000:0.0:1788574105.671981:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668921856 00000100:00100000:3.0:1788574105.672078:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668921728 00000100:00100000:0.0:1788574105.672097:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668921984 00000100:00100000:3.0:1788574105.672105:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668921728 00000100:00100000:0.0:1788574105.672105:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668921984 00000100:00100000:0.0:1788574105.672152:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 104 00000100:00100000:0.0:1788574105.672166:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3723800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+6:2394:x1875455668921856:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1788574105.672421:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 105 00000100:00100000:2.0:1788574105.672436:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3723480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+5:2394:x1875455668921984:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1788574105.672541:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3723480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+5:2394:x1875455668921984:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 108us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574105.672550:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 105 00000100:00100000:0.0:1788574105.672578:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3723800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+6:2394:x1875455668921856:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 413us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574105.672603:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 283 00000100:00100000:0.0:1788574105.672611:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 104 00000100:00100000:3.0:1788574105.672624:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5673450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+10:2394:x1875455668921728:12345-192.168.204.51@tcp:400:kworker.0 00000100:00080000:0.0:1788574105.672649:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788574105.672657:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788574105.672670:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5673450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+10:2394:x1875455668921728:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 52us (792us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574105.672679:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 283 00000100:00100000:0.0:1788574106.259590:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788574106.259614:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681575168:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788574106.259760:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788574106.259979:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574106.260047:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681575168 00000100:00100000:2.0:1788574106.260057:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681575168 00000100:00100000:2.0:1788574106.260119:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788574106.260129:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3721c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681575168:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788574106.260165:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788574106.260239:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3721c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681575168:12345-0@lo:41:osp-pre-0-1.0 Request processed in 111us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574106.260246:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788574106.260578:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681575168:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788574107.285150:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574107.795689:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788574107.795722:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c8601836a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681575296:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788574107.795861:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574107.795978:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681575296 00000100:00100000:2.0:1788574107.795988:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681575296 00000100:00100000:2.0:1788574107.796051:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788574107.796063:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681575296:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788574107.796110:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788574107.796168:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681575296:12345-0@lo:41:osp-pre-1-0.0 Request processed in 107us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574107.796176:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788574107.796256:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c8601836a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681575296:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788574107.798150:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c8601835180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681575424:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788574107.798270:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574107.798563:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681575424 00000100:00100000:1.0:1788574107.798574:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681575424 00000100:00100000:1.0:1788574107.798664:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788574107.798680:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c364b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681575424:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788574107.798726:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788574107.798789:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c364b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681575424:12345-0@lo:13:osp-pre-0-1.0 Request processed in 115us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574107.798797:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:1.0:1788574107.798856:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c8601835180 x1875455681575424/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574123 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574107.798877:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c8601835180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681575424:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788574107.799113:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681575552:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788574107.799160:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574107.799305:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681575552 00000100:00100000:2.0:1788574107.799310:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681575552 00000100:00100000:2.0:1788574107.799495:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788574107.800089:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681575552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788574107.800115:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788574107.800212:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681575552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 676us (1031us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574107.800221:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:3.0:1788574107.800320:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c1be1180 x1875455681575552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574123 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574107.800354:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681575552:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788574107.803600:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788574108.308733:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788574108.458555:0:11291:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.3 00000100:00100000:1.0:1788574108.822102:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3648e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:69505170-06bc-41d1-9626-ab1a3c7f32a0:3618:1875455681575808:0@lo:400:kworker.0 00000100:00100000:1.0:1788574108.822257:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574108.822326:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c364b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681576320:0@lo:400:kworker.0 00000100:00100000:1.0:1788574108.822359:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574108.822381:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85ffaf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681576832:0@lo:400:kworker.0 00000100:00100000:1.0:1788574108.822406:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574108.822425:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85ffaf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681577344:0@lo:400:kworker.0 00000100:00100000:1.0:1788574108.822444:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574108.822471:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1788574108.822477:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681575680:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788574108.822502:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574108.822521:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3648000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875455681576192:0@lo:400:kworker.0 00000100:00100000:1.0:1788574108.822548:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574108.822565:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681576704:0@lo:400:kworker.0 00000100:00100000:1.0:1788574108.822588:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574108.822607:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85ffaf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681577216:0@lo:400:kworker.0 00000100:00100000:1.0:1788574108.822629:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574108.822683:0:7533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681576320 00000100:00100000:1.0:1788574108.822694:0:7533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681576320 00000100:00100000:1.0:1788574108.822752:0:7533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788574108.822762:0:7533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601835180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681576320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574108.822844:0:7533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601835180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681576320:12345-0@lo:400:kworker.0 Request processed in 82us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574108.822853:0:7533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788574108.822899:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681576832 00000100:00100000:1.0:1788574108.822903:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681576832 00000100:00100000:1.0:1788574108.822923:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681577344 00000100:00100000:1.0:1788574108.822925:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681577344 00000100:00100000:1.0:1788574108.822948:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681576704 00000100:00100000:1.0:1788574108.822950:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681576704 00000100:00100000:1.0:1788574108.822960:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681577216 00000100:00100000:1.0:1788574108.822963:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681577216 00000100:00100000:1.0:1788574108.822977:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788574108.822983:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601835c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681576832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574108.823014:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601835c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681576832:12345-0@lo:400:kworker.0 Request processed in 31us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574108.823020:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788574108.823031:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788574108.823037:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601835500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681577344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574108.823061:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601835500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681577344:12345-0@lo:400:kworker.0 Request processed in 25us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574108.823067:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788574108.823077:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788574108.823083:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3726a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681576704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574108.823106:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3726a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681576704:12345-0@lo:400:kworker.0 Request processed in 23us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574108.823112:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788574108.823122:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788574108.823127:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3725180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681577216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574108.823150:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3725180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681577216:12345-0@lo:400:kworker.0 Request processed in 23us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574108.823165:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788574108.823221:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681575680 00000100:00100000:1.0:1788574108.823225:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681575680 00000100:00100000:1.0:1788574108.823249:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788574108.823256:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601836a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681575680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788574108.823285:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788574108.823319:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601836a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681575680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (816us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574108.823325:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:1.0:1788574108.823350:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788574108.823404:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c1be0a80 x1875455681575680/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574124 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574108.823425:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681575680:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1788574108.823436:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85faf3ce00 x1875455681576704/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574124 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574108.823445:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681576704:0@lo:400:kworker.0 00010000:00080000:1.0:1788574108.823453:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85ffaf5880 x1875455681577216/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574124 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574108.823459:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85ffaf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681577216:0@lo:400:kworker.0 00000100:00100000:1.0:1788574108.823468:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c364b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681576320:0@lo:400:kworker.0 00010000:00080000:1.0:1788574108.823475:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85ffaf5500 x1875455681576832/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574124 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574108.823482:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85ffaf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681576832:0@lo:400:kworker.0 00010000:00080000:1.0:1788574108.823499:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85ffaf6680 x1875455681577344/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574124 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574108.823507:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85ffaf6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681577344:0@lo:400:kworker.0 00000100:00100000:0.0:1788574108.823622:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681575808 00000100:00100000:0.0:1788574108.823628:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681575808 00000100:00100000:0.0:1788574108.823670:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1788574108.823677:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5670850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:3618:x1875455681575808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574108.823718:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5670850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:3618:x1875455681575808:12345-0@lo:400:kworker.0 Request processed in 42us (1462us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574108.823725:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1788574108.826897:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3648e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:69505170-06bc-41d1-9626-ab1a3c7f32a0:3618:1875455681575808:0@lo:400:kworker.0 00000100:00100000:2.0:1788574108.827049:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3649500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875455681575936:0@lo:400:kworker.0 00000100:00100000:2.0:1788574108.827141:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574108.827239:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c364ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3619:1875455681576448:0@lo:400:kworker.0 00000100:00100000:2.0:1788574108.827265:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574108.827290:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85ffaf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1875455681576960:0@lo:400:kworker.0 00000100:00100000:2.0:1788574108.827312:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574108.827341:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788574108.827348:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c364a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681576064:0@lo:400:kworker.0 00000100:00100000:2.0:1788574108.827375:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574108.827394:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1875455681576576:0@lo:400:kworker.0 00000100:00100000:2.0:1788574108.827416:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574108.827427:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85ffaf7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1875455681577088:0@lo:400:kworker.0 00000100:00100000:2.0:1788574108.827447:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574108.827476:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681576192 00000100:00100000:2.0:1788574108.827485:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681576192 00000100:00100000:2.0:1788574108.827536:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681575936 00000100:00100000:2.0:1788574108.827539:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681575936 00000100:00100000:2.0:1788574108.827550:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681576448 00000100:00100000:2.0:1788574108.827553:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681576448 00000100:00100000:2.0:1788574108.827578:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681576960 00000100:00100000:2.0:1788574108.827598:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681576960 00000100:00100000:2.0:1788574108.827617:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681576576 00000100:00100000:2.0:1788574108.827619:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681576576 00000100:00100000:2.0:1788574108.827632:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681577088 00000100:00100000:2.0:1788574108.827634:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681577088 00000100:00100000:2.0:1788574108.827650:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788574108.827659:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601834a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875455681576192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574108.827726:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601834a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875455681576192:12345-0@lo:400:kworker.0 Request processed in 67us (5177us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574108.827733:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788574108.827752:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788574108.827757:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875455681575936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574108.827791:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875455681575936:12345-0@lo:400:kworker.0 Request processed in 34us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574108.827797:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788574108.827809:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788574108.827815:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875455681576448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574108.827858:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875455681576448:12345-0@lo:400:kworker.0 Request processed in 44us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574108.827864:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788574108.827874:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788574108.827880:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875455681576960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574108.827909:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875455681576960:12345-0@lo:400:kworker.0 Request processed in 29us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574108.827915:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788574108.827925:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788574108.827931:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875455681576576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574108.827968:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875455681576576:12345-0@lo:400:kworker.0 Request processed in 38us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574108.827975:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788574108.827985:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788574108.827991:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875455681577088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574108.828016:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875455681577088:12345-0@lo:400:kworker.0 Request processed in 26us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574108.828022:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788574108.828041:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681576064 00000100:00100000:2.0:1788574108.828044:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681576064 00000100:00100000:2.0:1788574108.828072:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788574108.828078:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681576064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574108.828116:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681576064:12345-0@lo:400:kworker.0 Request processed in 38us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574108.828121:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:2.0:1788574108.828152:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788574108.828157:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788574108.828216:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c364a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681576064:0@lo:400:kworker.0 00010000:00080000:2.0:1788574108.828235:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85faf3dc00 x1875455681576576/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574124 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574108.828247:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1875455681576576:0@lo:400:kworker.0 00010000:00080000:2.0:1788574108.828258:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85ffaf7100 x1875455681577088/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574124 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574108.828267:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85ffaf7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1875455681577088:0@lo:400:kworker.0 00000100:00100000:2.0:1788574108.828293:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3649500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875455681575936:0@lo:400:kworker.0 00000100:00100000:2.0:1788574108.828304:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c364ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3619:1875455681576448:0@lo:400:kworker.0 00000100:00100000:2.0:1788574108.828314:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85ffaf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1875455681576960:0@lo:400:kworker.0 00000100:00100000:2.0:1788574108.828360:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3648000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875455681576192:0@lo:400:kworker.0 00000100:00100000:3.0:1788574108.828615:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681577472:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788574108.828659:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574108.829278:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681577472 00000100:00100000:1.0:1788574108.829288:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681577472 00000100:00100000:1.0:1788574108.829339:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788574108.829348:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681577472:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788574108.829384:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788574108.834468:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681577472:12345-0@lo:13:osp-pre-1-1.0 Request processed in 5105us (5791us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574108.834489:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:3.0:1788574108.835964:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c1be0380 x1875455681577472/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574124 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574108.836003:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681577472:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788574109.332238:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574110.359718:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788574110.537047:0:11340:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Fri Sep 4 22:08:28 EDT 2026 00000100:00100000:1.0:1788574110.801516:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574110.801572:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574110.801606:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574110.801843:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668922368 00000100:00100000:0.0:1788574110.801858:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668922368 00000100:00100000:0.0:1788574110.801948:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668922240 00000100:00100000:0.0:1788574110.801952:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668922240 00000100:00100000:0.0:1788574110.802000:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 112 00000100:00100000:0.0:1788574110.802011:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3724e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+5:2394:x1875455668922368:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1788574110.802115:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3724e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+5:2394:x1875455668922368:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 105us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574110.802124:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 112 00000100:00080000:1.0:1788574110.802129:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788574110.802135:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788574110.802163:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 113 00000100:00100000:0.0:1788574110.802169:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3727480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+6:2394:x1875455668922240:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1788574110.802238:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3727480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+6:2394:x1875455668922240:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 69us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574110.802245:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 113 00000100:00100000:3.0:1788574110.802570:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668922112 00000100:00100000:3.0:1788574110.802576:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668922112 00000100:00100000:3.0:1788574110.802624:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 285 00000100:00100000:3.0:1788574110.802633:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5670c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+10:2394:x1875455668922112:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1788574110.802687:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5670c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+10:2394:x1875455668922112:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 56us (1186us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574110.802695:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 285 00010000:00010000:2.0:1788574111.379581:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574111.380710:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788574111.380740:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681577600:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788574111.380845:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574111.380942:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681577600 00000100:00100000:2.0:1788574111.380952:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681577600 00000100:00100000:2.0:1788574111.381012:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788574111.381022:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681577600:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788574111.381069:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788574111.381124:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681577600:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574111.381133:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788574111.381218:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681577600:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788574112.410961:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574112.918925:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788574112.918954:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3725c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681577728:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788574112.919044:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574112.919135:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681577728 00000100:00100000:1.0:1788574112.919144:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681577728 00000100:00100000:1.0:1788574112.919239:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788574112.919253:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3724a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681577728:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788574112.919310:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788574112.919365:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3724a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681577728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 116us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574112.919373:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:1.0:1788574112.919404:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788574112.919448:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3725c00 x1875455681577728/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574128 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574112.919471:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3725c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681577728:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788574112.919499:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85ffaf7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681577856:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788574112.919527:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574112.919561:0:7533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681577856 00000100:00100000:1.0:1788574112.919565:0:7533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681577856 00000100:00100000:1.0:1788574112.919596:0:7533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788574112.919604:0:7533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3725c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681577856:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788574112.919634:0:7533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788574112.919673:0:7533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3725c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681577856:12345-0@lo:41:osp-pre-1-0.0 Request processed in 70us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574112.919679:0:7533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788574112.919709:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85ffaf7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681577856:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788574112.921647:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681577984:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788574112.921753:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574112.923686:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681577984 00000100:00100000:1.0:1788574112.923708:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681577984 00000100:00100000:1.0:1788574112.923872:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788574112.923884:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c2336680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681577984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788574112.923919:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788574112.924019:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c2336680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681577984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 136us (2276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574112.924034:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:1.0:1788574112.924099:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85faf5d500 x1875455681577984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574128 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574112.924124:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681577984:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788574112.928577:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788574113.427973:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574113.939361:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681578112:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788574113.939440:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574113.939498:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c364ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681578496:0@lo:400:kworker.0 00000100:00100000:0.0:1788574113.939512:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3648000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875455681578368:0@lo:400:kworker.0 00000100:00100000:1.0:1788574113.939531:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574113.939537:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574113.939555:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788574113.939561:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85ffaf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:69505170-06bc-41d1-9626-ab1a3c7f32a0:3618:1875455681578240:0@lo:400:kworker.0 00000100:00100000:1.0:1788574113.939579:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788574113.939585:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c364a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875455681578624:0@lo:400:kworker.0 00000100:00100000:0.0:1788574113.939587:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574113.939606:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574113.939623:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681578112 00000100:00100000:0.0:1788574113.939629:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681578112 00000100:00100000:1.0:1788574113.939652:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1875455681579008:0@lo:400:kworker.0 00000100:00100000:1.0:1788574113.939694:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574113.939698:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788574113.939706:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffaf6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681578112:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788574113.939746:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00002000:00000024:0.0:1788574113.939747:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788574113.939751:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681579136:0@lo:400:kworker.0 00000100:00100000:1.0:1788574113.939777:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574113.939784:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffaf6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681578112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574113.939791:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788574113.939802:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681579136 00000100:00100000:1.0:1788574113.939805:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681579136 00000100:00100000:0.0:1788574113.939812:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681578368 00000100:00100000:0.0:1788574113.939814:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681578368 00000100:00100000:0.0:1788574113.939833:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681578624 00000100:00100000:1.0:1788574113.939834:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788574113.939835:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681578624 00000100:00100000:1.0:1788574113.939840:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681579136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574113.939844:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681579008 00000100:00100000:0.0:1788574113.939853:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681579008 00000100:00100000:0.0:1788574113.939871:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788574113.939875:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681579136:12345-0@lo:400:kworker.0 Request processed in 35us (98us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574113.939877:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffaf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875455681578368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574113.939881:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788574113.939904:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffaf5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875455681578368:12345-0@lo:400:kworker.0 Request processed in 27us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574113.939910:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00010000:00080000:1.0:1788574113.939916:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c36dd880 x1875455681579136/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574129 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574113.939920:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788574113.939925:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3648e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875455681578624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574113.939931:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681579136:0@lo:400:kworker.0 00000100:00100000:1.0:1788574113.939988:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1875455681579520:0@lo:400:kworker.0 00000100:00100000:1.0:1788574113.940013:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574113.940052:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3648e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875455681578624:12345-0@lo:400:kworker.0 Request processed in 125us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574113.940058:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788574113.940068:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681579520 00000100:00100000:0.0:1788574113.940071:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681579520 00000100:00100000:1.0:1788574113.940073:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3618:1875455681578880:0@lo:400:kworker.0 00000100:00100000:0.0:1788574113.940088:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788574113.940093:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875455681579008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574113.940095:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574113.940106:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3618:1875455681579392:0@lo:400:kworker.0 00000100:00100000:0.0:1788574113.940118:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875455681579008:12345-0@lo:400:kworker.0 Request processed in 25us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574113.940122:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574113.940124:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788574113.940132:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681578880 00000100:00100000:0.0:1788574113.940134:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681578880 00000100:00100000:1.0:1788574113.940137:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3648000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875455681578368:0@lo:400:kworker.0 00000100:00100000:0.0:1788574113.940146:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681579392 00000100:00100000:1.0:1788574113.940149:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788574113.940149:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681579392 00000100:00100000:1.0:1788574113.940154:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c364b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681578752:0@lo:400:kworker.0 00000100:00100000:0.0:1788574113.940161:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788574113.940165:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875455681579520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574113.940174:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574113.940213:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681579264:0@lo:400:kworker.0 00000100:00100000:0.0:1788574113.940226:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875455681579520:12345-0@lo:400:kworker.0 Request processed in 60us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574113.940232:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574113.940232:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788574113.940251:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788574113.940255:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788574113.940256:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875455681578880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574113.940261:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875455681579392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574113.940670:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2337480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681579776:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788574113.940720:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681578496 00000100:00100000:2.0:1788574113.940737:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681578496 00000100:00100000:2.0:1788574113.940931:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681578752 00000100:00100000:2.0:1788574113.940935:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681578752 00000100:00100000:2.0:1788574113.941080:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788574113.941088:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3649500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681578496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574113.941166:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875455681579392:12345-0@lo:400:kworker.0 Request processed in 904us (1041us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574113.941175:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788574113.941221:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681578240 00000100:00100000:1.0:1788574113.941225:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681578240 00000100:00100000:1.0:1788574113.941254:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1788574113.941261:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5672c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:3618:x1875455681578240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574113.941303:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5672c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:3618:x1875455681578240:12345-0@lo:400:kworker.0 Request processed in 42us (1714us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574113.941310:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1788574113.941445:0:7533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788574113.941454:0:7533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681578752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574113.941486:0:7533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681578752:12345-0@lo:400:kworker.0 Request processed in 35us (1311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574113.941492:0:7533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788574113.941512:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681579264 00000100:00100000:1.0:1788574113.941516:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681579264 00000100:00100000:1.0:1788574113.941541:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788574113.941547:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681579264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574113.941591:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681579264:12345-0@lo:400:kworker.0 Request processed in 44us (1357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574113.941598:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788574113.941625:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681579648:0@lo:400:kworker.0 00000100:00100000:1.0:1788574113.941651:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788574113.941685:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85faf5d500 x1875455681578112/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574129 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574113.941704:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681578112:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788574113.941744:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681579648 00000100:00100000:1.0:1788574113.941748:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681579648 00000100:00100000:1.0:1788574113.941775:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788574113.941780:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681579648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574113.941813:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681579648:12345-0@lo:400:kworker.0 Request processed in 33us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574113.941820:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:1.0:1788574113.941846:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c36dea00 x1875455681579648/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574129 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574113.941866:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681579648:0@lo:400:kworker.0 00000100:00080000:1.0:1788574113.941905:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788574113.941909:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788574113.941912:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788574113.941945:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c36dd180 x1875455681579520/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574129 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574113.941956:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1875455681579520:0@lo:400:kworker.0 00010000:00080000:1.0:1788574113.941968:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85faf3ce00 x1875455681579008/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574129 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574113.941976:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1875455681579008:0@lo:400:kworker.0 00000100:00100000:1.0:1788574113.942568:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c364a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875455681578624:0@lo:400:kworker.0 00000100:00100000:1.0:1788574113.942670:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c364b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681578752:0@lo:400:kworker.0 00010000:00080000:1.0:1788574113.942681:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c36dd880 x1875455681579264/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574129 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574113.942681:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875455681578880:12345-0@lo:400:kworker.0 Request processed in 2423us (2583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574113.942689:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788574113.942690:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681579264:0@lo:400:kworker.0 00000100:00100000:1.0:1788574113.942700:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3618:1875455681578880:0@lo:400:kworker.0 00000100:00100000:1.0:1788574113.942711:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3618:1875455681579392:0@lo:400:kworker.0 00000100:00100000:1.0:1788574113.942732:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85ffaf7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:69505170-06bc-41d1-9626-ab1a3c7f32a0:3618:1875455681578240:0@lo:400:kworker.0 00000100:00100000:3.0:1788574113.946531:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574113.946858:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3649500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681578496:12345-0@lo:400:kworker.0 Request processed in 5767us (7322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574113.946883:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788574113.949140:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c364ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681578496:0@lo:400:kworker.0 00000100:00100000:1.0:1788574113.949226:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681579776 00000100:00100000:1.0:1788574113.949242:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681579776 00000100:00100000:1.0:1788574113.950407:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788574113.950422:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c2334700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681579776:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788574113.950451:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788574113.950530:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c2334700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681579776:12345-0@lo:13:osp-pre-1-1.0 Request processed in 112us (4006us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574113.950538:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:1.0:1788574113.950606:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c2337480 x1875455681579776/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574129 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574113.950624:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2337480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681579776:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788574114.463560:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574115.476080:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574115.913980:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574115.914166:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574115.914260:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574115.914302:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668922496 00000100:00100000:1.0:1788574115.914314:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668922496 00000100:00100000:1.0:1788574115.914368:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 287 00000100:00100000:1.0:1788574115.914378:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5673c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+10:2394:x1875455668922496:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788574115.914450:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5673c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+10:2394:x1875455668922496:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 74us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574115.914458:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 287 00000100:00100000:0.0:1788574115.914963:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668922624 00000100:00100000:0.0:1788574115.914969:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668922624 00000100:00100000:0.0:1788574115.915065:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668922752 00000100:00100000:0.0:1788574115.915069:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668922752 00000100:00100000:3.0:1788574115.915117:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 120 00000100:00100000:3.0:1788574115.915127:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c2337480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+6:2394:x1875455668922624:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1788574115.915174:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c2337480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+6:2394:x1875455668922624:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 49us (1204us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574115.915211:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 120 00000100:00080000:2.0:1788574115.915342:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788574115.915346:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788574115.915450:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 121 00000100:00100000:0.0:1788574115.915459:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa0e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+5:2394:x1875455668922752:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1788574115.915537:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa0e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+5:2394:x1875455668922752:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 79us (1277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574115.915545:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 121 00000100:00100000:1.0:1788574116.501773:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681579904:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788574116.501931:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788574116.502535:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574116.502605:0:7533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681579904 00000100:00100000:2.0:1788574116.502613:0:7533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681579904 00000100:00100000:2.0:1788574116.502682:0:7533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788574116.502693:0:7533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681579904:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788574116.502730:0:7533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788574116.502922:0:7533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681579904:12345-0@lo:41:osp-pre-0-1.0 Request processed in 229us (990us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574116.502929:0:7533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788574116.503377:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681579904:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788574117.523474:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574118.035432:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788574118.035456:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681580032:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788574118.035526:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574118.035607:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681580032 00000100:00100000:1.0:1788574118.035632:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681580032 00000100:00100000:1.0:1788574118.035708:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788574118.035720:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681580032:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788574118.035754:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788574118.035801:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681580032:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574118.035808:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1788574118.035829:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788574118.035875:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c36dd880 x1875455681580032/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574134 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574118.035893:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681580032:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788574118.036251:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85ffaf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681580160:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788574118.036288:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574118.036758:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788574118.036771:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c35f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681580288:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788574118.036806:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574118.036950:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681580288 00000100:00100000:3.0:1788574118.036957:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681580288 00000100:00100000:3.0:1788574118.037013:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788574118.037021:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681580288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788574118.037036:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788574118.037079:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681580288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574118.037086:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:3.0:1788574118.037125:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c35f8700 x1875455681580288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574134 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574118.037140:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c35f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681580288:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788574118.037402:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788574118.038261:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681580160 00000100:00100000:0.0:1788574118.038270:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681580160 00000100:00100000:0.0:1788574118.038821:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788574118.038833:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e57e3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681580160:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788574118.038884:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788574118.038992:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e57e3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681580160:12345-0@lo:41:osp-pre-1-0.0 Request processed in 161us (2702us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574118.039000:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788574118.039339:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85ffaf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681580160:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788574118.547953:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574119.060042:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788574119.060066:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85ffaf6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681580416:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788574119.060135:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574119.061804:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69505170-06bc-41d1-9626-ab1a3c7f32a0:3619:1875455681580544:0@lo:400:kworker.0 00000100:00100000:1.0:1788574119.061867:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574119.061911:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681581056:0@lo:400:kworker.0 00000100:00100000:1.0:1788574119.061938:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574119.061959:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faff1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681581568:0@lo:400:kworker.0 00000100:00100000:1.0:1788574119.061982:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574119.062005:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788574119.062011:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875455681580672:0@lo:400:kworker.0 00000100:00100000:1.0:1788574119.062034:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574119.062051:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3619:1875455681581184:0@lo:400:kworker.0 00000100:00100000:1.0:1788574119.062093:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574119.062111:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faff2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1875455681581696:0@lo:400:kworker.0 00000100:00100000:1.0:1788574119.062133:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574119.062179:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681581568 00000100:00100000:1.0:1788574119.062220:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681581568 00000100:00100000:1.0:1788574119.062271:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788574119.062280:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681581568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574119.062332:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681581568:12345-0@lo:400:kworker.0 Request processed in 53us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574119.062339:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788574119.062362:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681580672 00000100:00100000:1.0:1788574119.062365:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681580672 00000100:00100000:1.0:1788574119.062387:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681581184 00000100:00100000:1.0:1788574119.062390:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681581184 00000100:00100000:1.0:1788574119.062411:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681581696 00000100:00100000:1.0:1788574119.062414:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681581696 00000100:00100000:1.0:1788574119.062428:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788574119.062433:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875455681580672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574119.062462:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875455681580672:12345-0@lo:400:kworker.0 Request processed in 29us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574119.062469:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788574119.062480:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788574119.062485:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875455681581184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574119.062527:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875455681581184:12345-0@lo:400:kworker.0 Request processed in 41us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574119.062533:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788574119.062544:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788574119.062559:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875455681581696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574119.062588:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875455681581696:12345-0@lo:400:kworker.0 Request processed in 31us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574119.062593:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:1.0:1788574119.062616:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788574119.062659:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875455681580672:0@lo:400:kworker.0 00000100:00100000:1.0:1788574119.062669:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3619:1875455681581184:0@lo:400:kworker.0 00000100:00100000:1.0:1788574119.062677:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faff2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1875455681581696:0@lo:400:kworker.0 00010000:00080000:1.0:1788574119.062690:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85faff1500 x1875455681581568/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574135 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574119.062700:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faff1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681581568:0@lo:400:kworker.0 00000100:00100000:2.0:1788574119.063602:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681580544 00000100:00100000:2.0:1788574119.063612:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681580544 00000100:00100000:2.0:1788574119.063668:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1788574119.063677:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5672450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:3619:x1875455681580544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574119.063738:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5672450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:3619:x1875455681580544:12345-0@lo:400:kworker.0 Request processed in 63us (1870us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574119.063745:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1788574119.063931:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69505170-06bc-41d1-9626-ab1a3c7f32a0:3619:1875455681580544:0@lo:400:kworker.0 00000100:00100000:0.0:1788574119.064331:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681580800:0@lo:400:kworker.0 00000100:00100000:0.0:1788574119.064386:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574119.064411:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1875455681581312:0@lo:400:kworker.0 00000100:00100000:0.0:1788574119.064432:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574119.064451:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faff0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1875455681581824:0@lo:400:kworker.0 00000100:00100000:0.0:1788574119.064469:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574119.064494:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788574119.064515:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875455681580928:0@lo:400:kworker.0 00000100:00100000:0.0:1788574119.064539:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574119.064557:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681581440:0@lo:400:kworker.0 00000100:00100000:0.0:1788574119.064576:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574119.064591:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faff1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681581952:0@lo:400:kworker.0 00000100:00100000:0.0:1788574119.064608:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574119.064643:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681581312 00000100:00100000:0.0:1788574119.064648:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681581312 00000100:00100000:0.0:1788574119.064678:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681581824 00000100:00100000:0.0:1788574119.064681:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681581824 00000100:00100000:0.0:1788574119.064694:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681580928 00000100:00100000:0.0:1788574119.064696:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681580928 00000100:00100000:0.0:1788574119.064707:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788574119.064714:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffaf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875455681581312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574119.064755:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffaf7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875455681581312:12345-0@lo:400:kworker.0 Request processed in 42us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574119.064760:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788574119.064772:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788574119.064778:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffaf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875455681581824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574119.064986:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681581440 00000100:00100000:1.0:1788574119.064991:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681581440 00000100:00100000:1.0:1788574119.065020:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681581952 00000100:00100000:1.0:1788574119.065024:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681581952 00000100:00100000:1.0:1788574119.065041:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788574119.065047:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffaf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681581440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574119.065078:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffaf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681581440:12345-0@lo:400:kworker.0 Request processed in 32us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574119.065085:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788574119.065097:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788574119.065102:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffaf6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681581952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574119.065128:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffaf6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681581952:12345-0@lo:400:kworker.0 Request processed in 26us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574119.065141:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788574119.065165:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788574119.065172:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffaf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875455681580928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574119.065235:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffaf5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875455681580928:12345-0@lo:400:kworker.0 Request processed in 63us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574119.065240:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00080000:1.0:1788574119.065259:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788574119.065263:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788574119.065341:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffaf7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875455681581824:12345-0@lo:400:kworker.0 Request processed in 563us (870us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574119.065352:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788574119.065390:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875455681580928:0@lo:400:kworker.0 00010000:00080000:0.0:1788574119.065403:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c1be2d80 x1875455681581440/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574135 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574119.065413:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681581440:0@lo:400:kworker.0 00010000:00080000:0.0:1788574119.065422:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85faff1c00 x1875455681581952/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574135 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574119.065429:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faff1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681581952:0@lo:400:kworker.0 00010000:00080000:0.0:1788574119.065438:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c1be0a80 x1875455681581312/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574135 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574119.065445:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1875455681581312:0@lo:400:kworker.0 00010000:00080000:0.0:1788574119.065454:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85faff0000 x1875455681581824/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574135 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574119.065462:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faff0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1875455681581824:0@lo:400:kworker.0 00000100:00100000:2.0:1788574119.065891:0:7533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681581056 00000100:00100000:2.0:1788574119.065897:0:7533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681581056 00000100:00100000:2.0:1788574119.065936:0:7533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681580800 00000100:00100000:2.0:1788574119.065946:0:7533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681580800 00000100:00100000:2.0:1788574119.065966:0:7533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788574119.065973:0:7533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681581056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574119.066026:0:7533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681581056:12345-0@lo:400:kworker.0 Request processed in 53us (4086us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574119.066031:0:7533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788574119.066043:0:7533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788574119.066049:0:7533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffaf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681580800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574119.066081:0:7533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffaf6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681580800:12345-0@lo:400:kworker.0 Request processed in 32us (1695us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574119.066086:0:7533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788574119.066344:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681581056:0@lo:400:kworker.0 00000100:00100000:2.0:1788574119.067302:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681580416 00000100:00100000:2.0:1788574119.067310:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681580416 00000100:00100000:2.0:1788574119.067359:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788574119.067366:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffaf4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681580416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788574119.067392:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788574119.067445:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffaf4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681580416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (7310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574119.067452:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788574119.067559:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681580800:0@lo:400:kworker.0 00010000:00080000:0.0:1788574119.067573:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85ffaf6a00 x1875455681580416/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574135 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574119.067587:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85ffaf6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681580416:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788574119.068286:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788574119.068551:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788574119.068568:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c35f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681582080:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788574119.068634:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574119.068765:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681582080 00000100:00100000:2.0:1788574119.068771:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681582080 00000100:00100000:2.0:1788574119.068820:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788574119.068828:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffaf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681582080:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788574119.068847:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788574119.068905:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffaf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681582080:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574119.068912:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:0.0:1788574119.069014:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c35f8700 x1875455681582080/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574135 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574119.069031:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c35f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681582080:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788574119.571468:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574120.595676:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574121.048750:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574121.048798:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574121.048835:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574121.048948:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668922880 00000100:00100000:2.0:1788574121.048959:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668922880 00000100:00100000:2.0:1788574121.049020:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 289 00000100:00100000:2.0:1788574121.049030:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5670450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+10:2393:x1875455668922880:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1788574121.049097:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5670450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+10:2393:x1875455668922880:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 69us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574121.049104:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 289 00000100:00100000:1.0:1788574121.050278:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668923008 00000100:00100000:1.0:1788574121.050289:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668923008 00000100:00100000:1.0:1788574121.050352:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668923136 00000100:00100000:1.0:1788574121.050355:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668923136 00000100:00100000:1.0:1788574121.050391:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 128 00000100:00100000:1.0:1788574121.050401:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c35fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+6:2393:x1875455668923008:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788574121.050462:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c35fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+6:2393:x1875455668923008:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 63us (1723us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574121.050470:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 128 00000100:00100000:1.0:1788574121.050486:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 129 00000100:00100000:1.0:1788574121.050493:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c35f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+5:2393:x1875455668923136:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788574121.050516:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c35f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+5:2393:x1875455668923136:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 24us (1681us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574121.050521:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 129 00000100:00080000:2.0:1788574121.050832:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788574121.050837:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788574121.623589:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574121.628077:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788574121.628105:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c35f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681582208:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788574121.628242:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574121.628392:0:7533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681582208 00000100:00100000:3.0:1788574121.628401:0:7533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681582208 00000100:00100000:3.0:1788574121.628454:0:7533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788574121.628465:0:7533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c35faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681582208:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788574121.628498:0:7533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788574121.628545:0:7533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c35faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681582208:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574121.628573:0:7533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788574121.628635:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c35f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681582208:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788574122.644791:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574123.155439:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c35f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681582336:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788574123.155568:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574123.155657:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681582336 00000100:00100000:3.0:1788574123.155665:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681582336 00000100:00100000:3.0:1788574123.155734:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788574123.155746:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c35fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681582336:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788574123.155780:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788574123.155824:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c35fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681582336:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574123.155831:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:3.0:1788574123.155853:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788574123.155883:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c35f9880 x1875455681582336/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574139 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574123.155903:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c35f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681582336:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788574123.156007:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788574123.156017:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681582464:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788574123.156059:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574123.156083:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681582464 00000100:00100000:1.0:1788574123.156086:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681582464 00000100:00100000:1.0:1788574123.156126:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788574123.156132:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681582464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788574123.156143:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788574123.156172:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681582464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 40us (113us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574123.156178:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:1.0:1788574123.156225:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788574123.156242:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c36de680 x1875455681582464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574139 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574123.156255:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681582464:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788574123.158347:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788574123.158366:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85ffaf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681582592:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788574123.158419:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574123.158498:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681582592 00000100:00100000:0.0:1788574123.158505:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681582592 00000100:00100000:0.0:1788574123.158558:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788574123.158566:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681582592:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788574123.158595:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788574123.158670:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681582592:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574123.158677:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788574123.158751:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85ffaf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681582592:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788574123.667848:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574124.180911:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85ffaf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681582720:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788574124.180994:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574124.181121:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681582720 00000100:00100000:0.0:1788574124.181128:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681582720 00000100:00100000:0.0:1788574124.181183:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788574124.181219:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffaf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681582720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788574124.181249:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788574124.181293:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffaf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681582720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574124.181300:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:0.0:1788574124.181340:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85ffaf5880 x1875455681582720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574140 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788574124.181862:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788574124.181883:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681582848:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788574124.181925:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574124.181977:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681582848 00000100:00100000:1.0:1788574124.181981:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681582848 00000100:00100000:1.0:1788574124.182091:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788574124.182099:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681582848:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788574124.182115:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788574124.182147:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681582848:12345-0@lo:13:osp-pre-1-1.0 Request processed in 50us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574124.182153:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:1.0:1788574124.182169:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788574124.182330:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85ffaf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681582720:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1788574124.182411:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c36ded80 x1875455681582848/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574140 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574124.182426:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681582848:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788574124.182443:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788574124.182452:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faff0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:69505170-06bc-41d1-9626-ab1a3c7f32a0:3617:1875455681582976:0@lo:400:kworker.0 00000100:00100000:1.0:1788574124.182494:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574124.182630:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faff1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681583488:0@lo:400:kworker.0 00000100:00100000:0.0:1788574124.182669:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574124.182695:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faff1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681584000:0@lo:400:kworker.0 00000100:00100000:0.0:1788574124.182720:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574124.182739:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788574124.182745:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faff3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875455681583360:0@lo:400:kworker.0 00000100:00100000:0.0:1788574124.182769:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574124.182786:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faff1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681583872:0@lo:400:kworker.0 00000100:00100000:0.0:1788574124.182805:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574124.182830:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faff0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681583232:0@lo:400:kworker.0 00000100:00100000:0.0:1788574124.182850:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574124.182864:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faff0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3620:1875455681583744:0@lo:400:kworker.0 00000100:00100000:0.0:1788574124.182880:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574124.182892:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3620:1875455681584256:0@lo:400:kworker.0 00000100:00100000:0.0:1788574124.182907:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574124.182922:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788574124.182926:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faff2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875455681583104:0@lo:400:kworker.0 00000100:00100000:0.0:1788574124.182943:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574124.182956:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faff2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3620:1875455681583616:0@lo:400:kworker.0 00000100:00100000:0.0:1788574124.182971:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574124.182979:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faff2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3620:1875455681584128:0@lo:400:kworker.0 00000100:00100000:0.0:1788574124.182993:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574124.183010:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681583488 00000100:00100000:0.0:1788574124.183014:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681583488 00000100:00100000:1.0:1788574124.183109:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681582976 00000100:00100000:1.0:1788574124.183113:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681582976 00000100:00100000:1.0:1788574124.183145:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1788574124.183151:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5670050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:3617:x1875455681582976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574124.183268:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681583232 00000100:00100000:2.0:1788574124.183274:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681583232 00000100:00100000:2.0:1788574124.183307:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788574124.183316:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de938380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681583232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574124.183322:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5670050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:3617:x1875455681582976:12345-0@lo:400:kworker.0 Request processed in 168us (826us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574124.183331:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1788574124.183367:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681584000 00000100:00100000:1.0:1788574124.183371:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681584000 00000100:00100000:2.0:1788574124.183375:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de938380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681583232:12345-0@lo:400:kworker.0 Request processed in 59us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574124.183384:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788574124.183401:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681583872 00000100:00100000:1.0:1788574124.183405:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681583872 00000100:00100000:1.0:1788574124.183438:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788574124.183445:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de939180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681584000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574124.183481:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de939180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681584000:12345-0@lo:400:kworker.0 Request processed in 36us (760us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574124.183495:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788574124.183506:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788574124.183512:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de93b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681583872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574124.183556:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de93b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681583872:12345-0@lo:400:kworker.0 Request processed in 44us (749us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574124.183673:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788574124.183681:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffaf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681583488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574124.183719:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffaf5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681583488:12345-0@lo:400:kworker.0 Request processed in 40us (1050us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574124.183725:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788574124.183744:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681583360 00000100:00100000:0.0:1788574124.183747:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681583360 00000100:00100000:0.0:1788574124.183762:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681583744 00000100:00100000:0.0:1788574124.183764:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681583744 00000100:00100000:0.0:1788574124.183782:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681584256 00000100:00100000:0.0:1788574124.183785:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681584256 00000100:00100000:0.0:1788574124.183796:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681583104 00000100:00100000:0.0:1788574124.183799:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681583104 00000100:00100000:0.0:1788574124.183809:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681583616 00000100:00100000:0.0:1788574124.183812:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681583616 00000100:00100000:0.0:1788574124.183824:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681584128 00000100:00100000:0.0:1788574124.183827:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681584128 00000100:00100000:0.0:1788574124.183844:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788574124.183850:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de93bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875455681583360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574124.183878:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de93bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875455681583360:12345-0@lo:400:kworker.0 Request processed in 28us (1108us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574124.183884:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788574124.183893:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788574124.183899:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de938000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875455681583744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574124.183922:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de938000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875455681583744:12345-0@lo:400:kworker.0 Request processed in 24us (1041us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574124.183928:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788574124.183939:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788574124.183955:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788574124.183998:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de938a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875455681584256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574124.184035:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de938a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875455681584256:12345-0@lo:400:kworker.0 Request processed in 27us (1115us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574124.184121:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788574124.184129:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de93ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875455681583104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574124.184159:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de93ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875455681583104:12345-0@lo:400:kworker.0 Request processed in 32us (1215us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574124.184165:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788574124.184176:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788574124.184277:0:7439:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1788574124.184288:0:7439:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:1.0:1788574124.184315:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c2334a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875455681583616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574124.184353:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c2334a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875455681583616:12345-0@lo:400:kworker.0 Request processed in 171us (1379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574124.184360:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788574124.184375:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788574124.184383:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c2334000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875455681584128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574124.184407:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faff3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875455681583360:0@lo:400:kworker.0 00000100:00100000:1.0:1788574124.184421:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c2334000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875455681584128:12345-0@lo:400:kworker.0 Request processed in 38us (1424us total) trans 0 rc 0/0 00010000:00080000:3.0:1788574124.184428:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85faff1c00 x1875455681583872/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574140 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574124.184431:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788574124.184445:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faff1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681583872:0@lo:400:kworker.0 00000100:00100000:3.0:1788574124.184462:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faff1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681583488:0@lo:400:kworker.0 00000100:00100000:1.0:1788574124.184469:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faff0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:69505170-06bc-41d1-9626-ab1a3c7f32a0:3617:1875455681582976:0@lo:400:kworker.0 00010000:00080000:3.0:1788574124.184491:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85faff1500 x1875455681584000/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574140 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574124.184510:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faff1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681584000:0@lo:400:kworker.0 00000100:00100000:1.0:1788574124.184552:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faff2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875455681583104:0@lo:400:kworker.0 00000100:00100000:0.0:1788574124.184660:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00080000:0.0:1788574124.184682:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788574124.184686:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788574124.184737:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faff2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3620:1875455681583616:0@lo:400:kworker.0 00000100:00100000:1.0:1788574124.184748:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faff2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3620:1875455681584128:0@lo:400:kworker.0 00000100:00100000:1.0:1788574124.184758:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faff0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681583232:0@lo:400:kworker.0 00010000:00080000:1.0:1788574124.184770:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85faff0000 x1875455681583744/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574140 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574124.184779:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faff0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3620:1875455681583744:0@lo:400:kworker.0 00010000:00080000:1.0:1788574124.184791:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3c08a80 x1875455681584256/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574140 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574124.184798:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3620:1875455681584256:0@lo:400:kworker.0 00010000:00010000:1.0:1788574124.692477:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574125.717033:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574126.153561:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574126.153613:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574126.153920:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668923392 00000100:00100000:1.0:1788574126.153940:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668923392 00000100:00080000:0.0:1788574126.154008:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788574126.154019:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 136 00000100:00100000:1.0:1788574126.154031:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c35f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+6:2394:x1875455668923392:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788574126.154380:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c35f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+6:2394:x1875455668923392:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 351us (828us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574126.154389:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 136 00000100:00100000:3.0:1788574126.154542:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574126.154729:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668923520 00000100:00100000:1.0:1788574126.154734:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668923520 00000100:00100000:1.0:1788574126.154770:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 137 00000100:00100000:1.0:1788574126.154777:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c35f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+5:2394:x1875455668923520:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788574126.154820:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c35f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+5:2394:x1875455668923520:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 43us (279us total) trans 0 rc 0/0 00000100:00080000:0.0:1788574126.154826:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788574126.154843:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 137 00000100:00100000:2.0:1788574126.155373:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668923264 00000100:00100000:2.0:1788574126.155379:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668923264 00000100:00100000:2.0:1788574126.155413:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 291 00000100:00100000:2.0:1788574126.155421:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e564fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+10:2394:x1875455668923264:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1788574126.155454:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e564fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+10:2394:x1875455668923264:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 35us (1841us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574126.155461:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 291 00000100:00100000:3.0:1788574126.739594:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788574126.739617:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c35f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681584384:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788574126.739904:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574126.740433:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574126.741323:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681584384 00000100:00100000:0.0:1788574126.741335:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681584384 00000100:00100000:0.0:1788574126.741526:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788574126.741538:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c35fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681584384:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788574126.741577:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788574126.741654:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c35fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681584384:12345-0@lo:41:osp-pre-0-1.0 Request processed in 119us (1221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574126.741662:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788574126.741755:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c35f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681584384:0@lo:41:osp-pre-0-1.0 00000001:02000400:2.0:1788574127.538376:0:11970:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 22:08:45 (1788574125) === 00010000:00010000:1.0:1788574127.763410:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574128.277663:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c35f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681584512:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788574128.277777:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574128.278415:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681584512 00000100:00100000:1.0:1788574128.278431:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681584512 00000100:00100000:1.0:1788574128.278532:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788574128.278545:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c2335500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681584512:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788574128.278580:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788574128.278673:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c2335500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681584512:12345-0@lo:13:osp-pre-0-1.0 Request processed in 132us (896us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574128.278681:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:2.0:1788574128.278774:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788574128.279145:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c35f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681584640:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788574128.279245:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574128.279390:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681584640 00000100:00100000:3.0:1788574128.279400:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681584640 00000100:00100000:3.0:1788574128.279480:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788574128.279490:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681584640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788574128.279513:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788574128.279562:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681584640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574128.279570:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:2.0:1788574128.279714:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788574128.279753:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c35f8380 x1875455681584640/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574144 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574128.279776:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c35f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681584640:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1788574128.280080:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c35f8e00 x1875455681584512/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574144 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574128.280098:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c35f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681584512:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788574128.280173:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788574128.280183:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85e56c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681584768:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788574128.280251:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574128.280339:0:7533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681584768 00000100:00100000:3.0:1788574128.280345:0:7533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681584768 00000100:00100000:3.0:1788574128.280399:0:7533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788574128.280407:0:7533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681584768:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788574128.280441:0:7533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788574128.280504:0:7533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681584768:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574128.280526:0:7533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788574128.280607:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85e56c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681584768:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788574128.350061:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574128.350166:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668923648 00000100:00100000:3.0:1788574128.350181:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668923648 00000100:00100000:3.0:1788574128.350306:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 292 00000100:00100000:3.0:1788574128.350318:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e564e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+10:8728:x1875455668923648:12345-192.168.204.51@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788574128.350342:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574128.350366:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85c0031c00/0x5bf8706fdac8bffb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x652b547cf44d668a expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574128.350410:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85c0031c00/0x5bf8706fdac8bffb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d668a expref: 11 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574128.350424:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85c0031c00/0x5bf8706fdac8bffb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d668a expref: 11 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574128.350436:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85c0031c00, rc 0) 00000100:00100000:3.0:1788574128.350532:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e564e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+11:8728:x1875455668923648:12345-192.168.204.51@tcp:101:mount.lustre.0 Request processed in 216us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574128.350540:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 292 00000100:00100000:3.0:1788574128.363523:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574128.363700:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668923776 00000100:00100000:1.0:1788574128.363714:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668923776 00000100:00100000:1.0:1788574128.363788:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 293 00000100:00100000:1.0:1788574128.363801:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e564c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+11:8728:x1875455668923776:12345-192.168.204.51@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788574128.364061:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e564c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+11:8728:x1875455668923776:12345-192.168.204.51@tcp:501:mount.lustre.0 Request processed in 261us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574128.364071:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 293 00000100:00100000:0.0:1788574128.368330:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574128.368535:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668923904 00000100:00100000:2.0:1788574128.368549:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668923904 00000100:00100000:2.0:1788574128.368621:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 294 00000100:00100000:2.0:1788574128.368633:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e564c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+11:8728:x1875455668923904:12345-192.168.204.51@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788574128.370987:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e564c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+11:8728:x1875455668923904:12345-192.168.204.51@tcp:503:mount.lustre.0 Request processed in 2336us (2653us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574128.371006:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 294 00000100:00100000:2.0:1788574128.377998:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574128.378161:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668924032 00000100:00100000:3.0:1788574128.378174:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668924032 00000100:00100000:3.0:1788574128.378280:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 295 00000100:00100000:3.0:1788574128.378292:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e564e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+11:8732:x1875455668924032:12345-192.168.204.51@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788574128.378518:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e564e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+11:8732:x1875455668924032:12345-192.168.204.51@tcp:502:llog_process_th.0 Request processed in 227us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574128.378536:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 295 00000100:00100000:3.0:1788574128.410481:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574128.411262:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668924160 00000100:00100000:2.0:1788574128.411276:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668924160 00000100:00100000:2.0:1788574128.411353:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 296 00000100:00100000:2.0:1788574128.411366:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e564f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+11:8732:x1875455668924160:12345-192.168.204.51@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788574128.411603:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e564f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+11:8732:x1875455668924160:12345-192.168.204.51@tcp:502:llog_process_th.0 Request processed in 239us (1136us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574128.411613:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 296 00000100:00100000:0.0:1788574128.420959:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574128.421339:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668924288 00000100:00100000:1.0:1788574128.421354:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668924288 00000100:00100000:1.0:1788574128.421430:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 297 00000100:00100000:1.0:1788574128.421441:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e564d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+11:8732:x1875455668924288:12345-192.168.204.51@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788574128.421677:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e564d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+11:8732:x1875455668924288:12345-192.168.204.51@tcp:502:llog_process_th.0 Request processed in 237us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574128.421686:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 297 00000100:00100000:1.0:1788574128.430339:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574128.430478:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668924416 00000100:00100000:3.0:1788574128.430494:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668924416 00000100:00100000:3.0:1788574128.430567:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 298 00000100:00100000:3.0:1788574128.430578:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e564dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+11:8728:x1875455668924416:12345-192.168.204.51@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788574128.430600:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574128.430622:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85c0030e00/0x5bf8706fdac8c002 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x652b547cf44d66bb expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574128.430663:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85c0030e00/0x5bf8706fdac8c002 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d66bb expref: 12 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574128.430676:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85c0030e00/0x5bf8706fdac8c002 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d66bb expref: 12 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574128.430686:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85c0030e00, rc 0) 00000100:00100000:3.0:1788574128.430753:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e564dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+12:8728:x1875455668924416:12345-192.168.204.51@tcp:101:mount.lustre.0 Request processed in 176us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574128.430761:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 298 00000100:00100000:3.0:1788574128.437157:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574128.437361:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668924544 00000100:00100000:2.0:1788574128.437375:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668924544 00000100:00100000:2.0:1788574128.437454:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 299 00000100:00100000:2.0:1788574128.437466:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e564d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+12:8728:x1875455668924544:12345-192.168.204.51@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788574128.437517:0:6485:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788574128.437538:0:6485:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788574128.437542:0:6485:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788574128.437545:0:6485:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788574128.437548:0:6485:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1788574128.437551:0:6485:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:2.0:1788574128.440471:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e564d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+12:8728:x1875455668924544:12345-192.168.204.51@tcp:256:mount.lustre.0 Request processed in 2976us (3301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574128.440490:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 299 00000100:00100000:1.0:1788574128.444594:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574128.444722:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668924672 00000100:00100000:2.0:1788574128.444736:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668924672 00000100:00100000:2.0:1788574128.444806:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 300 00000100:00100000:2.0:1788574128.444817:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e564e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+12:8728:x1875455668924672:12345-192.168.204.51@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788574128.444838:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574128.444862:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85fa32f200/0x5bf8706fdac8c009 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x652b547cf44d66c2 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574128.444900:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85fa32f200/0x5bf8706fdac8c009 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d66c2 expref: 13 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574128.444914:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85fa32f200/0x5bf8706fdac8c009 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d66c2 expref: 13 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574128.444924:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85fa32f200, rc 0) 00000100:00100000:2.0:1788574128.445002:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e564e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+13:8728:x1875455668924672:12345-192.168.204.51@tcp:101:mount.lustre.0 Request processed in 186us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574128.445010:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 300 00000100:00100000:3.0:1788574128.446991:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574128.447173:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668924800 00000100:00100000:2.0:1788574128.447235:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668924800 00000100:00100000:2.0:1788574128.447375:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 301 00000100:00100000:2.0:1788574128.447387:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e564f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+13:8728:x1875455668924800:12345-192.168.204.51@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788574128.447609:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e564f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+13:8728:x1875455668924800:12345-192.168.204.51@tcp:501:mount.lustre.0 Request processed in 223us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574128.447618:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 301 00000100:00100000:0.0:1788574128.452481:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574128.454628:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668924928 00000100:00100000:1.0:1788574128.454648:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668924928 00000100:00100000:1.0:1788574128.454792:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 302 00000100:00100000:1.0:1788574128.454804:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e564d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+13:8728:x1875455668924928:12345-192.168.204.51@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788574128.455511:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e564d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+13:8728:x1875455668924928:12345-192.168.204.51@tcp:503:mount.lustre.0 Request processed in 707us (3042us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574128.455521:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 302 00000100:00100000:3.0:1788574128.458706:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574128.458806:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668925056 00000100:00100000:2.0:1788574128.458820:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668925056 00000100:00100000:2.0:1788574128.458897:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 303 00000100:00100000:2.0:1788574128.458910:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e564c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+13:8737:x1875455668925056:12345-192.168.204.51@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788574128.459815:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e564c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+13:8737:x1875455668925056:12345-192.168.204.51@tcp:502:llog_process_th.0 Request processed in 902us (1118us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574128.459828:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 303 00000100:00100000:0.0:1788574128.467626:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574128.467743:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668925184 00000100:00100000:1.0:1788574128.467761:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668925184 00000100:00100000:1.0:1788574128.467871:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 304 00000100:00100000:1.0:1788574128.467884:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e564cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+13:8737:x1875455668925184:12345-192.168.204.51@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788574128.468487:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e564cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+13:8737:x1875455668925184:12345-192.168.204.51@tcp:502:llog_process_th.0 Request processed in 603us (874us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574128.468498:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 304 00000100:00100000:3.0:1788574128.475406:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574128.475464:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574128.475499:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574128.475528:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574128.475588:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668926080 00000100:00100000:3.0:1788574128.475600:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668926080 00000100:00100000:3.0:1788574128.475677:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668925952 00000100:00100000:3.0:1788574128.475681:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668925952 00000100:00100000:3.0:1788574128.475699:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668925312 00000100:00100000:3.0:1788574128.475702:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668925312 00000100:00100000:3.0:1788574128.475713:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668925568 00000100:00100000:3.0:1788574128.475715:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668925568 00000100:00100000:3.0:1788574128.475729:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 138 00000100:00100000:3.0:1788574128.475741:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c35fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+5:2393:x1875455668926080:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1788574128.475838:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c35fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+5:2393:x1875455668926080:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 99us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574128.475848:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 138 00000100:00100000:3.0:1788574128.475870:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 139 00000100:00100000:3.0:1788574128.475876:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c35f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+6:2393:x1875455668925952:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1788574128.475902:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c35f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+6:2393:x1875455668925952:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 26us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574128.475909:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 139 00000100:00100000:3.0:1788574128.475920:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 16 00000100:00100000:3.0:1788574128.475925:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c35f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2392:x1875455668925312:12345-192.168.204.51@tcp:38:mount.lustre.0 00000100:00100000:0.0:1788574128.476064:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 17 00000100:00100000:0.0:1788574128.476072:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3658e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2392:x1875455668925568:12345-192.168.204.51@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788574128.476113:0:6492:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 38a8b838-f1df-4bf7-be24-5141ce328dae@192.168.204.51@tcp t0 exp 0000000000000000 cur 268 last 0 00000020:00000080:0.0:1788574128.476160:0:6492:0:(genops.c:1385:class_connect()) connect: client 38a8b838-f1df-4bf7-be24-5141ce328dae, cookie 0x5bf8706fdac8c010 00000004:00100000:0.0:1788574128.476222:0:6492:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00010000:00080000:3.0:1788574128.477816:0:7439:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 38a8b838-f1df-4bf7-be24-5141ce328dae@192.168.204.51@tcp t0 exp 0000000000000000 cur 268 last 0 00000020:00000080:3.0:1788574128.477863:0:7439:0:(genops.c:1385:class_connect()) connect: client 38a8b838-f1df-4bf7-be24-5141ce328dae, cookie 0x5bf8706fdac8c017 00000004:00100000:3.0:1788574128.477894:0:7439:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788574128.478370:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788574128.478377:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788574128.479879:0:7439:0:(import.c:65:import_set_state_nolock()) ffff9c85ffb11800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788574128.480021:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c35f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38a8b838-f1df-4bf7-be24-5141ce328dae+6:2392:x1875455668925312:12345-192.168.204.51@tcp:38:mount.lustre.0 Request processed in 4088us (4513us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574128.480299:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 16 00000100:00080000:0.0:1788574128.481585:0:6492:0:(import.c:65:import_set_state_nolock()) ffff9c85ffb1c800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788574128.481769:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3658e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38a8b838-f1df-4bf7-be24-5141ce328dae+6:2392:x1875455668925568:12345-192.168.204.51@tcp:38:mount.lustre.0 Request processed in 5693us (6236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574128.481781:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 17 00000100:00100000:2.0:1788574128.484898:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574128.485184:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668925824 00000100:00100000:1.0:1788574128.485304:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668925824 00000100:00100000:1.0:1788574128.485416:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 18 00000100:00100000:1.0:1788574128.485429:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38a8b838-f1df-4bf7-be24-5141ce328dae+6:8728:x1875455668925824:12345-192.168.204.51@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788574128.485495:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788574128.485725:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38a8b838-f1df-4bf7-be24-5141ce328dae+6:8728:x1875455668925824:12345-192.168.204.51@tcp:41:mount.lustre.0 Request processed in 296us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574128.485734:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 18 00000100:00080000:2.0:1788574128.487350:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788574128.488399:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574128.488574:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574128.488668:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668925696 00000100:00100000:2.0:1788574128.488681:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668925696 00000100:00100000:2.0:1788574128.488761:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668925440 00000100:00100000:2.0:1788574128.488765:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668925440 00000100:00100000:2.0:1788574128.488793:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 19 00000100:00100000:2.0:1788574128.488804:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c365a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38a8b838-f1df-4bf7-be24-5141ce328dae+6:0:x1875455668925696:12345-192.168.204.51@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788574128.488863:0:7439:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788574128.488978:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c365a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38a8b838-f1df-4bf7-be24-5141ce328dae+6:0:x1875455668925696:12345-192.168.204.51@tcp:41:mount.lustre.0 Request processed in 175us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574128.488987:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 19 00000100:00100000:2.0:1788574128.489006:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 20 00000100:00100000:2.0:1788574128.489012:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3658700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38a8b838-f1df-4bf7-be24-5141ce328dae+6:0:x1875455668925440:12345-192.168.204.51@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788574128.489026:0:7439:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788574128.489068:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3658700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38a8b838-f1df-4bf7-be24-5141ce328dae+6:0:x1875455668925440:12345-192.168.204.51@tcp:41:mount.lustre.0 Request processed in 55us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574128.489075:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 20 00000100:00080000:3.0:1788574128.490399:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788574128.493464:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574128.493593:0:11893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668926208 00000100:00100000:3.0:1788574128.493606:0:11893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668926208 00000100:00100000:3.0:1788574128.493677:0:11893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 21 00000100:00100000:3.0:1788574128.493688:0:11893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e56c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:38a8b838-f1df-4bf7-be24-5141ce328dae+6:8728:x1875455668926208:12345-192.168.204.51@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788574128.493797:0:11893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e56c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:38a8b838-f1df-4bf7-be24-5141ce328dae+6:8728:x1875455668926208:12345-192.168.204.51@tcp:40:mount.lustre.0 Request processed in 111us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574128.493805:0:11893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 21 00000100:00100000:2.0:1788574128.503833:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574128.504175:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668926336 00000100:00100000:1.0:1788574128.504228:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668926336 00000100:00100000:1.0:1788574128.504311:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 20 00000100:00100000:1.0:1788574128.504321:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2392:x1875455668926336:12345-192.168.204.51@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788574128.504368:0:8409:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 38a8b838-f1df-4bf7-be24-5141ce328dae@192.168.204.51@tcp t0 exp 0000000000000000 cur 268 last 0 00000020:00000080:1.0:1788574128.504412:0:8409:0:(genops.c:1385:class_connect()) connect: client 38a8b838-f1df-4bf7-be24-5141ce328dae, cookie 0x5bf8706fdac8c01e 00002000:00100000:1.0:1788574128.504429:0:8409:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 38a8b838-f1df-4bf7-be24-5141ce328dae/ffff9c84c369d800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788574128.504454:0:8409:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788574128.504566:0:8409:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788574128.504605:0:8409:0:(import.c:65:import_set_state_nolock()) ffff9c84c3698000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788574128.504690:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:38a8b838-f1df-4bf7-be24-5141ce328dae+6:2392:x1875455668926336:12345-192.168.204.51@tcp:8:mount.lustre.0 Request processed in 368us (871us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574128.504699:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 20 00000100:00100000:0.0:1788574128.507622:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574128.507666:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574128.507772:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668926592 00000100:00100000:2.0:1788574128.507785:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668926592 00000100:00100000:2.0:1788574128.507872:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 5 00000100:00100000:2.0:1788574128.507883:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e56c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:38a8b838-f1df-4bf7-be24-5141ce328dae+6:8728:x1875455668926592:12345-192.168.204.51@tcp:900:mount.lustre.0 00000100:00100000:2.0:1788574128.508017:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e56c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:38a8b838-f1df-4bf7-be24-5141ce328dae+6:8728:x1875455668926592:12345-192.168.204.51@tcp:900:mount.lustre.0 Request processed in 136us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574128.508026:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 5 00000100:00100000:3.0:1788574128.513577:0:8815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668926464 00000100:00100000:3.0:1788574128.513601:0:8815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668926464 00000100:00100000:3.0:1788574128.513678:0:8815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 21 00000100:00100000:3.0:1788574128.513688:0:8815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e56c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2392:x1875455668926464:12345-192.168.204.51@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788574128.513740:0:8815:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 38a8b838-f1df-4bf7-be24-5141ce328dae@192.168.204.51@tcp t0 exp 0000000000000000 cur 268 last 0 00000020:00000080:3.0:1788574128.513780:0:8815:0:(genops.c:1385:class_connect()) connect: client 38a8b838-f1df-4bf7-be24-5141ce328dae, cookie 0x5bf8706fdac8c025 00002000:00100000:3.0:1788574128.513798:0:8815:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 38a8b838-f1df-4bf7-be24-5141ce328dae/ffff9c85ffb15800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788574128.513823:0:8815:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788574128.513939:0:8815:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788574128.513985:0:8815:0:(import.c:65:import_set_state_nolock()) ffff9c85ffb10000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788574128.514312:0:8815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e56c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:38a8b838-f1df-4bf7-be24-5141ce328dae+6:2392:x1875455668926464:12345-192.168.204.51@tcp:8:mount.lustre.0 Request processed in 623us (6703us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574128.514323:0:8815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 21 00000100:00100000:3.0:1788574128.514417:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574128.515406:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668926720 00000100:00100000:3.0:1788574128.515419:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668926720 00000100:00100000:3.0:1788574128.515488:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 1 00000100:00100000:3.0:1788574128.515499:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c365a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:38a8b838-f1df-4bf7-be24-5141ce328dae+6:8728:x1875455668926720:12345-192.168.204.51@tcp:33:mount.lustre.0 00000004:00200000:3.0:1788574128.515637:0:6495:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788574128.515729:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c365a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:38a8b838-f1df-4bf7-be24-5141ce328dae+6:8728:x1875455668926720:12345-192.168.204.51@tcp:33:mount.lustre.0 Request processed in 231us (1311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574128.515738:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 1 00010000:00010000:3.0:1788574128.789537:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574129.299483:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788574129.299518:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85e56c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681584896:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788574129.299633:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574129.299811:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681584896 00000100:00100000:0.0:1788574129.299821:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681584896 00000100:00100000:0.0:1788574129.299939:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788574129.299952:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681584896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788574129.299995:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788574129.300058:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681584896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574129.300065:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:0.0:1788574129.300118:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85e56c1c00 x1875455681584896/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574145 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574129.300140:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85e56c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681584896:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788574129.300406:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3659880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681585024:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788574129.300455:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574129.300541:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681585024 00000100:00100000:3.0:1788574129.300548:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681585024 00000100:00100000:3.0:1788574129.300591:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788574129.300600:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e56c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681585024:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788574129.300619:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788574129.300658:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e56c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681585024:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574129.300665:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:0.0:1788574129.300993:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3659880 x1875455681585024/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574145 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574129.301037:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3659880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681585024:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788574129.301289:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788574129.301507:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85de9bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875455681585536:0@lo:400:kworker.0 00000100:00100000:0.0:1788574129.301571:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574129.301597:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85de9bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681586048:0@lo:400:kworker.0 00000100:00100000:0.0:1788574129.301628:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574129.301652:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788574129.301658:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85de9be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681585408:0@lo:400:kworker.0 00000100:00100000:0.0:1788574129.301688:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574129.301709:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85de9bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3618:1875455681585920:0@lo:400:kworker.0 00000100:00100000:0.0:1788574129.301730:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574129.301745:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85de9bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3618:1875455681586432:0@lo:400:kworker.0 00000100:00100000:0.0:1788574129.301765:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574129.301793:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681585408 00000100:00100000:1.0:1788574129.302000:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85de9bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875455681585280:0@lo:400:kworker.0 00000100:00100000:1.0:1788574129.302047:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574129.302071:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85de9bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3620:1875455681585792:0@lo:400:kworker.0 00000100:00100000:1.0:1788574129.302094:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574129.302121:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85de9bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3620:1875455681586304:0@lo:400:kworker.0 00000100:00100000:1.0:1788574129.302141:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574129.302154:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788574129.302159:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85e56c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:69505170-06bc-41d1-9626-ab1a3c7f32a0:3620:1875455681585152:0@lo:400:kworker.0 00000100:00100000:1.0:1788574129.302218:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574129.302242:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85de9bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681585664:0@lo:400:kworker.0 00000100:00100000:1.0:1788574129.302280:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574129.302296:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85de9bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681586176:0@lo:400:kworker.0 00000100:00100000:1.0:1788574129.302317:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574129.302346:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681585536 00000100:00100000:1.0:1788574129.302353:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681585536 00000100:00100000:1.0:1788574129.302398:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681585920 00000100:00100000:1.0:1788574129.302401:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681585920 00000100:00100000:1.0:1788574129.302438:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681586432 00000100:00100000:1.0:1788574129.302441:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681586432 00000100:00100000:1.0:1788574129.302456:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681585280 00000100:00100000:1.0:1788574129.302458:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681585280 00000100:00100000:1.0:1788574129.302470:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681585792 00000100:00100000:1.0:1788574129.302473:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681585792 00000100:00100000:1.0:1788574129.302487:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681586304 00000100:00100000:1.0:1788574129.302489:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681586304 00000100:00100000:1.0:1788574129.302505:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788574129.302514:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de9bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875455681585536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574129.302583:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de9bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875455681585536:12345-0@lo:400:kworker.0 Request processed in 71us (1011us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574129.302591:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788574129.302611:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788574129.302618:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa0e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875455681585920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574129.302655:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa0e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875455681585920:12345-0@lo:400:kworker.0 Request processed in 39us (924us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574129.302662:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788574129.302674:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788574129.302680:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa0e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875455681586432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574129.302707:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa0e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875455681586432:12345-0@lo:400:kworker.0 Request processed in 27us (941us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574129.302721:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788574129.302735:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788574129.302740:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875455681585280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574129.302777:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875455681585280:12345-0@lo:400:kworker.0 Request processed in 38us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574129.302783:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788574129.302807:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788574129.302815:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faff0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875455681585792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574129.302843:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faff0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875455681585792:12345-0@lo:400:kworker.0 Request processed in 29us (748us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574129.302848:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788574129.302860:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788574129.302866:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faff0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875455681586304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574129.302893:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faff0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875455681586304:12345-0@lo:400:kworker.0 Request processed in 27us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574129.302899:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:1.0:1788574129.302915:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788574129.302919:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788574129.302951:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85de9bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875455681585280:0@lo:400:kworker.0 00000100:00100000:1.0:1788574129.302963:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85de9bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3620:1875455681585792:0@lo:400:kworker.0 00000100:00100000:1.0:1788574129.302973:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85de9bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3620:1875455681586304:0@lo:400:kworker.0 00000100:00100000:1.0:1788574129.303022:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681586048 00000100:00100000:1.0:1788574129.303026:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681586048 00000100:00100000:1.0:1788574129.303051:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681586176 00000100:00100000:1.0:1788574129.303061:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681586176 00000100:00100000:1.0:1788574129.303082:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788574129.303088:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa0e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681586048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574129.303122:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa0e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681586048:12345-0@lo:400:kworker.0 Request processed in 34us (1493us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574129.303128:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788574129.303139:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788574129.303145:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faff2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681586176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574129.303173:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faff2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681586176:12345-0@lo:400:kworker.0 Request processed in 29us (855us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574129.303180:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:1.0:1788574129.303238:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85de9bea00 x1875455681586176/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574145 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574129.303250:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85de9bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681586176:0@lo:400:kworker.0 00010000:00080000:1.0:1788574129.303284:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85de9bf480 x1875455681585920/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574145 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574129.303293:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85de9bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3618:1875455681585920:0@lo:400:kworker.0 00010000:00080000:1.0:1788574129.303304:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85de9bc700 x1875455681586432/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574145 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574129.303312:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85de9bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3618:1875455681586432:0@lo:400:kworker.0 00000100:00100000:1.0:1788574129.303324:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85de9bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875455681585536:0@lo:400:kworker.0 00010000:00080000:1.0:1788574129.303332:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85de9bc000 x1875455681586048/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574145 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574129.303340:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85de9bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681586048:0@lo:400:kworker.0 00000100:00100000:0.0:1788574129.303784:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681585408 00000100:00100000:0.0:1788574129.303880:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681585664 00000100:00100000:0.0:1788574129.303885:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681585664 00000100:00100000:0.0:1788574129.303900:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788574129.303908:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa0e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681585408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574129.303969:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa0e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681585408:12345-0@lo:400:kworker.0 Request processed in 61us (2281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574129.304100:0:7533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788574129.304110:0:7533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faff2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681585664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574129.304158:0:7533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faff2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681585664:12345-0@lo:400:kworker.0 Request processed in 51us (1877us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574129.304165:0:7533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788574129.304231:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85de9bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681585664:0@lo:400:kworker.0 00000100:00100000:3.0:1788574129.304280:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85de9be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681585408:0@lo:400:kworker.0 00000100:00100000:0.0:1788574129.304380:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788574129.304506:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681585152 00000100:00100000:2.0:1788574129.304514:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681585152 00000100:00100000:2.0:1788574129.304568:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1788574129.304577:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e564ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:3620:x1875455681585152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574129.304633:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e564ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:3620:x1875455681585152:12345-0@lo:400:kworker.0 Request processed in 58us (2443us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574129.304639:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1788574129.304816:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85e56c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:69505170-06bc-41d1-9626-ab1a3c7f32a0:3620:1875455681585152:0@lo:400:kworker.0 00010000:00010000:3.0:1788574129.811533:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574130.835775:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574131.859339:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c365b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681586560:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788574131.859440:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574131.859491:0:7533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681586560 00000100:00100000:3.0:1788574131.859500:0:7533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681586560 00000100:00100000:3.0:1788574131.859556:0:7533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788574131.859573:0:7533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681586560:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788574131.859607:0:7533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788574131.859664:0:7533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681586560:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574131.859671:0:7533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788574131.859767:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c365b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681586560:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788574131.864250:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574132.883538:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574133.396229:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788574133.396256:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c365b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681586688:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788574133.396329:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574133.396458:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681586688 00000100:00100000:3.0:1788574133.396467:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681586688 00000100:00100000:3.0:1788574133.396529:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788574133.396539:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faff2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681586688:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788574133.396572:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788574133.396626:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faff2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681586688:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574133.396634:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:3.0:1788574133.396677:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c365b480 x1875455681586688/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574149 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574133.396697:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c365b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681586688:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788574133.396778:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788574133.396962:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fa0e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681586816:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788574133.397004:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574133.397131:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681586816 00000100:00100000:1.0:1788574133.397136:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681586816 00000100:00100000:1.0:1788574133.397174:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788574133.397181:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c365b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681586816:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788574133.397229:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788574133.397275:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c365b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681586816:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574133.397282:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788574133.397366:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fa0e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681586816:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788574133.399208:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788574133.399230:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3659880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681586944:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788574133.399290:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574133.399455:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681586944 00000100:00100000:3.0:1788574133.399464:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681586944 00000100:00100000:3.0:1788574133.399537:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788574133.399547:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681586944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788574133.399569:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788574133.399631:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681586944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574133.399639:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:1.0:1788574133.399708:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788574133.399892:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3659880 x1875455681586944/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574149 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574133.399910:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3659880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681586944:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788574133.834033:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574133.834088:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574133.834125:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574133.834166:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574133.834228:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574133.834248:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574133.834280:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574133.834325:0:8815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668927616 00000100:00100000:3.0:1788574133.834337:0:8815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668927616 00000100:00100000:3.0:1788574133.834406:0:8815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668927488 00000100:00100000:3.0:1788574133.834410:0:8815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668927488 00000100:00100000:3.0:1788574133.834435:0:8815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 55 00000100:00100000:3.0:1788574133.834444:0:8815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3009c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:38a8b838-f1df-4bf7-be24-5141ce328dae+6:2396:x1875455668927616:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1788574133.834555:0:8815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3009c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:38a8b838-f1df-4bf7-be24-5141ce328dae+6:2396:x1875455668927616:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 112us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574133.834563:0:8815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 55 00000100:00100000:3.0:1788574133.834580:0:8815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 56 00000100:00100000:3.0:1788574133.834587:0:8815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c300ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:38a8b838-f1df-4bf7-be24-5141ce328dae+6:2396:x1875455668927488:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1788574133.834610:0:8815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c300ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:38a8b838-f1df-4bf7-be24-5141ce328dae+6:2396:x1875455668927488:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 25us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574133.834617:0:8815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 56 00000100:00100000:1.0:1788574133.835125:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668926848 00000100:00100000:1.0:1788574133.835131:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668926848 00000100:00100000:1.0:1788574133.835171:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 306 00000100:00100000:1.0:1788574133.835179:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c5362850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+13:2396:x1875455668926848:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788574133.835247:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c5362850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+13:2396:x1875455668926848:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 69us (1224us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574133.835255:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 306 00000100:00080000:1.0:1788574133.835294:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788574133.835300:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788574133.835411:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668927104 00000100:00100000:2.0:1788574133.835418:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668927104 00000100:00100000:2.0:1788574133.835464:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668927360 00000100:00100000:2.0:1788574133.835467:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668927360 00000100:00100000:2.0:1788574133.835481:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668926976 00000100:00100000:2.0:1788574133.835484:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668926976 00000100:00100000:2.0:1788574133.835508:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668927232 00000100:00100000:2.0:1788574133.835511:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668927232 00000100:00100000:2.0:1788574133.835529:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 146 00000100:00100000:2.0:1788574133.835536:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3659880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+5:2396:x1875455668927104:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1788574133.835569:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3659880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+5:2396:x1875455668927104:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 34us (1480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574133.835575:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 146 00000100:00100000:2.0:1788574133.835587:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 147 00000100:00100000:2.0:1788574133.835593:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e56c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38a8b838-f1df-4bf7-be24-5141ce328dae+6:2396:x1875455668927360:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1788574133.835614:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e56c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38a8b838-f1df-4bf7-be24-5141ce328dae+6:2396:x1875455668927360:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 22us (1489us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574133.835648:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 147 00000100:00100000:2.0:1788574133.835661:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 148 00000100:00100000:2.0:1788574133.835667:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3008000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+6:2396:x1875455668926976:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1788574133.835693:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3008000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+6:2396:x1875455668926976:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 26us (1465us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574133.835699:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 148 00000100:00100000:2.0:1788574133.835710:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 149 00000100:00100000:2.0:1788574133.835717:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c300bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38a8b838-f1df-4bf7-be24-5141ce328dae+6:2396:x1875455668927232:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1788574133.835739:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c300bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38a8b838-f1df-4bf7-be24-5141ce328dae+6:2396:x1875455668927232:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 23us (1490us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574133.835746:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 149 00000100:00080000:1.0:1788574133.836316:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788574133.836323:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1788574133.910121:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788574133.911923:0:7422:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 38a8b838-f1df-4bf7-be24-5141ce328dae 00000001:00100000:2.0:1788574133.912403:0:6471:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 38a8b838-f1df-4bf7-be24-5141ce328dae 00000001:00100000:3.0:1788574133.913769:0:9487:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 38a8b838-f1df-4bf7-be24-5141ce328dae 00000001:00100000:1.0:1788574133.914036:0:8404:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 38a8b838-f1df-4bf7-be24-5141ce328dae 00000100:00100000:0.0:1788574134.421042:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fa0e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875455681587200:0@lo:400:kworker.0 00000100:00100000:0.0:1788574134.421119:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574134.421221:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fa0e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3619:1875455681587712:0@lo:400:kworker.0 00000100:00100000:0.0:1788574134.421247:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574134.421273:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1875455681588224:0@lo:400:kworker.0 00000100:00100000:0.0:1788574134.421292:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574134.421340:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788574134.421346:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fa0e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681587328:0@lo:400:kworker.0 00000100:00100000:2.0:1788574134.421534:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fa0e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:69505170-06bc-41d1-9626-ab1a3c7f32a0:3618:1875455681587072:0@lo:400:kworker.0 00000100:00100000:2.0:1788574134.421571:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574134.421599:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fa0e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681587584:0@lo:400:kworker.0 00000100:00100000:2.0:1788574134.421623:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574134.421640:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681588096:0@lo:400:kworker.0 00000100:00100000:2.0:1788574134.421664:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574134.421680:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3720380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681588608:0@lo:400:kworker.0 00000100:00100000:2.0:1788574134.421699:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574134.421720:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788574134.421725:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fa0e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875455681587456:0@lo:400:kworker.0 00000100:00100000:2.0:1788574134.421746:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574134.421772:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681587968:0@lo:400:kworker.0 00000100:00100000:2.0:1788574134.421791:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574134.421805:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3721180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681588480:0@lo:400:kworker.0 00000100:00100000:2.0:1788574134.421821:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574134.421850:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681588096 00000100:00100000:2.0:1788574134.421857:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681588096 00000100:00100000:2.0:1788574134.421899:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681588608 00000100:00100000:2.0:1788574134.421902:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681588608 00000100:00100000:2.0:1788574134.421928:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681587968 00000100:00100000:2.0:1788574134.421931:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681587968 00000100:00100000:2.0:1788574134.421942:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681588480 00000100:00100000:2.0:1788574134.421944:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681588480 00000100:00100000:2.0:1788574134.421960:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788574134.421968:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681588096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574134.422023:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681588096:12345-0@lo:400:kworker.0 Request processed in 55us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574134.422030:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788574134.422046:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788574134.422053:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681588608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574134.422081:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681588608:12345-0@lo:400:kworker.0 Request processed in 29us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574134.422086:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788574134.422095:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788574134.422100:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681587968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574134.422121:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681587968:12345-0@lo:400:kworker.0 Request processed in 21us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574134.422127:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788574134.422145:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788574134.422150:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681588480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574134.422178:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681588480:12345-0@lo:400:kworker.0 Request processed in 27us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574134.422183:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788574134.422229:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681587200 00000100:00100000:2.0:1788574134.422232:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681587200 00000100:00100000:2.0:1788574134.422255:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681587712 00000100:00100000:2.0:1788574134.422258:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681587712 00000100:00100000:2.0:1788574134.422268:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681588224 00000100:00100000:2.0:1788574134.422271:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681588224 00000100:00100000:2.0:1788574134.422282:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681587456 00000100:00100000:2.0:1788574134.422284:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681587456 00000100:00100000:2.0:1788574134.422294:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788574134.422300:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3721c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875455681587200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574134.422341:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3721c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875455681587200:12345-0@lo:400:kworker.0 Request processed in 41us (1223us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574134.422347:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788574134.422358:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788574134.422364:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601837480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875455681587712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574134.422392:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601837480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875455681587712:12345-0@lo:400:kworker.0 Request processed in 28us (1144us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574134.422398:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788574134.422408:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788574134.422413:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601834e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875455681588224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574134.422439:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601834e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875455681588224:12345-0@lo:400:kworker.0 Request processed in 26us (1146us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574134.422453:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788574134.422464:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788574134.422471:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875455681587456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574134.422498:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875455681587456:12345-0@lo:400:kworker.0 Request processed in 29us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574134.422504:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788574134.422541:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fa0e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875455681587456:0@lo:400:kworker.0 00010000:00080000:2.0:1788574134.422553:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c36efb80 x1875455681587968/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574150 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574134.422563:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681587968:0@lo:400:kworker.0 00010000:00080000:2.0:1788574134.422571:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3721180 x1875455681588480/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574150 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574134.422579:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3721180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681588480:0@lo:400:kworker.0 00010000:00080000:2.0:1788574134.422588:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c36ec000 x1875455681588096/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574150 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574134.422595:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681588096:0@lo:400:kworker.0 00010000:00080000:2.0:1788574134.422603:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3720380 x1875455681588608/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574150 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574134.422610:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3720380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681588608:0@lo:400:kworker.0 00000100:00100000:2.0:1788574134.422682:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681587072 00000100:00100000:2.0:1788574134.422686:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681587072 00000100:00100000:2.0:1788574134.422715:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1788574134.422721:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e564f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:3618:x1875455681587072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574134.422764:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e564f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:3618:x1875455681587072:12345-0@lo:400:kworker.0 Request processed in 43us (1192us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574134.422770:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1788574134.422807:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fa0e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:69505170-06bc-41d1-9626-ab1a3c7f32a0:3618:1875455681587072:0@lo:400:kworker.0 00000100:00100000:3.0:1788574134.422939:0:7533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681587584 00000100:00100000:3.0:1788574134.422950:0:7533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681587584 00000100:00100000:3.0:1788574134.422991:0:7533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788574134.422998:0:7533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681587584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574134.423051:0:7533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681587584:12345-0@lo:400:kworker.0 Request processed in 54us (1427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574134.423058:0:7533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788574134.423079:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788574134.423089:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c300b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681588736:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788574134.423123:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574134.423153:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681588736 00000100:00100000:3.0:1788574134.423157:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681588736 00000100:00100000:3.0:1788574134.423180:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788574134.423186:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fb135450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681588736:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788574134.423225:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788574134.423257:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fb135450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681588736:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574134.423263:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:3.0:1788574134.423456:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c300b100 x1875455681588736/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574150 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574134.423470:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c300b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681588736:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788574134.423493:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fa0e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681587584:0@lo:400:kworker.0 00000100:00080000:1.0:1788574134.423614:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788574134.423626:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788574134.423706:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574134.423735:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1875455681587840:0@lo:400:kworker.0 00000100:00100000:0.0:1788574134.423760:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574134.423779:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3722d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1875455681588352:0@lo:400:kworker.0 00000100:00100000:0.0:1788574134.423798:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574134.423823:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fa0e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875455681587200:0@lo:400:kworker.0 00000100:00100000:0.0:1788574134.423834:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fa0e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3619:1875455681587712:0@lo:400:kworker.0 00000100:00100000:0.0:1788574134.423844:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1875455681588224:0@lo:400:kworker.0 00000100:00100000:0.0:1788574134.423854:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788574134.423862:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faff1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681588864:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788574134.423884:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574134.423909:0:11893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681587840 00000100:00100000:0.0:1788574134.423914:0:11893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681587840 00000100:00100000:0.0:1788574134.423945:0:11893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681588352 00000100:00100000:0.0:1788574134.423948:0:11893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681588352 00000100:00100000:0.0:1788574134.423969:0:11893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788574134.423975:0:11893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601835f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875455681587840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574134.424011:0:11893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601835f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875455681587840:12345-0@lo:400:kworker.0 Request processed in 36us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574134.424028:0:11893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788574134.424041:0:11893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788574134.424047:0:11893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601834700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875455681588352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574134.424076:0:11893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601834700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875455681588352:12345-0@lo:400:kworker.0 Request processed in 29us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574134.424081:0:11893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00010000:00080000:0.0:1788574134.424110:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c36ef100 x1875455681587840/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574150 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574134.424118:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1875455681587840:0@lo:400:kworker.0 00010000:00080000:0.0:1788574134.424127:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3722d80 x1875455681588352/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574150 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574134.424135:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3722d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1875455681588352:0@lo:400:kworker.0 00000100:00100000:1.0:1788574134.424220:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681587328 00000100:00100000:1.0:1788574134.424225:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681587328 00000100:00100000:1.0:1788574134.424250:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788574134.424257:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601835880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681587328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574134.424298:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601835880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681587328:12345-0@lo:400:kworker.0 Request processed in 42us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574134.424305:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:1.0:1788574134.424320:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788574134.424349:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fa0e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681587328:0@lo:400:kworker.0 00000100:00100000:3.0:1788574134.424884:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681588864 00000100:00100000:3.0:1788574134.424890:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681588864 00000100:00100000:3.0:1788574134.424932:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788574134.424939:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601837100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681588864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788574134.424954:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788574134.425009:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601837100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681588864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (1124us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574134.425015:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:1.0:1788574134.425090:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85faff1500 x1875455681588864/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574150 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574134.425103:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faff1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681588864:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788574134.932092:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788574135.459463:0:12163:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg451-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:3.0:1788574135.957221:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574136.979420:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574136.979663:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788574136.979683:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c300b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681588992:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788574136.979762:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574136.979940:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681588992 00000100:00100000:3.0:1788574136.979949:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681588992 00000100:00100000:3.0:1788574136.980006:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788574136.980016:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faff1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681588992:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788574136.980051:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788574136.980111:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faff1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681588992:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574136.980119:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788574136.980318:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c300b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681588992:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788574138.003986:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574138.515909:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788574138.515932:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3009f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681589120:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788574138.515999:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574138.516072:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681589120 00000100:00100000:3.0:1788574138.516079:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681589120 00000100:00100000:3.0:1788574138.516132:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788574138.516142:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c300a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681589120:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788574138.516170:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788574138.516230:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c300a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681589120:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574138.516238:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00080000:3.0:1788574138.516293:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3009f80 x1875455681589120/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574154 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574138.516311:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3009f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681589120:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788574138.516452:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788574138.516965:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c8601835180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681589248:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788574138.517008:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574138.517107:0:7533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681589248 00000100:00100000:0.0:1788574138.517113:0:7533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681589248 00000100:00100000:0.0:1788574138.517152:0:7533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788574138.517159:0:7533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faff1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681589248:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788574138.517184:0:7533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788574138.517397:0:7533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faff1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681589248:12345-0@lo:41:osp-pre-1-0.0 Request processed in 238us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574138.517404:0:7533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788574138.517844:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c8601835180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681589248:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788574138.519748:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788574138.519765:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3009f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681589376:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788574138.519834:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574138.519891:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681589376 00000100:00100000:3.0:1788574138.519897:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681589376 00000100:00100000:3.0:1788574138.519948:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788574138.519956:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3008380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681589376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788574138.519981:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788574138.520020:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3008380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681589376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574138.520026:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:3.0:1788574138.520064:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3009f80 x1875455681589376/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574154 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574138.520079:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3009f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681589376:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788574138.522015:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788574138.956098:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574138.956159:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574138.956207:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574138.956232:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574138.956264:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574138.956283:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574138.956303:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574138.956329:0:11893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668928000 00000100:00100000:1.0:1788574138.956338:0:11893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668928000 00000100:00100000:1.0:1788574138.956392:0:11893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668928256 00000100:00100000:1.0:1788574138.956395:0:11893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668928256 00000100:00100000:1.0:1788574138.956408:0:11893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668927872 00000100:00100000:1.0:1788574138.956410:0:11893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668927872 00000100:00100000:1.0:1788574138.956421:0:11893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668928128 00000100:00100000:1.0:1788574138.956423:0:11893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668928128 00000100:00100000:1.0:1788574138.956439:0:11893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 156 00000100:00100000:1.0:1788574138.956449:0:11893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faff1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:659467ff-94af-418e-92fe-11e4323a48aa+5:2395:x1875455668928000:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788574138.956519:0:11893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faff1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:659467ff-94af-418e-92fe-11e4323a48aa+5:2395:x1875455668928000:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 70us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574138.956526:0:11893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 156 00000100:00100000:1.0:1788574138.956544:0:11893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 157 00000100:00100000:1.0:1788574138.956551:0:11893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faff3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2395:x1875455668928256:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788574138.956576:0:11893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faff3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2395:x1875455668928256:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 26us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574138.956583:0:11893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 157 00000100:00100000:1.0:1788574138.956594:0:11893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 158 00000100:00100000:1.0:1788574138.956601:0:11893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faff0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:659467ff-94af-418e-92fe-11e4323a48aa+6:2395:x1875455668927872:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788574138.956625:0:11893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faff0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:659467ff-94af-418e-92fe-11e4323a48aa+6:2395:x1875455668927872:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 25us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574138.956638:0:11893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 158 00000100:00100000:1.0:1788574138.956652:0:11893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 159 00000100:00100000:1.0:1788574138.956659:0:11893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faff2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2395:x1875455668928128:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788574138.956683:0:11893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faff2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2395:x1875455668928128:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 24us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574138.956688:0:11893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 159 00000100:00100000:1.0:1788574138.956707:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668928512 00000100:00100000:1.0:1788574138.956711:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668928512 00000100:00100000:1.0:1788574138.956735:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668928384 00000100:00100000:1.0:1788574138.956739:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668928384 00000100:00100000:1.0:1788574138.956761:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 61 00000100:00100000:1.0:1788574138.956769:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faff0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2395:x1875455668928512:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788574138.956795:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faff0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2395:x1875455668928512:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 28us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574138.956801:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 61 00000100:00100000:1.0:1788574138.956814:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 62 00000100:00100000:1.0:1788574138.956820:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de9bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2395:x1875455668928384:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788574138.956846:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de9bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2395:x1875455668928384:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 27us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574138.956853:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 62 00000100:00080000:1.0:1788574138.956879:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788574138.956883:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788574138.956886:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788574138.956888:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788574138.957001:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668927744 00000100:00100000:3.0:1788574138.957005:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668927744 00000100:00100000:3.0:1788574138.957037:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 308 00000100:00100000:3.0:1788574138.957044:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c820f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+13:2395:x1875455668927744:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1788574138.957071:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c820f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+13:2395:x1875455668927744:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 28us (984us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574138.957078:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 308 00010000:00010000:1.0:1788574139.033918:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574139.540394:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788574139.540418:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85de9be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681589504:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788574139.540496:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574139.540724:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681589504 00000100:00100000:1.0:1788574139.540732:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681589504 00000100:00100000:1.0:1788574139.540791:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788574139.540802:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681589504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788574139.540831:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788574139.540881:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681589504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574139.540888:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00080000:1.0:1788574139.540926:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85de9be300 x1875455681589504/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574155 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574139.540946:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85de9be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681589504:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788574139.540996:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788574139.541213:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788574139.541226:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85de9be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681589632:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788574139.541280:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574139.541439:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681589632 00000100:00100000:1.0:1788574139.541443:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681589632 00000100:00100000:1.0:1788574139.541483:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788574139.541489:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3009f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681589632:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788574139.541501:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788574139.541531:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3009f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681589632:12345-0@lo:13:osp-pre-1-1.0 Request processed in 42us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574139.541538:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:3.0:1788574139.541595:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788574139.541637:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85de9be300 x1875455681589632/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574155 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574139.541650:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85de9be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681589632:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788574139.549111:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875455681589888:0@lo:400:kworker.0 00000100:00100000:2.0:1788574139.549182:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574139.549264:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3620:1875455681590400:0@lo:400:kworker.0 00000100:00100000:2.0:1788574139.549289:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574139.549311:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3723100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3620:1875455681590912:0@lo:400:kworker.0 00000100:00100000:2.0:1788574139.549331:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574139.549351:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788574139.549357:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:69505170-06bc-41d1-9626-ab1a3c7f32a0:3620:1875455681589760:0@lo:400:kworker.0 00000100:00100000:2.0:1788574139.549384:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574139.549404:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681590272:0@lo:400:kworker.0 00000100:00100000:2.0:1788574139.549429:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574139.549444:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3721500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681590784:0@lo:400:kworker.0 00000100:00100000:2.0:1788574139.549466:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574139.549577:0:11893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681589888 00000100:00100000:1.0:1788574139.549586:0:11893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681589888 00000100:00100000:1.0:1788574139.549643:0:11893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681590400 00000100:00100000:1.0:1788574139.549646:0:11893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681590400 00000100:00100000:1.0:1788574139.549669:0:11893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681590912 00000100:00100000:1.0:1788574139.549672:0:11893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681590912 00000100:00100000:1.0:1788574139.549690:0:11893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788574139.549698:0:11893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3720000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875455681589888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574139.549770:0:11893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3720000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875455681589888:12345-0@lo:400:kworker.0 Request processed in 72us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574139.549777:0:11893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788574139.549795:0:11893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788574139.549801:0:11893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3720380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875455681590400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574139.549826:0:11893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3720380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875455681590400:12345-0@lo:400:kworker.0 Request processed in 25us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574139.549832:0:11893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788574139.549843:0:11893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788574139.549848:0:11893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3721180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875455681590912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574139.549870:0:11893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3721180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875455681590912:12345-0@lo:400:kworker.0 Request processed in 23us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574139.549876:0:11893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788574139.549898:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681589760 00000100:00100000:1.0:1788574139.549901:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681589760 00000100:00100000:1.0:1788574139.549921:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1788574139.549927:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c820d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:3620:x1875455681589760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574139.549953:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c820d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:3620:x1875455681589760:12345-0@lo:400:kworker.0 Request processed in 27us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574139.549958:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1788574139.549983:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681590272 00000100:00100000:1.0:1788574139.549986:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681590272 00000100:00100000:1.0:1788574139.550006:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788574139.550013:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681590272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574139.550040:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681590272:12345-0@lo:400:kworker.0 Request processed in 28us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574139.550053:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788574139.550071:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681590784 00000100:00100000:1.0:1788574139.550074:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681590784 00000100:00100000:1.0:1788574139.550098:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788574139.550103:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681590784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574139.550133:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681590784:12345-0@lo:400:kworker.0 Request processed in 29us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574139.550138:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788574139.550182:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:69505170-06bc-41d1-9626-ab1a3c7f32a0:3620:1875455681589760:0@lo:400:kworker.0 00000100:00100000:1.0:1788574139.550212:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681590272:0@lo:400:kworker.0 00010000:00080000:1.0:1788574139.550224:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3721500 x1875455681590784/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574155 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574139.550245:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3721500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681590784:0@lo:400:kworker.0 00000100:00100000:1.0:1788574139.550256:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875455681589888:0@lo:400:kworker.0 00000100:00100000:1.0:1788574139.550264:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3620:1875455681590400:0@lo:400:kworker.0 00000100:00100000:1.0:1788574139.550272:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3723100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3620:1875455681590912:0@lo:400:kworker.0 00000100:00080000:3.0:1788574139.550502:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788574139.550518:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681590016:0@lo:400:kworker.0 00000100:00100000:3.0:1788574139.550563:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574139.550591:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1875455681590528:0@lo:400:kworker.0 00000100:00100000:3.0:1788574139.550614:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574139.550644:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3722a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1875455681591040:0@lo:400:kworker.0 00000100:00100000:3.0:1788574139.550664:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574139.550683:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788574139.550689:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875455681590144:0@lo:400:kworker.0 00000100:00100000:3.0:1788574139.550710:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574139.550727:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3722d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681590656:0@lo:400:kworker.0 00000100:00100000:3.0:1788574139.550745:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574139.550772:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681590656 00000100:00100000:3.0:1788574139.550775:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681590656 00000100:00100000:3.0:1788574139.550799:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788574139.550804:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c300aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681590656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574139.550833:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c300aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681590656:12345-0@lo:400:kworker.0 Request processed in 29us (87us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574139.550839:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788574139.550857:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681590528 00000100:00100000:3.0:1788574139.550859:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681590528 00000100:00100000:3.0:1788574139.550876:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681591040 00000100:00100000:3.0:1788574139.550878:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681591040 00000100:00100000:3.0:1788574139.550896:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681590144 00000100:00100000:3.0:1788574139.550899:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681590144 00000100:00100000:3.0:1788574139.550908:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788574139.550913:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c300a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875455681590528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574139.550936:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c300a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875455681590528:12345-0@lo:400:kworker.0 Request processed in 23us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574139.550941:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788574139.550950:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788574139.550955:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3009880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875455681591040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574139.550973:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3009880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875455681591040:12345-0@lo:400:kworker.0 Request processed in 19us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574139.550979:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788574139.550986:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788574139.550991:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3008700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875455681590144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574139.551009:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3008700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875455681590144:12345-0@lo:400:kworker.0 Request processed in 18us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574139.551014:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00080000:3.0:1788574139.551027:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788574139.551048:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875455681590144:0@lo:400:kworker.0 00010000:00080000:3.0:1788574139.551057:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3722d80 x1875455681590656/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574155 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574139.551066:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3722d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681590656:0@lo:400:kworker.0 00010000:00080000:3.0:1788574139.551074:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3c08a80 x1875455681590528/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574155 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574139.551081:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1875455681590528:0@lo:400:kworker.0 00010000:00080000:3.0:1788574139.551095:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3722a00 x1875455681591040/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574155 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574139.551103:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3722a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1875455681591040:0@lo:400:kworker.0 00000100:00100000:1.0:1788574139.551356:0:7533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681590016 00000100:00100000:1.0:1788574139.551361:0:7533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681590016 00000100:00100000:1.0:1788574139.551392:0:7533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788574139.551400:0:7533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3008a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681590016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574139.551444:0:7533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3008a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681590016:12345-0@lo:400:kworker.0 Request processed in 46us (881us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574139.551450:0:7533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788574139.551519:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681590016:0@lo:400:kworker.0 00010000:00010000:1.0:1788574140.052251:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574141.075356:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574142.104434:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574142.104458:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788574142.104676:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3008e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681591168:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788574142.104780:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574142.106609:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681591168 00000100:00100000:1.0:1788574142.106626:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681591168 00000100:00100000:1.0:1788574142.106688:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788574142.106699:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c300b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681591168:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788574142.106735:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788574142.110953:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c300b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681591168:12345-0@lo:41:osp-pre-0-1.0 Request processed in 4242us (6159us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574142.110971:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788574142.111369:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3008e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681591168:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788574143.125121:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574143.635471:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c8601835180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681591296:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788574143.635547:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574143.635726:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681591296 00000100:00100000:2.0:1788574143.635734:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681591296 00000100:00100000:2.0:1788574143.635805:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788574143.635815:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de9bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681591296:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788574143.635861:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788574143.636838:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788574143.636852:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85de9bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681591552:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788574143.636920:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574143.636972:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681591552 00000100:00100000:1.0:1788574143.636978:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681591552 00000100:00100000:1.0:1788574143.637063:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788574143.637072:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de9bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681591552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788574143.637096:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788574143.637135:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de9bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681591552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574143.637142:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00080000:1.0:1788574143.637219:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85de9bc000 x1875455681591552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574159 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788574143.637443:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788574143.637497:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85de9bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681591552:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788574143.638344:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3008e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681591424:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788574143.638411:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574143.639719:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681591424 00000100:00100000:1.0:1788574143.639733:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681591424 00000100:00100000:1.0:1788574143.639825:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788574143.639835:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601836a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681591424:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788574143.639860:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788574143.639925:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601836a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681591424:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (1513us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574143.639933:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:0.0:1788574143.640252:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3008e00 x1875455681591424/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574159 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574143.640274:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3008e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681591424:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788574143.640305:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788574143.641283:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de9bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681591296:12345-0@lo:41:osp-pre-1-0.0 Request processed in 5465us (5731us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574143.641295:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788574143.643785:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c8601835180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681591296:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788574144.073567:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574144.073614:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574144.073675:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574144.073716:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574144.073737:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574144.073756:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574144.073821:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574144.073849:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668928768 00000100:00100000:3.0:1788574144.073858:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668928768 00000100:00100000:3.0:1788574144.073918:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668929024 00000100:00100000:3.0:1788574144.073921:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668929024 00000100:00100000:3.0:1788574144.073939:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668928896 00000100:00100000:3.0:1788574144.073942:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668928896 00000100:00100000:2.0:1788574144.073946:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668929152 00000100:00100000:2.0:1788574144.073952:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668929152 00000100:00100000:3.0:1788574144.073961:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 166 00000100:00100000:3.0:1788574144.073973:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c300b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+6:2393:x1875455668928768:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1788574144.073987:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 167 00000100:00100000:2.0:1788574144.073998:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3008e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2393:x1875455668929024:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1788574144.074042:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c300b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+6:2393:x1875455668928768:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 70us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574144.074043:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3008e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2393:x1875455668929024:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 46us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574144.074057:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 167 00000100:00100000:3.0:1788574144.074066:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 166 00000100:00100000:2.0:1788574144.074085:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 168 00000100:00100000:1.0:1788574144.074204:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668929280 00000100:00100000:1.0:1788574144.074210:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668929280 00000100:00100000:1.0:1788574144.074241:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668929408 00000100:00100000:1.0:1788574144.074244:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668929408 00000100:00100000:1.0:1788574144.074277:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 65 00000100:00100000:1.0:1788574144.074285:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c365b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2393:x1875455668929280:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788574144.074328:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c365b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2393:x1875455668929280:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 44us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574144.074335:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 65 00000100:00100000:1.0:1788574144.074355:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 66 00000100:00100000:1.0:1788574144.074361:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de938700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2393:x1875455668929408:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788574144.074384:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de938700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2393:x1875455668929408:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 22us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574144.074390:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 66 00000100:00100000:1.0:1788574144.074407:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668928640 00000100:00100000:1.0:1788574144.074411:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668928640 00000100:00100000:1.0:1788574144.074436:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 310 00000100:00100000:1.0:1788574144.074442:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c820f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+13:2393:x1875455668928640:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788574144.074478:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c820f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+13:2393:x1875455668928640:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 36us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574144.074485:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 310 00000100:00080000:1.0:1788574144.074663:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788574144.074668:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788574144.074671:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788574144.074673:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788574144.074849:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c365bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+5:2393:x1875455668928896:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1788574144.074889:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c365bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+5:2393:x1875455668928896:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 796us (1151us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574144.080041:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 169 00000100:00100000:3.0:1788574144.080074:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3659180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2393:x1875455668929152:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1788574144.080095:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 168 00000100:00100000:3.0:1788574144.080171:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3659180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2393:x1875455668929152:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 115us (6412us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574144.080179:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 169 00010000:00010000:2.0:1788574144.148326:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574144.671087:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c8601835180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681591680:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788574144.671175:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574144.671267:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681591680 00000100:00100000:1.0:1788574144.671275:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681591680 00000100:00100000:1.0:1788574144.671332:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788574144.671342:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de9bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681591680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788574144.671373:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788574144.671417:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de9bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681591680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574144.671424:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:1.0:1788574144.671446:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788574144.671478:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c8601835180 x1875455681591680/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574160 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574144.672817:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c8601835180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681591680:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788574144.674026:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69505170-06bc-41d1-9626-ab1a3c7f32a0:3619:1875455681591808:0@lo:400:kworker.0 00000100:00100000:2.0:1788574144.674100:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574144.674157:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681592320:0@lo:400:kworker.0 00000100:00100000:2.0:1788574144.674185:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574144.674234:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fa0e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681592832:0@lo:400:kworker.0 00000100:00100000:2.0:1788574144.674259:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574144.674284:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788574144.674298:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875455681591936:0@lo:400:kworker.0 00000100:00100000:2.0:1788574144.674325:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574144.674345:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fa0e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3619:1875455681592448:0@lo:400:kworker.0 00000100:00100000:2.0:1788574144.674366:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574144.674384:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fa0e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1875455681592960:0@lo:400:kworker.0 00000100:00100000:2.0:1788574144.674405:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574144.674438:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681591808 00000100:00100000:2.0:1788574144.674447:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681591808 00000100:00100000:2.0:1788574144.674493:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1788574144.674764:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c820c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:3619:x1875455681591808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574144.674816:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c820c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:3619:x1875455681591808:12345-0@lo:400:kworker.0 Request processed in 55us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574144.674824:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1788574144.674856:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681592320 00000100:00100000:2.0:1788574144.674860:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681592320 00000100:00100000:3.0:1788574144.674986:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681592064:0@lo:400:kworker.0 00000100:00100000:3.0:1788574144.675017:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574144.675038:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fa0e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1875455681592576:0@lo:400:kworker.0 00000100:00100000:3.0:1788574144.675062:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574144.675083:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fa0e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1875455681593088:0@lo:400:kworker.0 00000100:00100000:3.0:1788574144.675107:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574144.675128:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788574144.675146:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875455681592192:0@lo:400:kworker.0 00000100:00100000:3.0:1788574144.675171:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574144.675183:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fa0e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681592704:0@lo:400:kworker.0 00000100:00100000:3.0:1788574144.675223:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574144.675243:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681593216:0@lo:400:kworker.0 00000100:00100000:3.0:1788574144.675262:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574144.675305:0:7533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681592064 00000100:00100000:3.0:1788574144.675310:0:7533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681592064 00000100:00100000:3.0:1788574144.675343:0:7533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788574144.675350:0:7533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de939c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681592064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574144.675391:0:7533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de939c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681592064:12345-0@lo:400:kworker.0 Request processed in 42us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574144.675409:0:7533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788574144.675432:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681591936 00000100:00100000:3.0:1788574144.675436:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681591936 00000100:00100000:3.0:1788574144.675454:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681592448 00000100:00100000:3.0:1788574144.675458:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681592448 00000100:00100000:3.0:1788574144.675482:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681592960 00000100:00100000:3.0:1788574144.675485:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681592960 00000100:00100000:1.0:1788574144.675778:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788574144.675789:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85de9bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681593344:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788574144.675820:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574144.675849:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681593344 00000100:00100000:1.0:1788574144.675853:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681593344 00000100:00100000:2.0:1788574144.676142:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788574144.676150:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681592320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574144.676204:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681592320:12345-0@lo:400:kworker.0 Request processed in 55us (2018us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574144.676211:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788574144.676231:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681592832 00000100:00100000:2.0:1788574144.676235:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681592832 00000100:00100000:2.0:1788574144.676260:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681592704 00000100:00100000:2.0:1788574144.676263:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681592704 00000100:00100000:2.0:1788574144.676276:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681593216 00000100:00100000:2.0:1788574144.676278:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681593216 00000100:00100000:2.0:1788574144.676293:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788574144.676298:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681592832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574144.676339:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681592832:12345-0@lo:400:kworker.0 Request processed in 41us (2079us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574144.676345:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788574144.676357:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788574144.676362:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffaf6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681592704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574144.676387:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffaf6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681592704:12345-0@lo:400:kworker.0 Request processed in 25us (1163us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574144.676392:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788574144.676403:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788574144.676408:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffaf4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3617:x1875455681593216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574144.676435:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffaf4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3617:x1875455681593216:12345-0@lo:400:kworker.0 Request processed in 26us (1171us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574144.676440:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788574144.676457:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681592576 00000100:00100000:2.0:1788574144.676461:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681592576 00000100:00100000:2.0:1788574144.676476:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681593088 00000100:00100000:2.0:1788574144.676478:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681593088 00000100:00100000:2.0:1788574144.676487:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681592192 00000100:00100000:2.0:1788574144.676490:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681592192 00000100:00100000:1.0:1788574144.676991:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788574144.676999:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de9bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681593344:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788574144.677018:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788574144.677058:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de9bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681593344:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (1237us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574144.677064:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:1.0:1788574144.677106:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85de9bc700 x1875455681593344/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574160 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574144.677123:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85de9bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681593344:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788574144.681129:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788574144.681162:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875455681591936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574144.681289:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875455681591936:12345-0@lo:400:kworker.0 Request processed in 135us (6962us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574144.681297:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788574144.681319:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788574144.681328:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875455681592448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574144.681378:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875455681592448:12345-0@lo:400:kworker.0 Request processed in 53us (7011us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574144.681384:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788574144.681398:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788574144.681405:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de93aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875455681592576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574144.681440:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de93aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875455681592576:12345-0@lo:400:kworker.0 Request processed in 37us (6378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574144.681445:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788574144.681457:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788574144.681464:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c35fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875455681593088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574144.681493:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c35fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875455681593088:12345-0@lo:400:kworker.0 Request processed in 30us (6385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574144.681515:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788574144.681526:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788574144.681533:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffaf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875455681592192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574144.681561:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffaf4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875455681592192:12345-0@lo:400:kworker.0 Request processed in 30us (6390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574144.681566:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788574144.681802:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788574144.681812:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875455681592960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574144.682264:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875455681591936:0@lo:400:kworker.0 00000100:00080000:1.0:1788574144.682644:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788574144.682651:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788574144.682654:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788574144.686254:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875455681592960:12345-0@lo:400:kworker.0 Request processed in 4435us (11837us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574144.686271:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788574144.703509:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fa0e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3619:1875455681592448:0@lo:400:kworker.0 00000100:00100000:2.0:1788574144.703533:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fa0e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1875455681592960:0@lo:400:kworker.0 00000100:00100000:2.0:1788574144.703545:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69505170-06bc-41d1-9626-ab1a3c7f32a0:3619:1875455681591808:0@lo:400:kworker.0 00000100:00100000:2.0:1788574144.703556:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681592320:0@lo:400:kworker.0 00010000:00080000:2.0:1788574144.703591:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85fa0e5500 x1875455681592832/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574160 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574144.703601:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fa0e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681592832:0@lo:400:kworker.0 00000100:00100000:1.0:1788574144.709017:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875455681592192:0@lo:400:kworker.0 00010000:00080000:1.0:1788574144.709041:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85fa0e4700 x1875455681592704/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574160 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574144.709052:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fa0e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681592704:0@lo:400:kworker.0 00010000:00080000:1.0:1788574144.709063:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c36afb80 x1875455681593216/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574160 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574144.709072:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681593216:0@lo:400:kworker.0 00000100:00100000:1.0:1788574144.709085:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681592064:0@lo:400:kworker.0 00010000:00080000:1.0:1788574144.709097:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85fa0e4380 x1875455681592576/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574160 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574144.709105:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fa0e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1875455681592576:0@lo:400:kworker.0 00010000:00080000:1.0:1788574144.709145:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85fa0e6d80 x1875455681593088/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574160 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574144.709153:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fa0e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1875455681593088:0@lo:400:kworker.0 00000020:00000004:0.0:1788574144.867759:0:12478:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788574144.876336:0:12478:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788574145.173932:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574146.202032:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574147.220713:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574147.222002:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788574147.222023:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85ffaf6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681593472:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788574147.222106:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574147.222357:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681593472 00000100:00100000:3.0:1788574147.222366:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681593472 00000100:00100000:3.0:1788574147.222411:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788574147.222420:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681593472:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788574147.222454:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788574147.222513:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681593472:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574147.222776:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85ffaf6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681593472:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788574147.222820:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000020:00000004:1.0:1788574147.433808:0:12576:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788574147.434466:0:12576:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788574148.247837:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574148.756253:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788574148.756274:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85de9bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681593856:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788574148.756348:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574148.756454:0:7533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681593856 00000100:00100000:3.0:1788574148.756463:0:7533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681593856 00000100:00100000:3.0:1788574148.756515:0:7533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788574148.756525:0:7533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de9bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681593856:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788574148.756577:0:7533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788574148.756625:0:7533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de9bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681593856:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574148.756646:0:7533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788574148.756806:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85de9bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681593600:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788574148.756842:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574148.756877:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788574148.756884:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85ffaf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681593728:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788574148.756908:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574148.757169:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681593600 00000100:00100000:1.0:1788574148.757175:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681593600 00000100:00100000:1.0:1788574148.757237:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681593728 00000100:00100000:1.0:1788574148.757241:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681593728 00000100:00100000:1.0:1788574148.757257:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788574148.757264:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681593600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788574148.757286:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788574148.758736:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681593600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1465us (1886us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574148.758749:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788574148.758782:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788574148.758796:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681593728:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788574148.758817:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788574148.758862:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681593728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (1953us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574148.758868:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788574148.758932:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85de9bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681593856:0@lo:41:osp-pre-1-0.0 00000100:00080000:0.0:1788574148.759073:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788574148.762599:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85de9bc700 x1875455681593600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574164 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574148.762633:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85de9bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681593600:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1788574148.762669:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85ffaf5500 x1875455681593728/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574164 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574148.762681:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85ffaf5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681593728:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788574149.192962:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574149.193088:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574149.193830:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668929536 00000100:00100000:1.0:1788574149.193844:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668929536 00000100:00100000:3.0:1788574149.194171:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 312 00000100:00100000:3.0:1788574149.194184:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c820ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+13:2396:x1875455668929536:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1788574149.194281:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c820ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+13:2396:x1875455668929536:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 99us (1330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574149.194290:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 312 00000100:00100000:0.0:1788574149.194363:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574149.194464:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574149.194488:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668930176 00000100:00100000:0.0:1788574149.194493:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668930176 00000100:00100000:0.0:1788574149.194532:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668930304 00000100:00100000:0.0:1788574149.194535:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668930304 00000100:00100000:0.0:1788574149.194568:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 22 00000100:00100000:0.0:1788574149.194576:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601835180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2392:x1875455668930176:12345-192.168.204.51@tcp:9:kworker.0 00000020:00000080:0.0:1788574149.194597:0:8409:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8c01e 00000100:00080000:0.0:1788574149.194607:0:8409:0:(import.c:65:import_set_state_nolock()) ffff9c84c3698000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788574149.194652:0:8409:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1788574149.194792:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601835180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:38a8b838-f1df-4bf7-be24-5141ce328dae+2:2392:x1875455668930176:12345-192.168.204.51@tcp:9:kworker.0 Request processed in 216us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574149.194800:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 22 00000100:00100000:0.0:1788574149.194812:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 23 00000100:00100000:0.0:1788574149.194819:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3724380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2392:x1875455668930304:12345-192.168.204.51@tcp:9:kworker.0 00000020:00000080:0.0:1788574149.194831:0:8409:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8c025 00000100:00080000:0.0:1788574149.194841:0:8409:0:(import.c:65:import_set_state_nolock()) ffff9c85ffb10000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788574149.194864:0:8409:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1788574149.194876:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668929664 00000100:00100000:2.0:1788574149.194882:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668929664 00000100:00100000:2.0:1788574149.194919:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 176 00000100:00100000:2.0:1788574149.194926:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffaf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+6:2396:x1875455668929664:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1788574149.194978:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3724380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:38a8b838-f1df-4bf7-be24-5141ce328dae+2:2392:x1875455668930304:12345-192.168.204.51@tcp:9:kworker.0 Request processed in 158us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574149.195000:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 23 00000100:00080000:0.0:1788574149.195019:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788574149.195027:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788574149.195029:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788574149.195053:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574149.195144:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574149.195180:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffaf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+6:2396:x1875455668929664:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 44us (1882us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574149.195223:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 176 00000100:00100000:0.0:1788574149.196296:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574149.196332:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574149.196361:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574149.196441:0:11893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668929920 00000100:00100000:1.0:1788574149.196450:0:11893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668929920 00000100:00100000:1.0:1788574149.196503:0:11893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668929792 00000100:00100000:1.0:1788574149.196506:0:11893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668929792 00000100:00100000:1.0:1788574149.196523:0:11893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668930048 00000100:00100000:1.0:1788574149.196526:0:11893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668930048 00000100:00100000:1.0:1788574149.196540:0:11893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 177 00000100:00100000:1.0:1788574149.196548:0:11893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3725500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2395:x1875455668929920:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788574149.196611:0:11893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3725500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2395:x1875455668929920:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 63us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574149.196619:0:11893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 177 00000100:00100000:3.0:1788574149.196627:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 178 00000100:00100000:1.0:1788574149.196639:0:11893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 179 00000100:00100000:3.0:1788574149.196641:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3724a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+5:2395:x1875455668929792:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788574149.196652:0:11893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3725f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2395:x1875455668930048:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1788574149.196678:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3724a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+5:2395:x1875455668929792:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 40us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574149.196685:0:11893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3725f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2395:x1875455668930048:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 37us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574149.196689:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 178 00000100:00100000:1.0:1788574149.196697:0:11893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 179 00000100:00080000:0.0:1788574149.196898:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788574149.196903:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788574149.281701:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788574149.725430:0:12674:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788574149.725754:0:12674:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788574149.779665:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681593984:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788574149.779751:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574149.779837:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681593984 00000100:00100000:2.0:1788574149.779845:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681593984 00000100:00080000:0.0:1788574149.780782:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788574149.781217:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3727800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681594112:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788574149.781278:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574149.781330:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681594112 00000100:00100000:0.0:1788574149.781336:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681594112 00000100:00100000:0.0:1788574149.781379:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788574149.781387:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3725c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681594112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788574149.781415:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788574149.781458:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3725c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681594112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574149.781465:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:0.0:1788574149.781484:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788574149.781510:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3727800 x1875455681594112/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574165 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574149.782109:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788574149.782119:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681593984:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788574149.782131:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788574149.782169:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681593984:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (2418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574149.782174:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00080000:2.0:1788574149.782234:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c36ace00 x1875455681593984/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574165 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574149.782251:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681593984:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788574149.782321:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3727800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681594112:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788574149.782467:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c34ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875455681594368:0@lo:400:kworker.0 00000100:00100000:0.0:1788574149.782498:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574149.782519:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c34fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3619:1875455681594880:0@lo:400:kworker.0 00000100:00100000:2.0:1788574149.782688:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3727800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:69505170-06bc-41d1-9626-ab1a3c7f32a0:3618:1875455681594240:0@lo:400:kworker.0 00000100:00100000:2.0:1788574149.782721:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574149.782750:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c34ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681594752:0@lo:400:kworker.0 00000100:00100000:2.0:1788574149.782772:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574149.782790:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c34ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681595264:0@lo:400:kworker.0 00000100:00100000:2.0:1788574149.782811:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574149.782829:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788574149.782842:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c34fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875455681594624:0@lo:400:kworker.0 00000100:00100000:2.0:1788574149.782870:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574149.782900:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c34fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681595136:0@lo:400:kworker.0 00000100:00100000:0.0:1788574149.783279:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574149.783303:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c34fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1875455681595392:0@lo:400:kworker.0 00000100:00100000:0.0:1788574149.783324:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574149.783345:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788574149.783352:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c34fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681594496:0@lo:400:kworker.0 00000100:00100000:0.0:1788574149.783376:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574149.783396:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c34ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1875455681595008:0@lo:400:kworker.0 00000100:00100000:0.0:1788574149.783413:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574149.783428:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c34fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1875455681595520:0@lo:400:kworker.0 00000100:00100000:0.0:1788574149.783448:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574149.783480:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681594368 00000100:00100000:0.0:1788574149.783487:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681594368 00000100:00100000:0.0:1788574149.783522:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681594624 00000100:00100000:2.0:1788574149.784257:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574149.784307:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681594240 00000100:00100000:2.0:1788574149.784312:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681594240 00000100:00100000:2.0:1788574149.784355:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1788574149.784365:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c820fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:3618:x1875455681594240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574149.784423:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c820fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:3618:x1875455681594240:12345-0@lo:400:kworker.0 Request processed in 60us (1700us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574149.784431:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1788574149.784465:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681594752 00000100:00100000:2.0:1788574149.784470:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681594752 00000100:00100000:2.0:1788574149.784495:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681594496 00000100:00100000:2.0:1788574149.784498:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681594496 00000100:00100000:2.0:1788574149.784511:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788574149.784517:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681594752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574149.784614:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681594624 00000100:00100000:0.0:1788574149.784635:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681594880 00000100:00100000:0.0:1788574149.784638:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681594880 00000100:00100000:0.0:1788574149.784658:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681595392 00000100:00100000:0.0:1788574149.784660:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681595392 00000100:00100000:0.0:1788574149.784676:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681595008 00000100:00100000:0.0:1788574149.784679:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681595008 00000100:00100000:0.0:1788574149.784690:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681595520 00000100:00100000:0.0:1788574149.784692:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681595520 00000100:00100000:0.0:1788574149.784703:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788574149.784709:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c34fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875455681594368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574149.784760:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c34fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875455681594368:12345-0@lo:400:kworker.0 Request processed in 50us (2260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574149.784766:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788574149.784782:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788574149.784787:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875455681594624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574149.784813:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875455681594624:12345-0@lo:400:kworker.0 Request processed in 26us (1943us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574149.784818:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788574149.784828:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788574149.784833:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c34fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875455681594880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574149.784859:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c34fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875455681594880:12345-0@lo:400:kworker.0 Request processed in 26us (1579us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574149.784864:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788574149.785488:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788574149.785499:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c34fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875455681595392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574149.785553:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c34fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875455681595392:12345-0@lo:400:kworker.0 Request processed in 57us (2228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574149.785560:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788574149.785573:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788574149.785579:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c34fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875455681595008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574149.785618:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c34fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875455681595008:12345-0@lo:400:kworker.0 Request processed in 40us (2204us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574149.785624:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788574149.785634:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788574149.785640:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c34fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875455681595520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574149.785677:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c34fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875455681595520:12345-0@lo:400:kworker.0 Request processed in 38us (2229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574149.785683:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788574149.785703:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681595264 00000100:00100000:0.0:1788574149.785709:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681595264 00000100:00100000:0.0:1788574149.785736:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681595136 00000100:00100000:0.0:1788574149.785739:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681595136 00000100:00100000:0.0:1788574149.785759:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788574149.785765:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681595264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574149.785797:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681595264:12345-0@lo:400:kworker.0 Request processed in 32us (2985us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574149.785803:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788574149.785813:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788574149.785819:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681595136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574149.785845:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681595136:12345-0@lo:400:kworker.0 Request processed in 26us (1667us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574149.785850:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788574149.785889:0:7533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788574149.785899:0:7533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c34fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681594496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574149.786087:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681594752:12345-0@lo:400:kworker.0 Request processed in 1570us (3313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574149.786094:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788574149.786149:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c34fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875455681594624:0@lo:400:kworker.0 00010000:00080000:2.0:1788574149.786166:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c34fc380 x1875455681595136/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574165 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574149.786202:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c34fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681595136:0@lo:400:kworker.0 00000100:00100000:2.0:1788574149.786215:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3727800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:69505170-06bc-41d1-9626-ab1a3c7f32a0:3618:1875455681594240:0@lo:400:kworker.0 00000100:00100000:2.0:1788574149.786241:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c34ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681594752:0@lo:400:kworker.0 00010000:00080000:2.0:1788574149.786252:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c34ff800 x1875455681595264/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574165 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574149.786260:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c34ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681595264:0@lo:400:kworker.0 00000100:00100000:0.0:1788574149.787617:0:7533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c34fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681594496:12345-0@lo:400:kworker.0 Request processed in 1713us (4234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574149.787629:0:7533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788574149.787711:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c34fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681594496:0@lo:400:kworker.0 00010000:00080000:0.0:1788574149.787727:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c34ff480 x1875455681595008/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574165 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574149.787750:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c34ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1875455681595008:0@lo:400:kworker.0 00010000:00080000:0.0:1788574149.787766:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c34fc000 x1875455681595520/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574165 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574149.787774:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c34fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1875455681595520:0@lo:400:kworker.0 00000100:00100000:0.0:1788574149.787786:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c34ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875455681594368:0@lo:400:kworker.0 00000100:00100000:0.0:1788574149.787798:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c34fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3619:1875455681594880:0@lo:400:kworker.0 00000100:00100000:0.0:1788574149.787815:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c34fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1875455681595392:0@lo:400:kworker.0 00000100:00080000:0.0:1788574149.787851:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788574149.787856:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788574150.296318:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574151.315618:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574152.340894:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574152.343415:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788574152.343439:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85ffaf6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681595648:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788574152.343504:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574152.343741:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681595648 00000100:00100000:3.0:1788574152.343749:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681595648 00000100:00100000:3.0:1788574152.343805:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788574152.343815:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de9bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681595648:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788574152.343851:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788574152.343949:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de9bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681595648:12345-0@lo:41:osp-pre-0-1.0 Request processed in 135us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574152.343956:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788574152.344038:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85ffaf6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681595648:0@lo:41:osp-pre-0-1.0 00000020:00000004:2.0:1788574152.704325:0:12772:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788574152.704578:0:12772:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788574153.367722:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574153.875387:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85de9bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681595776:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788574153.875532:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574153.875642:0:7533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681595776 00000100:00100000:1.0:1788574153.875658:0:7533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681595776 00000100:00100000:1.0:1788574153.875709:0:7533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788574153.875718:0:7533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de9bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681595776:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788574153.875753:0:7533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788574153.875815:0:7533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de9bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681595776:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574153.875822:0:7533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788574153.875871:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85de9bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681595776:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788574153.879421:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681595904:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788574153.880071:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574153.880149:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788574153.880158:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681596032:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788574153.880186:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574153.880248:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681595904 00000100:00100000:2.0:1788574153.880258:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681595904 00000100:00100000:2.0:1788574153.880309:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681596032 00000100:00100000:2.0:1788574153.880312:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681596032 00000100:00100000:2.0:1788574153.880332:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788574153.880340:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681595904:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788574153.880392:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788574153.880455:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681595904:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574153.880463:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788574153.880480:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788574153.880486:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681596032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788574153.880497:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788574153.880865:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681596032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 379us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574153.880887:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:2.0:1788574153.880904:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788574153.880946:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c36af100 x1875455681596032/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574169 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574153.880976:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681596032:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1788574153.880988:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c36ad880 x1875455681595904/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574169 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574153.880998:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681595904:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788574154.317612:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574154.317654:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574154.317694:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574154.317714:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574154.317740:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574154.317853:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668930560 00000100:00100000:1.0:1788574154.317863:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668930560 00000100:00100000:1.0:1788574154.317929:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668930816 00000100:00100000:1.0:1788574154.317933:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668930816 00000100:00100000:1.0:1788574154.317960:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668930688 00000100:00100000:1.0:1788574154.317963:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668930688 00000100:00100000:1.0:1788574154.317977:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668930944 00000100:00100000:1.0:1788574154.317980:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668930944 00000100:00100000:1.0:1788574154.317996:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 186 00000100:00100000:1.0:1788574154.318006:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c34fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+6:2394:x1875455668930560:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788574154.318100:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c34fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+6:2394:x1875455668930560:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 84us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574154.318108:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 186 00000100:00100000:1.0:1788574154.318127:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 187 00000100:00100000:1.0:1788574154.318134:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c34fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2394:x1875455668930816:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788574154.318159:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c34fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2394:x1875455668930816:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 26us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574154.318164:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 187 00000100:00100000:1.0:1788574154.318174:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 188 00000100:00100000:1.0:1788574154.318247:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c34ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+5:2394:x1875455668930688:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788574154.318272:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c34ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+5:2394:x1875455668930688:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 29us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574154.318279:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 188 00000100:00100000:1.0:1788574154.318292:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 189 00000100:00100000:1.0:1788574154.318297:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c34fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2394:x1875455668930944:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788574154.318320:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c34fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2394:x1875455668930944:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 22us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574154.318326:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 189 00000100:00080000:1.0:1788574154.318343:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788574154.318347:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788574154.319288:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668930432 00000100:00100000:3.0:1788574154.319297:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668930432 00000100:00100000:3.0:1788574154.319349:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 314 00000100:00100000:3.0:1788574154.319356:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c820cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+13:2394:x1875455668930432:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1788574154.319398:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c820cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+13:2394:x1875455668930432:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 43us (1704us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574154.319405:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 314 00010000:00010000:0.0:1788574154.389547:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574154.901320:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788574154.901342:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681596160:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788574154.901414:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574154.901486:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681596160 00000100:00100000:2.0:1788574154.901494:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681596160 00000100:00100000:2.0:1788574154.901779:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788574154.901789:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681596160:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788574154.901820:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788574154.901867:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681596160:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574154.901873:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:2.0:1788574154.901892:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788574154.901920:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c36ad880 x1875455681596160/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574170 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574154.901949:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681596160:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788574154.902944:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788574154.902962:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c34ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681596288:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788574154.903015:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574154.904481:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69505170-06bc-41d1-9626-ab1a3c7f32a0:3619:1875455681596416:0@lo:400:kworker.0 00000100:00100000:2.0:1788574154.904559:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574154.905254:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681596288 00000100:00100000:0.0:1788574154.905263:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681596288 00000100:00100000:0.0:1788574154.905331:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788574154.905340:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c34fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681596288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788574154.905363:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788574154.905415:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c34fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681596288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (2399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574154.905422:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:0.0:1788574154.905474:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788574154.905991:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fa0e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681596928:0@lo:400:kworker.0 00000100:00100000:2.0:1788574154.906050:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574154.907367:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fa0e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681597440:0@lo:400:kworker.0 00000100:00100000:2.0:1788574154.907408:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574154.907438:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788574154.907446:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875455681596544:0@lo:400:kworker.0 00000100:00100000:2.0:1788574154.907470:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574154.907491:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fa0e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3619:1875455681597056:0@lo:400:kworker.0 00000100:00100000:0.0:1788574154.907785:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681596928 00000100:00100000:0.0:1788574154.907793:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681596928 00000100:00100000:0.0:1788574154.907842:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788574154.907851:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681596928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574154.908141:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574154.908172:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1875455681597568:0@lo:400:kworker.0 00000100:00100000:2.0:1788574154.908225:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574154.909443:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681596416 00000100:00100000:2.0:1788574154.909454:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681596416 00000100:00100000:2.0:1788574154.909498:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1788574154.909505:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c820e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:3619:x1875455681596416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574154.912412:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681596928:12345-0@lo:400:kworker.0 Request processed in 4550us (6349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574154.912427:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788574154.912472:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681597440 00000100:00100000:0.0:1788574154.912480:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681597440 00000100:00100000:0.0:1788574154.912536:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788574154.912544:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681597440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574154.913584:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681596544 00000100:00100000:3.0:1788574154.913660:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681596544 00000100:00100000:3.0:1788574154.913702:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681597056 00000100:00100000:3.0:1788574154.913705:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681597056 00000100:00100000:3.0:1788574154.913729:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681597568 00000100:00100000:3.0:1788574154.913732:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681597568 00000100:00100000:3.0:1788574154.913746:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1788574154.913752:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875455681596544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574154.915652:0:11893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1788574154.915671:0:11893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875455681597056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574154.915811:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c820e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:3619:x1875455681596416:12345-0@lo:400:kworker.0 Request processed in 6304us (11249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574154.915821:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1788574154.915868:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1788574154.915877:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875455681597568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574154.915910:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875455681597568:12345-0@lo:400:kworker.0 Request processed in 34us (7685us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574154.915917:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1788574154.915990:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875455681596544:12345-0@lo:400:kworker.0 Request processed in 2235us (8516us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574154.915999:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1788574154.918552:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3727800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681596672:0@lo:400:kworker.0 00000100:00100000:0.0:1788574154.918621:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681597440:12345-0@lo:400:kworker.0 Request processed in 6074us (11208us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574154.918633:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:0.0:1788574154.918761:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788574154.919032:0:11893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875455681597056:12345-0@lo:400:kworker.0 Request processed in 3366us (10889us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574154.919045:0:11893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000001:00100000:1.0:1788574154.920015:0:9487:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 38a8b838-f1df-4bf7-be24-5141ce328dae 00000001:00100000:0.0:1788574154.920019:0:8404:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 38a8b838-f1df-4bf7-be24-5141ce328dae 00000020:00000080:1.0:1788574154.920025:0:9487:0:(genops.c:885:class_export_put()) final put ffff9c85ffb15800/38a8b838-f1df-4bf7-be24-5141ce328dae 00000020:00000080:0.0:1788574154.920025:0:8404:0:(genops.c:885:class_export_put()) final put ffff9c84c369d800/38a8b838-f1df-4bf7-be24-5141ce328dae 00000020:00000080:1.0:1788574154.920053:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85ffb15800/38a8b838-f1df-4bf7-be24-5141ce328dae for lustre-OST0001 00000020:00000080:1.0:1788574154.920095:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c85ffb10000 for lustre-OST0001 00000020:00000080:0.0:1788574154.920167:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c84c369d800/38a8b838-f1df-4bf7-be24-5141ce328dae for lustre-OST0000 00000020:00000080:0.0:1788574154.920213:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c84c3698000 for lustre-OST0000 00000100:00100000:2.0:1788574154.920402:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875455681596544:0@lo:400:kworker.0 00000100:00100000:2.0:1788574154.920432:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fa0e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3619:1875455681597056:0@lo:400:kworker.0 00000100:00100000:2.0:1788574154.920443:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1875455681597568:0@lo:400:kworker.0 00000100:00100000:2.0:1788574154.920453:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69505170-06bc-41d1-9626-ab1a3c7f32a0:3619:1875455681596416:0@lo:400:kworker.0 00000100:00100000:2.0:1788574154.920465:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fa0e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681596928:0@lo:400:kworker.0 00010000:00080000:2.0:1788574154.920478:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85fa0e5f80 x1875455681597440/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574170 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574154.920489:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fa0e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681597440:0@lo:400:kworker.0 00000100:00100000:3.0:1788574154.922627:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574154.922698:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fa0e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1875455681597184:0@lo:400:kworker.0 00000100:00100000:3.0:1788574154.922751:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574154.922773:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1875455681597696:0@lo:400:kworker.0 00000100:00100000:3.0:1788574154.922791:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788574154.922825:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c34ff480 x1875455681596288/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574170 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574154.922832:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681596672 00000100:00100000:1.0:1788574154.922842:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681596672 00000100:00100000:3.0:1788574154.922849:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c34ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681596288:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788574154.922874:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788574154.922888:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fa0e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875455681596800:0@lo:400:kworker.0 00000100:00100000:1.0:1788574154.922898:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788574154.922910:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffaf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681596672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574154.922928:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574154.922959:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fa0e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681597312:0@lo:400:kworker.0 00000100:00100000:1.0:1788574154.922990:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffaf6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681596672:12345-0@lo:400:kworker.0 Request processed in 81us (2254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574154.922993:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574154.923007:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788574154.923022:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3727800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681596672:0@lo:400:kworker.0 00000100:00100000:3.0:1788574154.923222:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681597184 00000100:00100000:3.0:1788574154.923227:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681597184 00000100:00100000:3.0:1788574154.923270:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681597696 00000100:00100000:3.0:1788574154.923273:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681597696 00000100:00100000:3.0:1788574154.923286:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681596800 00000100:00100000:3.0:1788574154.923289:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681596800 00000100:00100000:3.0:1788574154.923299:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1788574154.923305:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c2334e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875455681597184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574154.923340:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c2334e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875455681597184:12345-0@lo:400:kworker.0 Request processed in 36us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574154.923347:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1788574154.923355:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1788574154.923363:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1788574154.923369:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c2335c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875455681597696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574154.923375:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c2336a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875455681596800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574154.923423:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c2335c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875455681597696:12345-0@lo:400:kworker.0 Request processed in 58us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574154.923425:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c2336a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875455681596800:12345-0@lo:400:kworker.0 Request processed in 53us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574154.923438:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00080000:1.0:1788574154.923459:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788574154.923638:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1788574154.923751:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fa0e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875455681596800:0@lo:400:kworker.0 00010000:00080000:3.0:1788574154.923764:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85fa0e5500 x1875455681597184/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574170 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574154.923773:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fa0e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1875455681597184:0@lo:400:kworker.0 00010000:00080000:3.0:1788574154.923783:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c36ec000 x1875455681597696/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574170 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574154.923799:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1875455681597696:0@lo:400:kworker.0 00000100:00100000:1.0:1788574154.924251:0:8815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681597312 00000100:00100000:1.0:1788574154.924258:0:8815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681597312 00000100:00100000:1.0:1788574154.924309:0:8815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788574154.924317:0:8815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c2335880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681597312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574154.924369:0:8815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c2335880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681597312:12345-0@lo:400:kworker.0 Request processed in 53us (1377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574154.924376:0:8815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:1.0:1788574154.924407:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85fa0e5c00 x1875455681597312/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574170 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574154.924418:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fa0e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681597312:0@lo:400:kworker.0 00000020:00000004:1.0:1788574154.992978:0:12869:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788574154.993886:0:12869:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788574155.411914:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574156.435660:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574157.459368:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574157.459488:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788574157.459508:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85de9bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681597824:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788574157.459578:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574157.459646:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681597824 00000100:00100000:1.0:1788574157.459654:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681597824 00000100:00100000:1.0:1788574157.459699:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788574157.459709:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de9bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681597824:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788574157.459765:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788574157.459814:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de9bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681597824:12345-0@lo:41:osp-pre-0-1.0 Request processed in 106us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574157.459821:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788574157.459881:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85de9bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681597824:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788574158.483916:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574158.995650:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788574158.995674:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681597952:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788574158.995744:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574158.995816:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681597952 00000100:00100000:2.0:1788574158.995824:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681597952 00000100:00100000:2.0:1788574158.995890:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788574158.995900:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681597952:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788574158.995932:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1788574158.996104:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788574158.996117:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85de9bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681598080:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788574158.996149:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574158.996313:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3722a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681598208:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788574158.996343:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574158.996377:0:7533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681598208 00000100:00100000:1.0:1788574158.996381:0:7533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681598208 00000100:00100000:1.0:1788574158.996410:0:7533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788574158.996418:0:7533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3722d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681598208:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788574158.996446:0:7533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788574158.996486:0:7533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3722d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681598208:12345-0@lo:41:osp-pre-1-0.0 Request processed in 69us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574158.996495:0:7533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788574158.996554:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3722a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681598208:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788574158.996706:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681597952:12345-0@lo:13:osp-pre-0-1.0 Request processed in 807us (961us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574158.996714:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788574158.996726:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681598080 00000100:00100000:2.0:1788574158.996730:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681598080 00000100:00100000:2.0:1788574158.996750:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788574158.996756:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de9be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681598080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788574158.996785:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788574158.996814:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de9be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681598080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 58us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574158.996821:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:1.0:1788574158.997311:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788574158.997341:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85de9bd880 x1875455681598080/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574174 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574158.997356:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85de9bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681598080:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1788574158.997368:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3c2df80 x1875455681597952/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574174 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574158.997389:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681597952:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788574159.452769:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574159.452823:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574159.452857:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574159.452879:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574159.452907:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574159.452942:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668931328 00000100:00100000:1.0:1788574159.452953:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668931328 00000100:00100000:1.0:1788574159.453020:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668931584 00000100:00100000:1.0:1788574159.453023:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668931584 00000100:00100000:1.0:1788574159.453037:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668931200 00000100:00100000:1.0:1788574159.453039:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668931200 00000100:00100000:1.0:1788574159.453051:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668931456 00000100:00100000:1.0:1788574159.453054:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668931456 00000100:00100000:1.0:1788574159.453070:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 196 00000100:00100000:1.0:1788574159.453080:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3722a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+5:2394:x1875455668931328:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788574159.453178:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3722a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+5:2394:x1875455668931328:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 98us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574159.453209:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 196 00000100:00100000:1.0:1788574159.453230:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 197 00000100:00100000:1.0:1788574159.453237:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3723100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2394:x1875455668931584:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788574159.453263:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3723100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2394:x1875455668931584:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 27us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574159.453269:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 197 00000100:00100000:1.0:1788574159.453280:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 198 00000100:00100000:1.0:1788574159.453285:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3721500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+6:2394:x1875455668931200:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788574159.453331:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3721500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+6:2394:x1875455668931200:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 46us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574159.453336:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 198 00000100:00100000:1.0:1788574159.453349:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 199 00000100:00100000:1.0:1788574159.453354:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de9bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2394:x1875455668931456:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788574159.453378:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de9bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2394:x1875455668931456:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 24us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574159.453383:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 199 00000100:00100000:3.0:1788574159.453524:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668931072 00000100:00100000:3.0:1788574159.453531:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668931072 00000100:00100000:3.0:1788574159.453569:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 316 00000100:00100000:3.0:1788574159.453576:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c820c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+13:2394:x1875455668931072:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1788574159.453605:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c820c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+13:2394:x1875455668931072:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 30us (857us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574159.453611:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 316 00000100:00080000:0.0:1788574159.454280:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788574159.454287:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788574159.522600:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788574159.984552:0:13014:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1788574160.019724:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681598336:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788574160.019798:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574160.020173:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681598336 00000100:00100000:0.0:1788574160.020214:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681598336 00000100:00100000:0.0:1788574160.020329:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788574160.020343:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681598336:12345-0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788574160.020357:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:0.0:1788574160.020398:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788574160.020503:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681598336:12345-0@lo:13:osp-pre-1-1.0 Request processed in 163us (704us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574160.020512:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788574160.020682:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2335f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69505170-06bc-41d1-9626-ab1a3c7f32a0:3619:1875455681598464:0@lo:400:kworker.0 00000100:00100000:2.0:1788574160.020744:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574160.020811:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3727800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681598976:0@lo:400:kworker.0 00000100:00100000:1.0:1788574160.020857:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2335500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875455681598848:0@lo:400:kworker.0 00000100:00100000:2.0:1788574160.020882:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574160.020923:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574160.020933:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681599488:0@lo:400:kworker.0 00000100:00100000:1.0:1788574160.020963:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681599360:0@lo:400:kworker.0 00000100:00100000:2.0:1788574160.020995:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574160.021027:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681598848 00000100:00100000:1.0:1788574160.021035:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681598848 00000100:00100000:2.0:1788574160.021049:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788574160.021065:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2336680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875455681598592:0@lo:400:kworker.0 00000100:00100000:1.0:1788574160.021090:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1788574160.021103:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875455681598848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574160.021113:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574160.021143:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3619:1875455681599104:0@lo:400:kworker.0 00000100:00100000:2.0:1788574160.021378:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574160.021406:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85e56c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1875455681599616:0@lo:400:kworker.0 00000100:00100000:2.0:1788574160.021429:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574160.021472:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681598464 00000100:00100000:2.0:1788574160.021483:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681598464 00000100:00100000:2.0:1788574160.021543:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:2.0:1788574160.021552:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c820c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:3619:x1875455681598464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574160.021609:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c820c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:3619:x1875455681598464:12345-0@lo:400:kworker.0 Request processed in 57us (866us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574160.021617:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:2.0:1788574160.021670:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681598976 00000100:00100000:2.0:1788574160.021675:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681598976 00000100:00100000:2.0:1788574160.021703:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788574160.021709:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681598976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574160.021745:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681598976:12345-0@lo:400:kworker.0 Request processed in 36us (870us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574160.021751:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788574160.021770:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681599488 00000100:00100000:2.0:1788574160.021773:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681599488 00000100:00100000:2.0:1788574160.021805:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788574160.021812:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681599488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574160.021863:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681599488:12345-0@lo:400:kworker.0 Request processed in 50us (872us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574160.021874:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788574160.021895:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681598592 00000100:00100000:2.0:1788574160.021900:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681598592 00000100:00100000:2.0:1788574160.021924:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681599104 00000100:00100000:2.0:1788574160.021926:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681599104 00000100:00100000:2.0:1788574160.021944:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681599616 00000100:00100000:2.0:1788574160.021952:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681599616 00000100:00100000:2.0:1788574160.022034:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1788574160.022043:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875455681598592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574160.022087:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875455681598592:12345-0@lo:400:kworker.0 Request processed in 46us (979us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574160.022094:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1788574160.022111:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1788574160.022120:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875455681599104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574160.022167:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875455681599104:12345-0@lo:400:kworker.0 Request processed in 49us (789us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574160.022180:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1788574160.022227:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1788574160.022234:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875455681599616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574160.022267:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875455681599616:12345-0@lo:400:kworker.0 Request processed in 33us (837us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574160.022274:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00080000:2.0:1788574160.022300:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788574160.022305:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788574160.022316:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788574160.022363:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3c2f100 x1875455681598336/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574176 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574160.022388:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681598336:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788574160.022413:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681599872:0@lo:400:kworker.0 00000100:00100000:2.0:1788574160.022441:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574160.022472:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2335500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875455681598848:0@lo:400:kworker.0 00000100:00100000:2.0:1788574160.022487:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788574160.022494:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2334700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681598720:0@lo:400:kworker.0 00000100:00100000:2.0:1788574160.022522:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574160.022552:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3618:1875455681599232:0@lo:400:kworker.0 00000100:00100000:2.0:1788574160.022596:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574160.022622:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3618:1875455681599744:0@lo:400:kworker.0 00000100:00100000:2.0:1788574160.022646:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574160.022660:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875455681598848:12345-0@lo:400:kworker.0 Request processed in 1552us (1732us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574160.022674:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1788574160.022684:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681598720 00000100:00100000:2.0:1788574160.022693:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681598720 00000100:00100000:1.0:1788574160.022706:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681599232 00000100:00100000:1.0:1788574160.022714:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681599232 00000100:00100000:2.0:1788574160.022740:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788574160.022753:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681598720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574160.022772:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681599744 00000100:00100000:1.0:1788574160.022779:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681599744 00000100:00100000:2.0:1788574160.022808:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681598720:12345-0@lo:400:kworker.0 Request processed in 59us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574160.022821:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788574160.022829:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1788574160.022853:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875455681599232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574160.022866:0:11893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1788574160.022880:0:11893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875455681599744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574160.023960:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681599360 00000100:00100000:3.0:1788574160.023974:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681599360 00000100:00100000:3.0:1788574160.024275:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681599872 00000100:00100000:3.0:1788574160.024280:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681599872 00000100:00100000:3.0:1788574160.024316:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788574160.024536:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875455681599232:12345-0@lo:400:kworker.0 Request processed in 1695us (1936us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574160.024551:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1788574160.024561:0:11893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875455681599744:12345-0@lo:400:kworker.0 Request processed in 1676us (1905us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574160.024581:0:11893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00080000:1.0:1788574160.024613:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788574160.024620:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788574160.024623:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788574160.024684:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2336680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875455681598592:0@lo:400:kworker.0 00000100:00100000:2.0:1788574160.024699:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3619:1875455681599104:0@lo:400:kworker.0 00000100:00100000:2.0:1788574160.024712:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85e56c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1875455681599616:0@lo:400:kworker.0 00010000:00080000:2.0:1788574160.024728:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c36ded80 x1875455681599488/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574176 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574160.024740:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681599488:0@lo:400:kworker.0 00000100:00100000:2.0:1788574160.024754:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3727800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681598976:0@lo:400:kworker.0 00000100:00100000:2.0:1788574160.024766:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2335f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69505170-06bc-41d1-9626-ab1a3c7f32a0:3619:1875455681598464:0@lo:400:kworker.0 00000100:00100000:2.0:1788574160.024813:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2334700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681598720:0@lo:400:kworker.0 00010000:00080000:2.0:1788574160.024854:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c36de300 x1875455681599232/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574176 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574160.024866:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3618:1875455681599232:0@lo:400:kworker.0 00010000:00080000:2.0:1788574160.024902:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c335f100 x1875455681599744/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574176 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574160.024910:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3618:1875455681599744:0@lo:400:kworker.0 00000100:00100000:3.0:1788574160.025675:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681599360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574160.025798:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681599360:12345-0@lo:400:kworker.0 Request processed in 147us (3479us total) trans 0 rc 0/0 00010000:00080000:0.0:1788574160.025980:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c36df800 x1875455681599360/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574176 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574160.025997:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681599360:0@lo:400:kworker.0 00000100:00100000:0.0:1788574160.026436:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681600000:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788574160.027058:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574160.029227:0:8815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788574160.030741:0:8815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681599872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574160.031069:0:8815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681599872:12345-0@lo:400:kworker.0 Request processed in 358us (8626us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574160.031316:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:0.0:1788574160.031921:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c335d880 x1875455681599872/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574176 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574160.031943:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681599872:0@lo:400:kworker.0 00000100:00100000:1.0:1788574160.032618:0:8815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788574160.032680:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681600000 00000100:00100000:1.0:1788574160.032691:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681600000 00000100:00100000:1.0:1788574160.032769:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788574160.032782:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c34fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681600000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788574160.032861:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788574160.032976:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c34fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681600000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 198us (5921us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574160.032985:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:0.0:1788574160.033572:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3c2dc00 x1875455681600000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574176 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574160.033601:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681600000:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788574160.531872:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574161.557226:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574162.591885:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574162.592601:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788574162.592633:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681600128:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788574162.594658:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574162.594864:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681600128 00000100:00100000:2.0:1788574162.594883:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681600128 00000100:00100000:2.0:1788574162.594970:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788574162.594983:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c335ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681600128:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788574162.595038:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788574162.597073:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c335ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681600128:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2079us (2411us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574162.597089:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788574162.597282:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681600128:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788574163.604958:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788574163.795985:0:13161:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffff8634380 20000000:00000080:3.0:1788574163.796003:0:13161:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c84c1b9f800 uarg=0000000000000000 20000000:01000000:3.0:1788574163.796052:0:13161:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788574163.796065:0:13161:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788574163.796069:0:13161:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788574163.796676:0:13162:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:3.0:1788574163.796825:0:13161:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788574163.802624:0:13161:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788574163.802656:0:13161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c85c0030200/0x5bf8706fdac8c02c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574163.802677:0:13161:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c85faea2e00/0x5bf8706fdac8bfbc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6683 expref: 12 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574163.802686:0:13161:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c85c152ee00/0x5bf8706fdac8bfca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8bfc3 expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574163.802694:0:13161:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c860204b800/0x5bf8706fdac8bfd8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8bfd1 expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574163.802702:0:13161:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c85fa32e000/0x5bf8706fdac8bfe6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8bfdf expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574163.802709:0:13161:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c85fa32fa00/0x5bf8706fdac8bff4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8bfed expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574163.802716:0:13161:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c85fa32f200/0x5bf8706fdac8c009 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d66c2 expref: 12 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574163.802723:0:13161:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c85c0030200/0x5bf8706fdac8c02c lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574163.802870:0:13161:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c85fa32f200/0x5bf8706fdac8c009 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d66c2 expref: 12 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574163.802887:0:13161:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c85fa32f200/0x5bf8706fdac8c009 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d66c2 expref: 12 pid: 6487 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574163.802911:0:13161:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13161:1875455681600256:192.168.204.51@tcp:104: 00010000:00010000:3.0:1788574163.803114:0:13161:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c85fa32fa00/0x5bf8706fdac8bff4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5bf8706fdac8bfed expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574163.803122:0:13161:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c85fa32fa00/0x5bf8706fdac8bff4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5bf8706fdac8bfed expref: 23 pid: 6485 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574163.803131:0:13161:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13161:1875455681600384:0@lo:104: 00000100:00100000:3.0:1788574163.803170:0:13161:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788574163.803257:0:13161:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c85fa32e000/0x5bf8706fdac8bfe6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5bf8706fdac8bfdf expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574163.803266:0:13161:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c85fa32e000/0x5bf8706fdac8bfe6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5bf8706fdac8bfdf expref: 23 pid: 6486 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574163.803274:0:13161:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13161:1875455681600512:0@lo:104: 00000100:00100000:3.0:1788574163.803296:0:13161:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788574163.803328:0:13161:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c860204b800/0x5bf8706fdac8bfd8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5bf8706fdac8bfd1 expref: 23 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574163.803335:0:13161:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c860204b800/0x5bf8706fdac8bfd8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5bf8706fdac8bfd1 expref: 23 pid: 6486 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574163.803342:0:13161:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13161:1875455681600640:0@lo:104: 00000100:00100000:3.0:1788574163.803361:0:13161:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788574163.803383:0:13161:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c85c152ee00/0x5bf8706fdac8bfca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5bf8706fdac8bfc3 expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574163.803402:0:13161:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c85c152ee00/0x5bf8706fdac8bfca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5bf8706fdac8bfc3 expref: 23 pid: 6485 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574163.803411:0:13161:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13161:1875455681600768:0@lo:104: 00000100:00100000:3.0:1788574163.803434:0:13161:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788574163.803451:0:13161:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c85faea2e00/0x5bf8706fdac8bfbc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6683 expref: 12 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574163.803459:0:13161:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c85faea2e00/0x5bf8706fdac8bfbc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6683 expref: 12 pid: 6487 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574163.803466:0:13161:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13161:1875455681600896:192.168.204.51@tcp:104: 00000100:00100000:3.0:1788574163.803487:0:13161:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c267ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1788574163.803877:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681600384 00000100:00100000:2.0:1788574163.803885:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681600384 00000100:00100000:2.0:1788574163.805070:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681600512 00000100:00100000:2.0:1788574163.805083:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681600512 00000100:00100000:2.0:1788574163.805118:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681600640 00000100:00100000:2.0:1788574163.805121:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681600640 00000100:00100000:2.0:1788574163.805131:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681600768 00000100:00100000:2.0:1788574163.805134:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681600768 00000100:00100000:2.0:1788574163.805150:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788574163.805160:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c335ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:69505170-06bc-41d1-9626-ab1a3c7f32a0+6:13161:x1875455681600384:12345-0@lo:104: 00010000:00010000:2.0:1788574163.805181:0:6475:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff9c860204a600/0x5bf8706fdac8bfed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8bff4 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574163.805297:0:6475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788574163.805304:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c335ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:69505170-06bc-41d1-9626-ab1a3c7f32a0+6:13161:x1875455681600384:12345-0@lo:104: Request processed in 145us (2134us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574163.805460:0:10311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788574163.805472:0:10311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c335ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:69505170-06bc-41d1-9626-ab1a3c7f32a0+6:13161:x1875455681600512:12345-0@lo:104: 00010000:00010000:1.0:1788574163.805482:0:10311:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff9c860204b400/0x5bf8706fdac8bfdf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8bfe6 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574163.805541:0:10311:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788574163.805546:0:10311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c335ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:69505170-06bc-41d1-9626-ab1a3c7f32a0+6:13161:x1875455681600512:12345-0@lo:104: Request processed in 79us (2250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574163.805553:0:10311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788574163.805570:0:10311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788574163.805576:0:10311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c335c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:69505170-06bc-41d1-9626-ab1a3c7f32a0+5:13161:x1875455681600640:12345-0@lo:104: 00010000:00010000:1.0:1788574163.805584:0:10311:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff9c85fa32e800/0x5bf8706fdac8bfd1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8bfd8 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574163.805616:0:10311:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788574163.805621:0:10311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c335c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:69505170-06bc-41d1-9626-ab1a3c7f32a0+5:13161:x1875455681600640:12345-0@lo:104: Request processed in 46us (2260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574163.805627:0:10311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788574163.805637:0:10311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788574163.805642:0:10311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c335d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:69505170-06bc-41d1-9626-ab1a3c7f32a0+4:13161:x1875455681600768:12345-0@lo:104: 00010000:00010000:1.0:1788574163.805650:0:10311:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff9c85fa32f800/0x5bf8706fdac8bfc3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8bfca expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574163.805673:0:10311:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1788574163.805677:0:10311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c335d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:69505170-06bc-41d1-9626-ab1a3c7f32a0+4:13161:x1875455681600768:12345-0@lo:104: Request processed in 36us (2243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574163.805682:0:10311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788574163.806508:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00010000:1.0:1788574163.806789:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788574163.806799:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c860204a600/0x5bf8706fdac8bfed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8bff4 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574163.806821:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c860204a600 already unused, calling callback (ffffffffc1472c20) 10000000:00010000:1.0:1788574163.806826:0:6480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c860204a600/0x5bf8706fdac8bfed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5bf8706fdac8bff4 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574163.806835:0:6480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c860204a600/0x5bf8706fdac8bfed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5bf8706fdac8bff4 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788574163.806843:0:6480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c860204a600/0x5bf8706fdac8bfed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5bf8706fdac8bff4 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788574163.806849:0:6480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788574163.806899:0:6480:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9c860204a600/0x5bf8706fdac8bfed lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bff4 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574163.806906:0:6480:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788574163.806934:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c860204a600/0x5bf8706fdac8bfed lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bff4 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574163.806941:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c860204a600/0x5bf8706fdac8bfed lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bff4 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574163.806956:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788574163.806959:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c860204b400/0x5bf8706fdac8bfdf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8bfe6 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574163.806965:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c860204b400 already unused, calling callback (ffffffffc1472c20) 10000000:00010000:1.0:1788574163.806968:0:6480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c860204b400/0x5bf8706fdac8bfdf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5bf8706fdac8bfe6 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574163.806985:0:6480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c860204b400/0x5bf8706fdac8bfdf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5bf8706fdac8bfe6 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788574163.806992:0:6480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c860204b400/0x5bf8706fdac8bfdf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5bf8706fdac8bfe6 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788574163.806997:0:6480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788574163.807010:0:6480:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9c860204b400/0x5bf8706fdac8bfdf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bfe6 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574163.807017:0:6480:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788574163.807023:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c860204b400/0x5bf8706fdac8bfdf lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bfe6 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574163.807029:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c860204b400/0x5bf8706fdac8bfdf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bfe6 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574163.807042:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788574163.807045:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c85fa32e800/0x5bf8706fdac8bfd1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8bfd8 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574163.807051:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32e800 already unused, calling callback (ffffffffc1472c20) 10000000:00010000:1.0:1788574163.807054:0:6480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c85fa32e800/0x5bf8706fdac8bfd1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5bf8706fdac8bfd8 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574163.807060:0:6480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c85fa32e800/0x5bf8706fdac8bfd1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5bf8706fdac8bfd8 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788574163.807067:0:6480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c85fa32e800/0x5bf8706fdac8bfd1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5bf8706fdac8bfd8 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788574163.807077:0:6480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788574163.807090:0:6480:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9c85fa32e800/0x5bf8706fdac8bfd1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bfd8 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574163.807095:0:6480:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788574163.807112:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c85fa32e800/0x5bf8706fdac8bfd1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bfd8 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574163.807119:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c85fa32e800/0x5bf8706fdac8bfd1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bfd8 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574163.807127:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788574163.807130:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c85fa32f800/0x5bf8706fdac8bfc3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8bfca expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574163.807135:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32f800 already unused, calling callback (ffffffffc1472c20) 10000000:00010000:1.0:1788574163.807138:0:6480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c85fa32f800/0x5bf8706fdac8bfc3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5bf8706fdac8bfca expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574163.807145:0:6480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c85fa32f800/0x5bf8706fdac8bfc3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5bf8706fdac8bfca expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788574163.807151:0:6480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c85fa32f800/0x5bf8706fdac8bfc3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5bf8706fdac8bfca expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788574163.807156:0:6480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788574163.807168:0:6480:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9c85fa32f800/0x5bf8706fdac8bfc3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bfca expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574163.807173:0:6480:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788574163.807185:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c85fa32f800/0x5bf8706fdac8bfc3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bfca expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574163.807677:0:13161:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13161:1875455681600384:0@lo:104: 00000100:00100000:3.0:1788574163.807689:0:13161:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13161:1875455681600512:0@lo:104: 00000100:00100000:3.0:1788574163.807697:0:13161:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13161:1875455681600640:0@lo:104: 00000100:00100000:3.0:1788574163.807706:0:13161:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13161:1875455681600768:0@lo:104: 00000100:00100000:2.0:1788574163.807899:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:69505170-06bc-41d1-9626-ab1a3c7f32a0:3620:1875455681601408:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788574163.807970:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574163.808027:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788574163.808034:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:69505170-06bc-41d1-9626-ab1a3c7f32a0:3620:1875455681601280:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788574163.808058:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574163.808088:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:69505170-06bc-41d1-9626-ab1a3c7f32a0:3617:1875455681601024:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788574163.808110:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574163.808128:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788574163.808132:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:69505170-06bc-41d1-9626-ab1a3c7f32a0:3617:1875455681601152:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788574163.808150:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788574163.808173:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574163.808186:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681601408 00000100:00100000:2.0:1788574163.808214:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681601408 00010000:00010000:2.0:1788574163.808244:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c85c152ee00/0x5bf8706fdac8bfca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8bfc3 expref: 24 pid: 6485 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574163.808476:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c85fa32f800/0x5bf8706fdac8bfc3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8bfca expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574163.808493:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574163.808495:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574163.808497:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574163.808508:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681601280 00000100:00100000:1.0:1788574163.808512:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681601280 00010000:00010000:1.0:1788574163.808530:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c860204b800/0x5bf8706fdac8bfd8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8bfd1 expref: 25 pid: 6486 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574163.808550:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681601024 00000100:00100000:1.0:1788574163.808553:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681601024 00010000:00010000:1.0:1788574163.808564:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c85fa32fa00/0x5bf8706fdac8bff4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8bfed expref: 26 pid: 6485 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574163.808574:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681601152 00000100:00100000:1.0:1788574163.808577:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681601152 00010000:00010000:1.0:1788574163.808587:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c85fa32e000/0x5bf8706fdac8bfe6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8bfdf expref: 27 pid: 6486 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574163.808601:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788574163.808609:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:69505170-06bc-41d1-9626-ab1a3c7f32a0+27:3620:x1875455681601280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788574163.808622:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574163.808628:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c860204b800/0x5bf8706fdac8bfd8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8bfd1 expref: 27 pid: 6486 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574163.808637:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c860204b800/0x5bf8706fdac8bfd8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5bf8706fdac8bfd1 expref: 27 pid: 6486 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574163.808667:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c860204b800/0x5bf8706fdac8bfd8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5bf8706fdac8bfd1 expref: 27 pid: 6486 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574163.808709:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788574163.808753:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:69505170-06bc-41d1-9626-ab1a3c7f32a0+26:3620:x1875455681601280:12345-0@lo:103:ldlm_bl.0 Request processed in 145us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574163.808773:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788574163.808791:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788574163.808798:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c2e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:69505170-06bc-41d1-9626-ab1a3c7f32a0+25:3617:x1875455681601024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788574163.808806:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574163.808811:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c85fa32fa00/0x5bf8706fdac8bff4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8bfed expref: 25 pid: 6485 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574163.808819:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c85fa32fa00/0x5bf8706fdac8bff4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5bf8706fdac8bfed expref: 25 pid: 6485 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574163.808830:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85fa32fa00/0x5bf8706fdac8bff4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5bf8706fdac8bfed expref: 25 pid: 6485 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574163.808838:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788574163.808865:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c2e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:3617:x1875455681601024:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (754us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574163.808871:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788574163.808883:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788574163.808889:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:69505170-06bc-41d1-9626-ab1a3c7f32a0+23:3617:x1875455681601152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788574163.808896:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574163.808900:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c85fa32e000/0x5bf8706fdac8bfe6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8bfdf expref: 23 pid: 6486 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574163.808913:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c85fa32e000/0x5bf8706fdac8bfe6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5bf8706fdac8bfdf expref: 23 pid: 6486 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574163.809004:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788574163.809011:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c2c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69505170-06bc-41d1-9626-ab1a3c7f32a0+23:3620:x1875455681601408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788574163.809019:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788574163.809023:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c85c152ee00/0x5bf8706fdac8bfca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8bfc3 expref: 23 pid: 6485 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574163.809051:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85fa32e000/0x5bf8706fdac8bfe6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5bf8706fdac8bfdf expref: 23 pid: 6486 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574163.809147:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574163.810496:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:69505170-06bc-41d1-9626-ab1a3c7f32a0:3620:1875455681601280:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788574163.812594:0:13161:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13161:1875455681600256:192.168.204.51@tcp:104: 00000100:00100000:3.0:1788574163.812617:0:13161:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13161:1875455681600896:192.168.204.51@tcp:104: 00010000:00010000:2.0:1788574163.813014:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c85c152ee00/0x5bf8706fdac8bfca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5bf8706fdac8bfc3 expref: 22 pid: 6485 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574163.813041:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85c152ee00/0x5bf8706fdac8bfca lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5bf8706fdac8bfc3 expref: 22 pid: 6485 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574163.813079:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788574163.813141:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c2c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69505170-06bc-41d1-9626-ab1a3c7f32a0+21:3620:x1875455681601408:12345-0@lo:103:ldlm_bl.0 Request processed in 4130us (5170us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574163.813153:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788574163.813521:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:69505170-06bc-41d1-9626-ab1a3c7f32a0:3620:1875455681601408:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788574163.813660:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:69505170-06bc-41d1-9626-ab1a3c7f32a0:3617:1875455681601024:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788574163.814049:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788574163.814116:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:69505170-06bc-41d1-9626-ab1a3c7f32a0+20:3617:x1875455681601152:12345-0@lo:103:ldlm_bl.0 Request processed in 5225us (5961us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574163.814126:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788574163.814242:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574163.814446:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668931840 00000100:00100000:1.0:1788574163.814453:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668931840 00010000:00010000:1.0:1788574163.814484:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c85faea2e00/0x5bf8706fdac8bfbc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6683 expref: 13 pid: 6487 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574163.814513:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 44 00000100:00100000:1.0:1788574163.814521:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c34fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+13:2394:x1875455668931840:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788574163.814536:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574163.814542:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c85faea2e00/0x5bf8706fdac8bfbc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6683 expref: 13 pid: 6487 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574163.814553:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c85faea2e00/0x5bf8706fdac8bfbc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6683 expref: 13 pid: 6487 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574163.814568:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85faea2e00/0x5bf8706fdac8bfbc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6683 expref: 13 pid: 6487 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574163.814579:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788574163.814629:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c34fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+12:2394:x1875455668931840:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 108us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574163.814636:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 44 00000100:00100000:0.0:1788574163.815212:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574163.815240:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668931712 00000100:00100000:0.0:1788574163.815246:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668931712 00010000:00010000:0.0:1788574163.815369:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c85fa32f200/0x5bf8706fdac8c009 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d66c2 expref: 12 pid: 6487 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574163.815393:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 45 00000100:00100000:0.0:1788574163.815400:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e0b7a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+12:2394:x1875455668931712:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788574163.815409:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574163.815413:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c85fa32f200/0x5bf8706fdac8c009 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d66c2 expref: 12 pid: 6487 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574163.815423:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c85fa32f200/0x5bf8706fdac8c009 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d66c2 expref: 12 pid: 6487 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574163.815434:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85fa32f200/0x5bf8706fdac8c009 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d66c2 expref: 12 pid: 6487 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574163.815448:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c85c0030200/0x5bf8706fdac8c02c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574163.815457:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85c0030200/0x5bf8706fdac8c02c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 13161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574163.815485:0:6479:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c85c0030200/0x5bf8706fdac8c02c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574163.815492:0:6479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c85c0030200/0x5bf8706fdac8c02c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574163.815498:0:6479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c85c0030200/0x5bf8706fdac8c02c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574163.815506:0:6479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c85c0030200/0x5bf8706fdac8c02c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574163.815512:0:6479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85c0030200 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:0.0:1788574163.815517:0:6479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c85c0030200/0x5bf8706fdac8c02c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574163.815526:0:6479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c85c0030200/0x5bf8706fdac8c02c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574163.815535:0:6479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c85c0030200/0x5bf8706fdac8c02c lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574163.815544:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574163.815572:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e0b7a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+11:2394:x1875455668931712:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 173us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574163.815579:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 45 00000100:00100000:2.0:1788574163.816802:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:69505170-06bc-41d1-9626-ab1a3c7f32a0:3617:1875455681601152:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788574163.817465:0:13161:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c85c0030200/0x5bf8706fdac8c02c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574163.817518:0:13161:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c85c0030200/0x5bf8706fdac8c02c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574163.817526:0:13161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c85c0030200/0x5bf8706fdac8c02c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574163.817556:0:13161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85c0030200/0x5bf8706fdac8c02c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574164.115960:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681601536:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788574164.116068:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574164.116171:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681601536 00000100:00100000:1.0:1788574164.116181:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681601536 00000100:00100000:1.0:1788574164.116297:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788574164.116453:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681601536:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788574164.116486:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788574164.116529:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681601536:12345-0@lo:13:osp-pre-0-1.0 Request processed in 223us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574164.116535:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:1.0:1788574164.116553:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788574164.116576:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3c0aa00 x1875455681601536/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574180 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574164.116594:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c0aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681601536:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788574164.116939:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c34fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681601664:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788574164.116975:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574164.117123:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681601664 00000100:00100000:2.0:1788574164.117130:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681601664 00000100:00100000:2.0:1788574164.117171:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788574164.117178:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c34ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681601664:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788574164.117236:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788574164.117317:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c34ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681601664:12345-0@lo:41:osp-pre-1-0.0 Request processed in 130us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574164.117324:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788574164.117627:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c34fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681601664:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788574164.117804:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788574164.117816:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681601792:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788574164.117849:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574164.117937:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681601792 00000100:00100000:3.0:1788574164.117942:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681601792 00000100:00100000:3.0:1788574164.117988:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788574164.117997:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c34fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681601792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788574164.118013:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788574164.118052:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c34fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681601792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574164.118058:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:0.0:1788574164.118118:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788574164.118139:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c335f100 x1875455681601792/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574180 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574164.118153:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681601792:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788574164.554686:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574164.554777:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668931968 00000100:00100000:3.0:1788574164.554787:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668931968 00000100:00100000:3.0:1788574164.554903:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 318 00000100:00100000:3.0:1788574164.554915:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c820e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+11:2393:x1875455668931968:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1788574164.555004:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c820e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+11:2393:x1875455668931968:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 80us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574164.555012:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 318 00000100:00100000:1.0:1788574164.565620:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574164.565671:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574164.565782:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574164.569780:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668932096 00000100:00100000:0.0:1788574164.569797:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668932096 00000100:00100000:3.0:1788574164.571240:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668932352 00000100:00100000:3.0:1788574164.571255:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668932352 00000100:00100000:0.0:1788574164.571281:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668932224 00000100:00100000:0.0:1788574164.571288:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668932224 00000100:00100000:3.0:1788574164.571350:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 206 00000100:00100000:3.0:1788574164.571363:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+6:2394:x1875455668932096:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1788574164.571372:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 207 00000100:00100000:0.0:1788574164.571385:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2394:x1875455668932352:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1788574164.571454:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+6:2394:x1875455668932096:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 93us (5845us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574164.571455:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2394:x1875455668932352:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 73us (5781us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574164.571470:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 206 00000100:00100000:0.0:1788574164.571492:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 207 00000100:00100000:3.0:1788574164.571509:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 208 00000100:00100000:3.0:1788574164.571518:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+5:2393:x1875455668932224:12345-192.168.204.51@tcp:400:kworker.0 00000100:00080000:0.0:1788574164.571533:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788574164.571539:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788574164.571547:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+5:2393:x1875455668932224:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 30us (5765us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574164.571553:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 208 00000100:00100000:1.0:1788574164.574217:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574164.574476:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668932480 00000100:00100000:0.0:1788574164.574487:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668932480 00000100:00100000:0.0:1788574164.574635:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 209 00000100:00100000:0.0:1788574164.574647:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2393:x1875455668932480:12345-192.168.204.51@tcp:400:kworker.0 00000100:00080000:2.0:1788574164.574652:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788574164.574732:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2393:x1875455668932480:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 87us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574164.574740:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 209 00010000:00010000:0.0:1788574164.629583:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574165.139417:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788574165.139443:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681601920:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788574165.139686:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574165.139865:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:69505170-06bc-41d1-9626-ab1a3c7f32a0:3617:1875455681602048:0@lo:400:kworker.0 00000100:00100000:2.0:1788574165.139900:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574165.139959:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3727800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681602560:0@lo:400:kworker.0 00000100:00100000:2.0:1788574165.139984:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574165.140003:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681603072:0@lo:400:kworker.0 00000100:00100000:2.0:1788574165.140026:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574165.140045:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2336680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681603584:0@lo:400:kworker.0 00000100:00100000:2.0:1788574165.140065:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574165.140085:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788574165.140091:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875455681602176:0@lo:400:kworker.0 00000100:00100000:1.0:1788574165.140095:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681602304:0@lo:400:kworker.0 00000100:00100000:1.0:1788574165.140118:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574165.140127:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574165.140143:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85e56c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1875455681602688:0@lo:400:kworker.0 00000100:00100000:1.0:1788574165.140143:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1875455681602816:0@lo:400:kworker.0 00000100:00100000:1.0:1788574165.140161:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574165.140170:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875455681602432:0@lo:400:kworker.0 00000100:00100000:1.0:1788574165.140179:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2334700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1875455681603328:0@lo:400:kworker.0 00000100:00100000:2.0:1788574165.140211:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574165.140226:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681601920 00000100:00100000:2.0:1788574165.140232:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681602944:0@lo:400:kworker.0 00000100:00100000:1.0:1788574165.140235:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681601920 00000100:00100000:2.0:1788574165.140251:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574165.140265:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2335f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681603456:0@lo:400:kworker.0 00000100:00100000:2.0:1788574165.140281:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574165.140285:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788574165.140294:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681601920:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788574165.140308:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681602048 00000100:00100000:2.0:1788574165.140311:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681602048 00002000:00000024:1.0:1788574165.140322:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788574165.140334:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:2.0:1788574165.140340:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c820f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+20:3617:x1875455681602048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574165.140359:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681601920:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574165.140365:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c820f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+20:3617:x1875455681602048:12345-0@lo:400:kworker.0 Request processed in 25us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574165.140366:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788574165.140370:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1788574165.140388:0:11893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681602176 00000100:00100000:1.0:1788574165.140392:0:11893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681602176 00000100:00100000:2.0:1788574165.140393:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681602560 00000100:00100000:2.0:1788574165.140395:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681602560 00000100:00100000:2.0:1788574165.140413:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681602304 00000100:00100000:1.0:1788574165.140413:0:11893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681602816 00000100:00100000:2.0:1788574165.140416:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681602304 00000100:00100000:1.0:1788574165.140416:0:11893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681602816 00000100:00100000:2.0:1788574165.140428:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788574165.140432:0:11893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681602432 00000100:00100000:2.0:1788574165.140434:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c2335500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681602560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574165.140434:0:11893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681602432 00000100:00100000:1.0:1788574165.140446:0:11893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1788574165.140451:0:11893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa0e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875455681602176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574165.140463:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c2335500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681602560:12345-0@lo:400:kworker.0 Request processed in 30us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574165.140654:0:11893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa0e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875455681602176:12345-0@lo:400:kworker.0 Request processed in 202us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574165.140661:0:11893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1788574165.140675:0:11893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1788574165.140681:0:11893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875455681602816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574165.140821:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1788574165.140830:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa0e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875455681602432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574165.140869:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa0e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875455681602432:12345-0@lo:400:kworker.0 Request processed in 41us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574165.140875:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1788574165.140912:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875455681602432:0@lo:400:kworker.0 00000100:00100000:1.0:1788574165.141637:0:11893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875455681602816:12345-0@lo:400:kworker.0 Request processed in 887us (1404us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574165.141646:0:11893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1788574165.142353:0:8815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681603072 00000100:00100000:1.0:1788574165.142362:0:8815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681603072 00000100:00100000:1.0:1788574165.142403:0:8815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681603584 00000100:00100000:1.0:1788574165.142411:0:8815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681603584 00000100:00100000:1.0:1788574165.142426:0:8815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681602944 00000100:00100000:1.0:1788574165.142428:0:8815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681602944 00000100:00100000:1.0:1788574165.142438:0:8815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681603456 00000100:00100000:1.0:1788574165.142441:0:8815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681603456 00000100:00100000:2.0:1788574165.142845:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788574165.142877:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788574165.142890:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681602304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574165.142987:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681602304:12345-0@lo:400:kworker.0 Request processed in 102us (2868us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574165.142995:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788574165.143024:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788574165.143032:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681603072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574165.143066:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681603072:12345-0@lo:400:kworker.0 Request processed in 36us (3038us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574165.143072:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788574165.143085:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788574165.143091:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681603584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574165.143117:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681603584:12345-0@lo:400:kworker.0 Request processed in 27us (3052us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574165.143124:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788574165.143135:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788574165.143141:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa0e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681602944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574165.143176:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa0e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681602944:12345-0@lo:400:kworker.0 Request processed in 35us (2923us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574165.143176:0:8815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788574165.143215:0:8815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa0e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681603456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574165.143257:0:8815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa0e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681603456:12345-0@lo:400:kworker.0 Request processed in 68us (2974us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574165.143325:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788574165.143399:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c36de300 x1875455681602944/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574181 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574165.143435:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681602944:0@lo:400:kworker.0 00010000:00080000:0.0:1788574165.143566:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c2335f80 x1875455681603456/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574181 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574165.143576:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2335f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681603456:0@lo:400:kworker.0 00000100:00100000:0.0:1788574165.143606:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681602688 00000100:00100000:0.0:1788574165.143610:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681602688 00000100:00100000:3.0:1788574165.143791:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3617:1875455681603200:0@lo:400:kworker.0 00000100:00100000:3.0:1788574165.143829:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574165.143928:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:69505170-06bc-41d1-9626-ab1a3c7f32a0:3617:1875455681602048:0@lo:400:kworker.0 00000100:00100000:3.0:1788574165.143948:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3727800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681602560:0@lo:400:kworker.0 00010000:00080000:3.0:1788574165.143961:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c36ded80 x1875455681603072/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574181 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574165.143969:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681603072:0@lo:400:kworker.0 00010000:00080000:3.0:1788574165.143981:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c2336680 x1875455681603584/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574181 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574165.143989:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2336680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681603584:0@lo:400:kworker.0 00000100:00100000:3.0:1788574165.144013:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875455681602176:0@lo:400:kworker.0 00000100:00100000:3.0:1788574165.144033:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681603200 00000100:00100000:3.0:1788574165.144037:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681603200 00000100:00100000:0.0:1788574165.144067:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1788574165.144077:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c335fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875455681602688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574165.144119:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c335fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875455681602688:12345-0@lo:400:kworker.0 Request processed in 44us (795us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574165.145362:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1788574165.145427:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1788574165.145801:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85e56c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1875455681602688:0@lo:400:kworker.0 00000100:00100000:3.0:1788574165.145860:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c335d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875455681603200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574165.145937:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c335d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875455681603200:12345-0@lo:400:kworker.0 Request processed in 565us (2106us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574165.145961:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1788574165.145989:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788574165.146025:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3c2df80 x1875455681601920/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574181 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574165.146042:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681601920:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788574165.146065:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681602304:0@lo:400:kworker.0 00010000:00080000:3.0:1788574165.146078:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c36df800 x1875455681602816/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574181 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574165.146087:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1875455681602816:0@lo:400:kworker.0 00000100:00100000:0.0:1788574165.146168:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681603328 00000100:00100000:2.0:1788574165.146218:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:2.0:1788574165.146243:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788574165.146247:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788574165.146251:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788574165.146453:0:8815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788574165.146802:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681603328 00000100:00100000:0.0:1788574165.146853:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1788574165.146860:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c335f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875455681603328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574165.146920:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c335f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875455681603328:12345-0@lo:400:kworker.0 Request processed in 60us (930us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574165.146926:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00010000:00080000:0.0:1788574165.146959:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c2334700 x1875455681603328/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574181 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574165.146969:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2334700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1875455681603328:0@lo:400:kworker.0 00000100:00100000:0.0:1788574165.146995:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3617:1875455681603200:0@lo:400:kworker.0 00000100:00100000:0.0:1788574165.147005:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788574165.147014:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fa0e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681603712:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788574165.147048:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574165.147076:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681603712 00000100:00100000:0.0:1788574165.147080:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681603712 00000100:00100000:0.0:1788574165.147103:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788574165.147109:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c34ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681603712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788574165.147122:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788574165.147155:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c34ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681603712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 46us (106us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574165.147161:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00080000:0.0:1788574165.147185:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85fa0e4380 x1875455681603712/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574181 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574165.147219:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fa0e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681603712:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788574165.147294:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788574165.255045:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574165.255651:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668932608 00000100:00100000:2.0:1788574165.255664:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668932608 00000100:00100000:2.0:1788574165.255727:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 320 00000100:00100000:2.0:1788574165.255750:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c860022b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+11:6164:x1875455668932608:12345-192.168.204.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788574165.255803:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574165.255826:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85fa32ea00/0x5bf8706fdac8c033 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x652b547cf44d66f3 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574165.255858:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85fa32ea00/0x5bf8706fdac8c033 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d66f3 expref: 12 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574165.255870:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85fa32ea00/0x5bf8706fdac8c033 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d66f3 expref: 12 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574165.255881:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85fa32ea00, rc 0) 00000100:00100000:2.0:1788574165.255950:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c860022b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+12:6164:x1875455668932608:12345-192.168.204.51@tcp:101:ll_cfg_requeue.0 Request processed in 214us (916us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574165.255958:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 320 00000100:00100000:1.0:1788574165.270169:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574165.270348:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668932736 00000100:00100000:2.0:1788574165.270359:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668932736 00000100:00100000:2.0:1788574165.270414:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 321 00000100:00100000:2.0:1788574165.270424:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8600229850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+12:6164:x1875455668932736:12345-192.168.204.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788574165.270584:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8600229850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+12:6164:x1875455668932736:12345-192.168.204.51@tcp:501:ll_cfg_requeue.0 Request processed in 161us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574165.270592:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 321 00000100:00100000:1.0:1788574165.283122:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574165.283377:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668932864 00000100:00100000:3.0:1788574165.283390:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668932864 00000100:00100000:3.0:1788574165.283461:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 322 00000100:00100000:3.0:1788574165.283474:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c860022b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+12:6164:x1875455668932864:12345-192.168.204.51@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788574165.283639:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c860022b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+12:6164:x1875455668932864:12345-192.168.204.51@tcp:503:ll_cfg_requeue.0 Request processed in 167us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574165.283716:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 322 00000100:00100000:1.0:1788574165.300218:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574165.300303:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668932992 00000100:00100000:2.0:1788574165.300313:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668932992 00000100:00100000:2.0:1788574165.300360:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 323 00000100:00100000:2.0:1788574165.300369:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5676450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+12:6164:x1875455668932992:12345-192.168.204.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788574165.300386:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574165.300412:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85fa32e400/0x5bf8706fdac8c03a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x652b547cf44d66fa expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574165.300456:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85fa32e400/0x5bf8706fdac8c03a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d66fa expref: 13 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574165.300468:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85fa32e400/0x5bf8706fdac8c03a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d66fa expref: 13 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574165.300477:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85fa32e400, rc 0) 00000100:00100000:2.0:1788574165.300543:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5676450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+13:6164:x1875455668932992:12345-192.168.204.51@tcp:101:ll_cfg_requeue.0 Request processed in 174us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574165.300550:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 323 00000100:00100000:1.0:1788574165.327134:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574165.327700:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668933120 00000100:00100000:3.0:1788574165.327715:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668933120 00000100:00100000:3.0:1788574165.327807:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 324 00000100:00100000:3.0:1788574165.327822:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5674450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+13:6164:x1875455668933120:12345-192.168.204.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788574165.328397:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5674450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+13:6164:x1875455668933120:12345-192.168.204.51@tcp:501:ll_cfg_requeue.0 Request processed in 576us (1274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574165.328422:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 324 00000100:00100000:2.0:1788574165.344067:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574165.352848:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668933248 00000100:00100000:0.0:1788574165.352865:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668933248 00000100:00100000:0.0:1788574165.352936:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 325 00000100:00100000:0.0:1788574165.352947:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5676050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+13:6164:x1875455668933248:12345-192.168.204.51@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788574165.353467:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5676050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+13:6164:x1875455668933248:12345-192.168.204.51@tcp:503:ll_cfg_requeue.0 Request processed in 519us (9408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574165.353477:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 325 10000000:01000000:1.0:1788574165.405836:0:6490:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788574165.405845:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c85f7fb1000 from 7 10000000:01000000:1.0:1788574165.405850:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788574165.405898:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85faea2800/0x5bf8706fdac8c041 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574165.405911:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c85faea2800/0x5bf8706fdac8c041 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574165.405924:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c85faea2800/0x5bf8706fdac8c041 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574165.405953:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681603840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788574165.406035:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574165.406108:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c8b899c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788574165.407240:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681603840 00000100:00100000:3.0:1788574165.407256:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681603840 00000100:00100000:3.0:1788574165.407316:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1788574165.407326:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5674050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+20:6490:x1875455681603840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788574165.407342:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574165.407359:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85c0031e00/0x5bf8706fdac8c048 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8c041 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574165.407399:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85c0031e00/0x5bf8706fdac8c048 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8c041 expref: 21 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574165.407412:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85c0031e00/0x5bf8706fdac8c048 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8c041 expref: 21 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574165.407421:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85c0031e00, rc 0) 00000100:00100000:3.0:1788574165.407482:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5674050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+21:6490:x1875455681603840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 157us (1446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574165.407488:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1788574165.407762:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681603840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788574165.407782:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c85faea2800/0x5bf8706fdac8c041 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8c048 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574165.407793:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c85faea2800/0x5bf8706fdac8c041 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8c048 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574165.407868:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681603968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788574165.407901:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574165.407940:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c8b899c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788574165.410142:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681603968 00000100:00100000:3.0:1788574165.410155:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681603968 00000100:00100000:3.0:1788574165.410229:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1788574165.410238:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5677850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+21:6490:x1875455681603968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788574165.410392:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5677850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+21:6490:x1875455681603968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 155us (2490us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574165.410400:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1788574165.410898:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681603968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788574165.410957:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681604096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788574165.411030:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574165.411078:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c8b899c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788574165.411333:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681604096 00000100:00100000:0.0:1788574165.411339:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681604096 00000100:00100000:0.0:1788574165.411376:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1788574165.411396:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5675050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+21:6490:x1875455681604096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788574165.411486:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5675050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+21:6490:x1875455681604096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 92us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574165.411494:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1788574165.411634:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681604096:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788574165.424054:0:13198:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788574165.426249:0:6490:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788574165.426286:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788574165.426299:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85faea2800/0x5bf8706fdac8c041 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8c048 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574165.426310:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c85faea2800/0x5bf8706fdac8c041 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8c048 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788574165.426322:0:6490:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788574165.426324:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c85fad3f000 from 7 10000000:01000000:1.0:1788574165.426327:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788574165.426394:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85faea3800/0x5bf8706fdac8c04f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574165.426403:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c85faea3800/0x5bf8706fdac8c04f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574165.426414:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c85faea3800/0x5bf8706fdac8c04f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574165.426438:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681604224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788574165.426511:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574165.426562:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c86019836c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788574165.426947:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681604224 00000100:00100000:2.0:1788574165.426957:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681604224 00000100:00100000:2.0:1788574165.427018:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1788574165.427028:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5675c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+21:6490:x1875455681604224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788574165.427041:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574165.427054:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85fa32f000/0x5bf8706fdac8c056 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8c04f expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574165.427078:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85fa32f000/0x5bf8706fdac8c056 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8c04f expref: 22 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574165.427089:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85fa32f000/0x5bf8706fdac8c056 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8c04f expref: 22 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574165.427097:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85fa32f000, rc 0) 00000100:00100000:2.0:1788574165.427156:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5675c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+22:6490:x1875455681604224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574165.427162:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:1.0:1788574165.427395:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681604224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788574165.427412:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c85faea3800/0x5bf8706fdac8c04f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8c056 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574165.427422:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c85faea3800/0x5bf8706fdac8c04f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8c056 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574165.427486:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681604352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788574165.427514:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574165.427584:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c86019836c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788574165.434087:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681604352 00000100:00100000:0.0:1788574165.434102:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681604352 00000100:00100000:1.0:1788574165.434243:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1788574165.434254:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5675450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+22:6490:x1875455681604352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788574165.434421:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5675450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+22:6490:x1875455681604352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 168us (6905us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574165.434429:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:0.0:1788574165.434630:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681604352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788574165.434695:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c34ffb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681604480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788574165.434756:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574165.434799:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c26bd000 going to sleep for 11 seconds 00000100:00100000:2.0:1788574165.434842:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681604480 00000100:00100000:2.0:1788574165.434847:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681604480 00000100:00100000:2.0:1788574165.434882:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1788574165.434889:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5677050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+22:6490:x1875455681604480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788574165.434986:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5677050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+22:6490:x1875455681604480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 89us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574165.434993:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:0.0:1788574165.435238:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c34ffb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681604480:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788574165.436392:0:13200:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788574165.436596:0:6490:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788574165.436630:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788574165.436652:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85faea3800/0x5bf8706fdac8c04f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8c056 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574165.436665:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c85faea3800/0x5bf8706fdac8c04f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8c056 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788574165.436675:0:6490:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788574165.436678:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c85fa390800 from 7 10000000:01000000:1.0:1788574165.436681:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788574165.436711:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85faea2c00/0x5bf8706fdac8c05d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574165.436718:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c85faea2c00/0x5bf8706fdac8c05d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574165.436726:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c85faea2c00/0x5bf8706fdac8c05d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574165.436758:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681604608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788574165.436808:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574165.436851:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8601842840 going to sleep for 11 seconds 00000100:00100000:0.0:1788574165.437772:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681604608 00000100:00100000:0.0:1788574165.437780:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681604608 00000100:00100000:0.0:1788574165.437831:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1788574165.437839:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5676850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+22:6490:x1875455681604608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788574165.437854:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574165.437867:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85c152e600/0x5bf8706fdac8c064 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8c05d expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574165.437904:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85c152e600/0x5bf8706fdac8c064 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8c05d expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574165.437915:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85c152e600/0x5bf8706fdac8c064 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8c05d expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574165.437924:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85c152e600, rc 0) 00000100:00100000:1.0:1788574165.438091:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681604608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788574165.438107:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c85faea2c00/0x5bf8706fdac8c05d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8c064 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574165.438116:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c85faea2c00/0x5bf8706fdac8c05d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8c064 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574165.438176:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681604736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788574165.438232:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574165.438258:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8601842840 going to sleep for 11 seconds 00000100:00100000:1.0:1788574165.438271:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681604736 00000100:00100000:1.0:1788574165.438275:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681604736 00000100:00100000:1.0:1788574165.438293:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1788574165.438299:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5675850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:6490:x1875455681604736:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788574165.438397:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5675850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:6490:x1875455681604736:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 97us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574165.438404:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1788574165.438438:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681604736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788574165.438463:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681604864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788574165.438503:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574165.438517:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8601842840 going to sleep for 11 seconds 00000100:00100000:1.0:1788574165.438526:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681604864 00000100:00100000:1.0:1788574165.438530:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681604864 00000100:00100000:1.0:1788574165.438545:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1788574165.438551:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5677450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:6490:x1875455681604864:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788574165.438623:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5677450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:6490:x1875455681604864:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 71us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574165.438630:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:0.0:1788574165.439080:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5676850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+23:6490:x1875455681604608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (1169us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574165.439088:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1788574165.439305:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681604864:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788574165.442132:0:13201:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788574165.447330:0:6490:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788574165.447370:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788574165.447383:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85faea2c00/0x5bf8706fdac8c05d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8c064 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574165.447396:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c85faea2c00/0x5bf8706fdac8c05d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8c064 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788574165.451813:0:6490:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788574165.451831:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c85c2bfb800 from 7 10000000:01000000:3.0:1788574165.451836:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788574165.451879:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85c0030200/0x5bf8706fdac8c06b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574165.451892:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c85c0030200/0x5bf8706fdac8c06b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574165.451903:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c85c0030200/0x5bf8706fdac8c06b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574165.451929:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681604992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788574165.452063:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574165.452155:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c357f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788574165.455834:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681604992 00000100:00100000:0.0:1788574165.455850:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681604992 00000100:00100000:0.0:1788574165.455912:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:0.0:1788574165.455922:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5676c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+23:6490:x1875455681604992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788574165.455939:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574165.455958:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85c152ee00/0x5bf8706fdac8c072 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8c06b expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574165.456014:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85c152ee00/0x5bf8706fdac8c072 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8c06b expref: 24 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574165.456026:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85c152ee00/0x5bf8706fdac8c072 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8c06b expref: 24 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574165.456035:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85c152ee00, rc 0) 00000100:00100000:0.0:1788574165.456108:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5676c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:6490:x1875455681604992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 188us (4046us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574165.456115:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:3.0:1788574165.456301:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681604992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788574165.456319:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c85c0030200/0x5bf8706fdac8c06b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8c072 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574165.456328:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c85c0030200/0x5bf8706fdac8c06b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8c072 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574165.456396:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681605120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788574165.456432:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574165.456467:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c357f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788574165.456552:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681605120 00000100:00100000:0.0:1788574165.456557:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681605120 00000100:00100000:0.0:1788574165.456581:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1788574165.456587:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5674c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:6490:x1875455681605120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788574165.456829:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5674c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:6490:x1875455681605120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 240us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574165.456836:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:3.0:1788574165.456913:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681605120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788574165.456941:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681605248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788574165.456987:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574165.457005:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c357f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788574165.457096:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681605248 00000100:00100000:0.0:1788574165.457100:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681605248 00000100:00100000:0.0:1788574165.457127:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:0.0:1788574165.457133:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5674850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:6490:x1875455681605248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788574165.457217:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5674850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:6490:x1875455681605248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574165.457223:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:3.0:1788574165.457488:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681605248:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788574165.458962:0:13205:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788574165.462864:0:6490:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788574165.462903:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788574165.462925:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85c0030200/0x5bf8706fdac8c06b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8c072 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574165.462937:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c85c0030200/0x5bf8706fdac8c06b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8c072 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574165.651326:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574166.678336:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574167.702260:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681605376:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788574167.702378:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574167.702527:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681605376 00000100:00100000:3.0:1788574167.702537:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681605376 00000100:00100000:3.0:1788574167.702615:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788574167.702625:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c34ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681605376:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788574167.702662:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788574167.702733:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c34ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681605376:12345-0@lo:41:osp-pre-0-1.0 Request processed in 110us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574167.702741:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788574167.702929:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681605376:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788574167.702974:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788574167.875664:0:13360:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg451-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788574168.723387:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574169.236518:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c34fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681605504:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788574169.236588:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574169.236689:0:7533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681605504 00000100:00100000:0.0:1788574169.236697:0:7533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681605504 00000100:00100000:0.0:1788574169.236755:0:7533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788574169.236763:0:7533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c34fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681605504:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788574169.236805:0:7533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788574169.236899:0:7533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c34fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681605504:12345-0@lo:41:osp-pre-1-0.0 Request processed in 135us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574169.236906:0:7533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788574169.236967:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c34fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681605504:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788574169.238708:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788574169.238734:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681605632:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788574169.238839:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574169.239455:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681605632 00000100:00100000:0.0:1788574169.239463:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681605632 00000100:00100000:0.0:1788574169.239545:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788574169.239556:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c335c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681605632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788574169.239606:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788574169.239684:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c335c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681605632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 132us (847us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574169.239692:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00010000:00080000:0.0:1788574169.239914:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c335ce00 x1875455681605632/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574185 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574169.239933:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681605632:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788574169.240010:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788574169.240630:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788574169.240644:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681605760:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788574169.240698:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574169.242077:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681605760 00000100:00100000:0.0:1788574169.242089:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681605760 00000100:00100000:0.0:1788574169.242461:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788574169.242471:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681605760:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788574169.242493:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788574169.242559:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681605760:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (1860us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574169.242566:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00010000:00080000:0.0:1788574169.242610:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c335f100 x1875455681605760/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574185 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574169.242629:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681605760:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788574169.242782:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788574169.693478:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574169.693522:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574169.693558:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574169.693581:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574169.693600:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574169.693627:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668933376 00000100:00100000:0.0:1788574169.693636:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668933376 00000100:00100000:0.0:1788574169.693695:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 338 00000100:00100000:0.0:1788574169.693705:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5677c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+13:2396:x1875455668933376:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788574169.693859:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668933504 00000100:00100000:1.0:1788574169.693864:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668933504 00000100:00100000:1.0:1788574169.693902:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668933760 00000100:00100000:1.0:1788574169.693905:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668933760 00000100:00100000:1.0:1788574169.693918:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668933632 00000100:00100000:1.0:1788574169.693921:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668933632 00000100:00100000:1.0:1788574169.693933:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668933888 00000100:00100000:1.0:1788574169.693935:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668933888 00000100:00100000:1.0:1788574169.693948:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 216 00000100:00100000:1.0:1788574169.693954:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c34fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+6:2396:x1875455668933504:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1788574169.694010:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5677c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+13:2396:x1875455668933376:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 305us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574169.694018:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 338 00000100:00100000:0.0:1788574169.694052:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 217 00000100:00100000:0.0:1788574169.694059:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e56c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2396:x1875455668933760:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1788574169.694401:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 218 00000100:00100000:3.0:1788574169.694413:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c2334700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+5:2396:x1875455668933632:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788574169.696910:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c34fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+6:2396:x1875455668933504:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 2944us (3432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574169.696926:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 216 00000100:00100000:1.0:1788574169.696965:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 219 00000100:00100000:1.0:1788574169.696980:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c2336680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2396:x1875455668933888:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788574169.697043:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c2336680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2396:x1875455668933888:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 70us (3442us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574169.697049:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 219 00000100:00080000:1.0:1788574169.697076:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788574169.697081:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788574169.699710:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e56c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2396:x1875455668933760:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 5635us (6171us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574169.699726:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 217 00000100:00100000:3.0:1788574169.700281:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c2334700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+5:2396:x1875455668933632:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 5859us (6686us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574169.700291:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 218 00010000:00010000:0.0:1788574169.747946:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574170.259450:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788574170.259475:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fa0e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681605888:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788574170.259551:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788574170.259557:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574170.259563:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fa0e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681606016:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788574170.259597:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574170.259666:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681605888 00000100:00100000:1.0:1788574170.259674:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681605888 00000100:00100000:1.0:1788574170.259716:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681606016 00000100:00100000:1.0:1788574170.259719:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681606016 00000100:00100000:1.0:1788574170.259735:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788574170.259743:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c2335f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681605888:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788574170.259766:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:69505170-06bc-41d1-9626-ab1a3c7f32a0:3617:1875455681606144:0@lo:400:kworker.0 00002000:00000024:1.0:1788574170.259771:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788574170.259799:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574170.259815:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c2335f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681605888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574170.259822:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681606656:0@lo:400:kworker.0 00000100:00100000:1.0:1788574170.259823:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788574170.259840:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788574170.259843:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574170.259860:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681607168:0@lo:400:kworker.0 00000100:00100000:1.0:1788574170.259861:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c335f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681606016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788574170.259871:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788574170.259895:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c335f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681606016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 36us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574170.259895:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574170.259901:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788574170.259913:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00080000:1.0:1788574170.259915:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788574170.259918:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875455681606272:0@lo:400:kworker.0 00000100:00100000:0.0:1788574170.259954:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574170.259978:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1875455681606784:0@lo:400:kworker.0 00000100:00100000:0.0:1788574170.259999:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574170.260013:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3723b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3617:1875455681607296:0@lo:400:kworker.0 00000100:00100000:0.0:1788574170.260040:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574170.260068:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681606656 00000100:00100000:0.0:1788574170.260072:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681606656 00000100:00100000:0.0:1788574170.260099:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788574170.260105:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8334380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681606656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574170.260141:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8334380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681606656:12345-0@lo:400:kworker.0 Request processed in 36us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574170.260147:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788574170.260170:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875455681606528:0@lo:400:kworker.0 00000100:00100000:0.0:1788574170.260210:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574170.260227:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681606144 00000100:00100000:0.0:1788574170.260227:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681607040:0@lo:400:kworker.0 00000100:00100000:2.0:1788574170.260231:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681606144 00000100:00100000:0.0:1788574170.260247:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574170.260259:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1788574170.260265:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5673850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:3617:x1875455681606144:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1788574170.260276:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85fa0e4700 x1875455681605888/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574186 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574170.260294:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5673850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:3617:x1875455681606144:12345-0@lo:400:kworker.0 Request processed in 30us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574170.260295:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fa0e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681605888:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788574170.260300:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:0.0:1788574170.260311:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788574170.260316:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681606400:0@lo:400:kworker.0 00000100:00100000:2.0:1788574170.260332:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681607168 00000100:00100000:2.0:1788574170.260335:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681607168 00000100:00100000:0.0:1788574170.260338:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574170.260353:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3620:1875455681606912:0@lo:400:kworker.0 00000100:00100000:2.0:1788574170.260356:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681607040 00000100:00100000:2.0:1788574170.260358:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681607040 00000100:00100000:0.0:1788574170.260372:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574170.260375:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788574170.260381:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8337800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681607168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574170.260385:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8337480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3620:1875455681607424:0@lo:400:kworker.0 00000100:00100000:0.0:1788574170.260403:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574170.260408:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8337800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681607168:12345-0@lo:400:kworker.0 Request processed in 28us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574170.260414:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788574170.260420:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681606272 00000100:00100000:0.0:1788574170.260423:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681606272 00000100:00100000:2.0:1788574170.260432:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788574170.260437:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8334e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681607040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574170.260439:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681606784 00000100:00100000:0.0:1788574170.260447:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681606784 00000100:00100000:0.0:1788574170.260466:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681607296 00000100:00100000:2.0:1788574170.260468:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8334e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681607040:12345-0@lo:400:kworker.0 Request processed in 31us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574170.260469:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681607296 00000100:00100000:2.0:1788574170.260474:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788574170.260479:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681606528 00000100:00100000:0.0:1788574170.260482:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681606528 00000100:00100000:0.0:1788574170.260491:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681606912 00000100:00100000:0.0:1788574170.260494:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681606912 00000100:00100000:2.0:1788574170.260504:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681607424 00000100:00100000:2.0:1788574170.260507:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681607424 00000100:00100000:0.0:1788574170.260507:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1788574170.260512:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8334a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875455681606272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574170.260522:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1788574170.260527:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8334000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875455681606784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574170.260541:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8334a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875455681606272:12345-0@lo:400:kworker.0 Request processed in 28us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574170.260547:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1788574170.260550:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8334000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875455681606784:12345-0@lo:400:kworker.0 Request processed in 23us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574170.260555:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1788574170.260558:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1788574170.260563:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1788574170.260564:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8335c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875455681607296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574170.260567:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8334700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875455681606528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574170.260587:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8334700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875455681606528:12345-0@lo:400:kworker.0 Request processed in 19us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574170.260587:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8335c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875455681607296:12345-0@lo:400:kworker.0 Request processed in 23us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574170.260593:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1788574170.264115:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1788574170.264243:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00010000:00080000:3.0:1788574170.264246:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85fa0e4380 x1875455681606016/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574186 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574170.264260:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8336300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875455681606912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574170.264269:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fa0e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681606016:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788574170.264783:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8336300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875455681606912:12345-0@lo:400:kworker.0 Request processed in 529us (4407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574170.264791:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1788574170.264807:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1788574170.264814:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8336d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875455681607424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574170.264843:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8336d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875455681607424:12345-0@lo:400:kworker.0 Request processed in 30us (4439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574170.264849:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1788574170.265662:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681606400 00000100:00100000:0.0:1788574170.265673:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681606400 00000100:00100000:0.0:1788574170.265715:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788574170.265722:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8336680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681606400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574170.265770:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8336680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681606400:12345-0@lo:400:kworker.0 Request processed in 48us (5431us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574170.265777:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788574170.265818:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875455681606272:0@lo:400:kworker.0 00000100:00100000:0.0:1788574170.265832:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1875455681606784:0@lo:400:kworker.0 00000100:00100000:0.0:1788574170.265845:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3723b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3617:1875455681607296:0@lo:400:kworker.0 00000100:00100000:0.0:1788574170.265858:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:69505170-06bc-41d1-9626-ab1a3c7f32a0:3617:1875455681606144:0@lo:400:kworker.0 00000100:00100000:0.0:1788574170.265869:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681606656:0@lo:400:kworker.0 00010000:00080000:0.0:1788574170.265896:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3c2dc00 x1875455681607168/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574186 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574170.265907:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681607168:0@lo:400:kworker.0 00000100:00080000:1.0:1788574170.265970:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788574170.265977:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788574170.268505:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681606400:0@lo:400:kworker.0 00010000:00080000:0.0:1788574170.268529:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3c2e680 x1875455681606912/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574186 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574170.268541:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3620:1875455681606912:0@lo:400:kworker.0 00010000:00080000:0.0:1788574170.268554:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85c8337480 x1875455681607424/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574186 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574170.268562:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8337480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3620:1875455681607424:0@lo:400:kworker.0 00000100:00100000:0.0:1788574170.268599:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875455681606528:0@lo:400:kworker.0 00010000:00080000:0.0:1788574170.268610:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3c2ce00 x1875455681607040/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574186 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574170.268618:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681607040:0@lo:400:kworker.0 00010000:00010000:3.0:1788574170.771440:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574171.803686:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574172.820857:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681607552:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788574172.820932:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574172.821008:0:7533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681607552 00000100:00100000:3.0:1788574172.821016:0:7533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681607552 00000100:00100000:3.0:1788574172.821060:0:7533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788574172.821070:0:7533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3727800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681607552:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788574172.821116:0:7533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788574172.821244:0:7533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3727800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681607552:12345-0@lo:41:osp-pre-0-1.0 Request processed in 174us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574172.821252:0:7533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788574172.821298:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681607552:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788574172.826525:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574173.843559:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574174.355616:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681607680:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788574174.355689:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574174.355772:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788574174.355779:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681607808:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788574174.355831:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574174.355874:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681607808 00000100:00100000:2.0:1788574174.355881:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681607808 00000100:00100000:2.0:1788574174.355937:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788574174.355955:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa0e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681607808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788574174.355986:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788574174.356030:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa0e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681607808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574174.356038:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:2.0:1788574174.356071:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788574174.356101:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c1be2d80 x1875455681607808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574190 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574174.356119:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681607808:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788574174.356257:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681607680 00000100:00100000:1.0:1788574174.356262:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681607680 00000100:00100000:1.0:1788574174.356300:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788574174.356307:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa0e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681607680:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788574174.356328:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788574174.356374:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa0e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681607680:12345-0@lo:41:osp-pre-1-0.0 Request processed in 68us (685us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574174.356381:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788574174.356727:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681607680:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788574174.356891:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788574174.356902:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681607936:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788574174.356934:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574174.357005:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681607936 00000100:00100000:2.0:1788574174.357009:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681607936 00000100:00100000:2.0:1788574174.357060:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788574174.357067:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681607936:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788574174.357078:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788574174.357119:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681607936:12345-0@lo:13:osp-pre-0-1.0 Request processed in 53us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574174.357125:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00010000:00080000:2.0:1788574174.357150:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c335ce00 x1875455681607936/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574190 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574174.357163:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681607936:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788574174.358141:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788574174.791703:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574174.791748:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574174.791779:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574174.791794:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574174.791815:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574174.791884:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668934272 00000100:00100000:2.0:1788574174.791895:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668934272 00000100:00100000:2.0:1788574174.791961:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668934528 00000100:00100000:2.0:1788574174.791965:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668934528 00000100:00100000:2.0:1788574174.791997:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668934144 00000100:00100000:2.0:1788574174.792002:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668934144 00000100:00100000:2.0:1788574174.792014:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668934400 00000100:00100000:2.0:1788574174.792016:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668934400 00000100:00100000:2.0:1788574174.792032:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 226 00000100:00100000:2.0:1788574174.792041:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c335ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+5:2396:x1875455668934272:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1788574174.792127:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c335ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+5:2396:x1875455668934272:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 86us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574174.792136:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 226 00000100:00100000:2.0:1788574174.792153:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 227 00000100:00100000:2.0:1788574174.792159:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa32aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2396:x1875455668934528:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1788574174.792183:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa32aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2396:x1875455668934528:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 25us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574174.792215:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 227 00000100:00100000:2.0:1788574174.792227:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 228 00000100:00100000:2.0:1788574174.792234:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa329880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+6:2396:x1875455668934144:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1788574174.792258:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa329880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+6:2396:x1875455668934144:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 25us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574174.792264:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 228 00000100:00100000:2.0:1788574174.792275:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 229 00000100:00100000:2.0:1788574174.792281:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa329500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2396:x1875455668934400:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1788574174.792302:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa329500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2396:x1875455668934400:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 22us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574174.792308:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 229 00000100:00100000:1.0:1788574174.792536:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668934016 00000100:00100000:1.0:1788574174.792541:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668934016 00000100:00100000:1.0:1788574174.792589:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 340 00000100:00100000:1.0:1788574174.792597:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5672050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+13:2396:x1875455668934016:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788574174.792629:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5672050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+13:2396:x1875455668934016:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 35us (937us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574174.792636:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 340 00000100:00080000:3.0:1788574174.792774:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788574174.792778:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788574174.869866:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788574175.155481:0:13509:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 22:09:32 (1788574172) === 00000100:00100000:0.0:1788574175.381673:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788574175.381709:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8337480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681608064:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788574175.381782:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574175.381860:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681608064 00000100:00100000:0.0:1788574175.381868:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681608064 00000100:00100000:0.0:1788574175.381922:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788574175.381932:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8335f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681608064:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788574175.381963:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788574175.382010:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8335f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681608064:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574175.382018:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00010000:00080000:0.0:1788574175.382058:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85c8337480 x1875455681608064/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574191 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574175.382076:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8337480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681608064:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1788574175.382286:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788574175.382492:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:69505170-06bc-41d1-9626-ab1a3c7f32a0:3617:1875455681608192:0@lo:400:kworker.0 00000100:00100000:1.0:1788574175.382528:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574175.382569:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681608704:0@lo:400:kworker.0 00000100:00100000:1.0:1788574175.382601:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574175.382619:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681609216:0@lo:400:kworker.0 00000100:00100000:1.0:1788574175.382637:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574175.382656:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788574175.382661:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875455681608320:0@lo:400:kworker.0 00000100:00100000:1.0:1788574175.382697:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574175.382714:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1875455681608832:0@lo:400:kworker.0 00000100:00100000:1.0:1788574175.382733:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574175.382750:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3617:1875455681609344:0@lo:400:kworker.0 00000100:00100000:1.0:1788574175.382766:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574175.382792:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875455681608576:0@lo:400:kworker.0 00000100:00100000:1.0:1788574175.382814:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574175.382830:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681609088:0@lo:400:kworker.0 00000100:00100000:1.0:1788574175.382855:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574175.382872:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681609600:0@lo:400:kworker.0 00000100:00100000:1.0:1788574175.382890:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574175.382927:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788574175.382933:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681608448:0@lo:400:kworker.0 00000100:00100000:1.0:1788574175.382954:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574175.382969:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3620:1875455681608960:0@lo:400:kworker.0 00000100:00100000:1.0:1788574175.382993:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574175.383006:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3620:1875455681609472:0@lo:400:kworker.0 00000100:00100000:1.0:1788574175.383023:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574175.383045:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681608192 00000100:00100000:1.0:1788574175.383052:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681608192 00000100:00100000:1.0:1788574175.383101:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1788574175.383109:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5671050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:3617:x1875455681608192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574175.383149:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5671050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:3617:x1875455681608192:12345-0@lo:400:kworker.0 Request processed in 41us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574175.383155:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1788574175.383183:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681608704 00000100:00100000:1.0:1788574175.383211:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681608704 00000100:00100000:1.0:1788574175.383236:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681608448 00000100:00100000:1.0:1788574175.383239:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681608448 00000100:00100000:1.0:1788574175.383254:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788574175.383260:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681608704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574175.383294:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681608704:12345-0@lo:400:kworker.0 Request processed in 34us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574175.383301:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788574175.383311:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788574175.383316:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681608448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574175.383345:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681608448:12345-0@lo:400:kworker.0 Request processed in 29us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574175.383359:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788574175.383378:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681609216 00000100:00100000:1.0:1788574175.383382:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681609216 00000100:00100000:1.0:1788574175.383403:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681609088 00000100:00100000:1.0:1788574175.383405:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681609088 00000100:00100000:1.0:1788574175.383415:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681609600 00000100:00100000:1.0:1788574175.383417:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681609600 00000100:00100000:1.0:1788574175.383435:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788574175.383440:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681609216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574175.383472:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681609216:12345-0@lo:400:kworker.0 Request processed in 31us (833us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574175.383478:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788574175.383489:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788574175.383495:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681609088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574175.383520:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681609088:12345-0@lo:400:kworker.0 Request processed in 26us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574175.383525:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788574175.383535:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788574175.383554:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681609600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574175.383596:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681609600:12345-0@lo:400:kworker.0 Request processed in 55us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574175.383602:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788574175.383625:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681608320 00000100:00100000:1.0:1788574175.383628:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681608320 00000100:00100000:1.0:1788574175.383646:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681608832 00000100:00100000:1.0:1788574175.383649:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681608832 00000100:00100000:1.0:1788574175.383660:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681609344 00000100:00100000:1.0:1788574175.383668:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681609344 00000100:00100000:1.0:1788574175.383682:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681608576 00000100:00100000:1.0:1788574175.383685:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681608576 00000100:00100000:1.0:1788574175.383694:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681608960 00000100:00100000:1.0:1788574175.383696:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681608960 00000100:00100000:1.0:1788574175.383706:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681609472 00000100:00100000:1.0:1788574175.383708:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681609472 00000100:00100000:1.0:1788574175.383719:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1788574175.383724:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875455681608320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574175.383753:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875455681608320:12345-0@lo:400:kworker.0 Request processed in 30us (1057us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574175.383758:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1788574175.383768:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1788574175.383773:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875455681608832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574175.383795:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875455681608832:12345-0@lo:400:kworker.0 Request processed in 23us (1061us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574175.383801:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1788574175.383809:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1788574175.383815:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875455681609344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574175.383836:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875455681609344:12345-0@lo:400:kworker.0 Request processed in 22us (1069us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574175.383841:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1788574175.383850:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1788574175.383856:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875455681608576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574175.383881:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875455681608576:12345-0@lo:400:kworker.0 Request processed in 25us (1066us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574175.383886:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1788574175.383907:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1788574175.383913:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875455681608960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574175.383939:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875455681608960:12345-0@lo:400:kworker.0 Request processed in 27us (945us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574175.383945:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1788574175.383956:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1788574175.383961:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875455681609472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574175.383984:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875455681609472:12345-0@lo:400:kworker.0 Request processed in 24us (961us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574175.383989:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1788574175.384041:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788574175.384052:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8337480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681609728:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788574175.384079:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574175.384131:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681608448:0@lo:400:kworker.0 00010000:00080000:1.0:1788574175.384143:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c1be3100 x1875455681608960/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574191 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574175.384152:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3620:1875455681608960:0@lo:400:kworker.0 00010000:00080000:1.0:1788574175.384163:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85faf3e680 x1875455681609472/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574191 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574175.384171:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3620:1875455681609472:0@lo:400:kworker.0 00000100:00100000:1.0:1788574175.384180:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875455681608576:0@lo:400:kworker.0 00010000:00080000:1.0:1788574175.384207:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85faf3fb80 x1875455681609088/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574191 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574175.384215:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681609088:0@lo:400:kworker.0 00000100:00100000:0.0:1788574175.384217:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681609728 00000100:00100000:0.0:1788574175.384221:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681609728 00010000:00080000:1.0:1788574175.384234:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85faf3e300 x1875455681609600/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574191 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574175.384242:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681609600:0@lo:400:kworker.0 00000100:00100000:0.0:1788574175.384246:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788574175.384251:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681609728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788574175.384264:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788574175.384283:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875455681608320:0@lo:400:kworker.0 00000100:00100000:1.0:1788574175.384294:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1875455681608832:0@lo:400:kworker.0 00000100:00100000:0.0:1788574175.384300:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681609728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574175.384303:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3617:1875455681609344:0@lo:400:kworker.0 00000100:00100000:1.0:1788574175.384311:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:69505170-06bc-41d1-9626-ab1a3c7f32a0:3617:1875455681608192:0@lo:400:kworker.0 00000100:00100000:0.0:1788574175.384312:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788574175.384319:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681608704:0@lo:400:kworker.0 00010000:00080000:1.0:1788574175.384329:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85faf3ea00 x1875455681609216/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574191 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1788574175.384335:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85c8337480 x1875455681609728/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574191 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574175.384337:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681609216:0@lo:400:kworker.0 00000100:00100000:0.0:1788574175.384347:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8337480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681609728:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788574175.384674:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788574175.384690:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788574175.384692:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788574175.539380:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574175.539445:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574175.539614:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668934784 00000100:00100000:3.0:1788574175.539626:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668934784 00000100:00100000:3.0:1788574175.539688:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 2 00000100:00100000:3.0:1788574175.539698:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:659467ff-94af-418e-92fe-11e4323a48aa+6:10499:x1875455668934784:12345-192.168.204.51@tcp:700:mkdir.0 00000100:00100000:3.0:1788574175.539805:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:659467ff-94af-418e-92fe-11e4323a48aa+6:10499:x1875455668934784:12345-192.168.204.51@tcp:700:mkdir.0 Request processed in 108us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574175.539813:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 2 00000100:00100000:1.0:1788574175.539924:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668934656 00000100:00100000:1.0:1788574175.539928:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668934656 00000100:00100000:1.0:1788574175.539963:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 22 00000100:00100000:1.0:1788574175.539969:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+6:2395:x1875455668934656:12345-192.168.204.51@tcp:41:mkdir.0 00000004:00000024:1.0:1788574175.539990:0:6494:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788574175.540040:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+6:2395:x1875455668934656:12345-192.168.204.51@tcp:41:mkdir.0 Request processed in 71us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574175.540046:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 22 00000100:00100000:1.0:1788574175.545559:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574175.545702:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668935040 00000100:00100000:2.0:1788574175.545713:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668935040 00000100:00100000:2.0:1788574175.545784:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 23 00000100:00100000:2.0:1788574175.545794:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+6:10499:x1875455668935040:12345-192.168.204.51@tcp:36:mkdir.0 00010000:00010000:2.0:1788574175.545852:0:6493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788574175.545929:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217fa00/0x5bf8706fdac8bf1b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d666e expref: 6 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574175.545951:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c85c6b83700) 00010000:00010000:2.0:1788574175.545961:0:6493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788574175.546053:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f800/0x5bf8706fdac8c079 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574175.546066:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f800/0x5bf8706fdac8c079 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574175.546075:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f800/0x5bf8706fdac8c079 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574175.546087:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8c080 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574175.546094:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8c080 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574175.546101:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8c080 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574175.546858:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f200/0x5bf8706fdac8c087 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574175.546877:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f200/0x5bf8706fdac8c087 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574175.546885:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f200/0x5bf8706fdac8c087 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788574175.546900:0:6493:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a8ae1c0f reply state 000000003e643940 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f200/0x5bf8706fdac8c087 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574175.546910:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f200/0x5bf8706fdac8c087 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574175.546916:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9c85d20f2000) 00010000:00010000:2.0:1788574175.546919:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788574175.546923:0:6493:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788574175.546927:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788574175.546933:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f800/0x5bf8706fdac8c079 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574175.546940:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f800/0x5bf8706fdac8c079 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574175.546946:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f800/0x5bf8706fdac8c079 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574175.546952:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32f800 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:2.0:1788574175.546956:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f800/0x5bf8706fdac8c079 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574175.546964:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f800/0x5bf8706fdac8c079 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574175.546979:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c85d20f2500) 00010000:00010000:2.0:1788574175.546981:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788574175.546985:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f800/0x5bf8706fdac8c079 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574175.546991:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f800/0x5bf8706fdac8c079 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788574175.547005:0:6493:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a8ae1c0f reply state 000000003e643940 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8c080 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574175.547012:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8c080 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574175.547017:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9c85d20f2600) 00010000:00010000:2.0:1788574175.547019:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788574175.547021:0:6493:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1788574175.547111:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+7:10499:x1875455668935040:12345-192.168.204.51@tcp:36:mkdir.0 Request processed in 1317us (2719us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788574175.547119:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 23 00000100:00100000:2.0:1788574175.561627:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574175.561788:0:11893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668935168 00000100:00100000:1.0:1788574175.561798:0:11893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668935168 00000100:00100000:1.0:1788574175.561870:0:11893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 24 00000100:00100000:1.0:1788574175.561885:0:11893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffafce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:659467ff-94af-418e-92fe-11e4323a48aa+7:10500:x1875455668935168:12345-192.168.204.51@tcp:101:chmod.0 00010000:00010000:1.0:1788574175.561908:0:11893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574175.561931:0:11893:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c08e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6701 expref: -99 pid: 11893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.561998:0:11893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c095 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.562012:0:11893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c095 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.562023:0:11893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c095 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788574175.562073:0:11893:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788574175.562078:0:11893:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788574175.562115:0:11893:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c095 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.562142:0:11893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c08e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6701 expref: 9 pid: 11893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.562162:0:11893:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c095 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6701 expref: 8 pid: 11893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.562171:0:11893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c84c34bba00) 00010000:00010000:1.0:1788574175.562174:0:11893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788574175.562178:0:11893:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85faea2000, rc 0) 00000100:00100000:1.0:1788574175.562504:0:11893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffafce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:659467ff-94af-418e-92fe-11e4323a48aa+8:10500:x1875455668935168:12345-192.168.204.51@tcp:101:chmod.0 Request processed in 620us (885us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574175.562518:0:11893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 24 00000100:00100000:1.0:1788574175.573255:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574175.573393:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668935424 00000100:00100000:0.0:1788574175.573405:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668935424 00000100:00100000:0.0:1788574175.573470:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 25 00000100:00100000:0.0:1788574175.573480:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+8:10500:x1875455668935424:12345-192.168.204.51@tcp:36:chmod.0 00010000:00010000:0.0:1788574175.573546:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574175.573574:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c095 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6701 expref: 8 pid: 11893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574175.573593:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c84c34bba00) 00010000:00010000:0.0:1788574175.573603:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788574175.573630:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8c09c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574175.573643:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8c09c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574175.573652:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8c09c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788574175.573857:0:6492:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a9275782 reply state 00000000ac8d9b93 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8c09c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574175.573871:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8c09c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574175.573885:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c85c6b83400) 00010000:00010000:0.0:1788574175.573888:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788574175.573891:0:6492:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788574175.573898:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788574175.573986:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+9:10500:x1875455668935424:12345-192.168.204.51@tcp:36:chmod.0 Request processed in 507us (741us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1788574175.573994:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 25 00000100:00100000:3.0:1788574175.599525:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574175.599913:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668935552 00000100:00100000:1.0:1788574175.599926:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668935552 00000100:00100000:1.0:1788574175.599994:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 26 00000100:00100000:1.0:1788574175.600005:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa328a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+9:10501:x1875455668935552:12345-192.168.204.51@tcp:101:chown.0 00010000:00010000:1.0:1788574175.600031:0:7439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574175.600590:0:7439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c0a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6708 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.600672:0:7439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8c0aa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.600697:0:7439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8c0aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.600710:0:7439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8c0aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788574175.600759:0:7439:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788574175.600763:0:7439:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788574175.600802:0:7439:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8c0aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.600834:0:7439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c0a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6708 expref: 11 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.600852:0:7439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8c0aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6708 expref: 10 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.600881:0:7439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c85c6b83400) 00010000:00010000:1.0:1788574175.600884:0:7439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788574175.600888:0:7439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85faea2200, rc 0) 00000100:00100000:1.0:1788574175.600966:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa328a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+10:10501:x1875455668935552:12345-192.168.204.51@tcp:101:chown.0 Request processed in 962us (1453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574175.600974:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 26 00000100:00100000:2.0:1788574175.604905:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574175.605909:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668935680 00000100:00100000:1.0:1788574175.605924:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668935680 00000100:00100000:1.0:1788574175.605991:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 27 00000100:00100000:1.0:1788574175.606004:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffafe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+10:10501:x1875455668935680:12345-192.168.204.51@tcp:101:chown.0 00010000:00010000:1.0:1788574175.606294:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574175.606316:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c0b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d670f expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.606386:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c0b8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.606402:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c0b8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.606415:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c0b8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.606427:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3200/0x5bf8706fdac8c0bf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.606434:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3200/0x5bf8706fdac8c0bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.606460:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3200/0x5bf8706fdac8c0bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.606569:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3400/0x5bf8706fdac8c0c6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.606578:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3400/0x5bf8706fdac8c0c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.606584:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3400/0x5bf8706fdac8c0c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788574175.606629:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788574175.606632:0:6494:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788574175.606650:0:6494:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3400/0x5bf8706fdac8c0c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.606663:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c0b8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.606670:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c0b8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.606676:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c0b8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.606682:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85faea2000 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:1.0:1788574175.606687:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c0b8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.606694:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c0b8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.606717:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c85c6b83400) 00010000:00010000:1.0:1788574175.606720:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788574175.606726:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c0b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.606732:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c0b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.606747:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3200/0x5bf8706fdac8c0bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.606754:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3200/0x5bf8706fdac8c0bf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.606760:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3200/0x5bf8706fdac8c0bf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.606765:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85faea3200 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:1.0:1788574175.606767:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3200/0x5bf8706fdac8c0bf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.606773:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3200/0x5bf8706fdac8c0bf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.606780:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9c85d20f2600) 00010000:00010000:1.0:1788574175.606783:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788574175.606786:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3200/0x5bf8706fdac8c0bf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.606792:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3200/0x5bf8706fdac8c0bf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.606838:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c0b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d670f expref: 12 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.606853:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3400/0x5bf8706fdac8c0c6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d670f expref: 11 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.606862:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9c85d20f2000) 00010000:00010000:1.0:1788574175.606864:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788574175.606866:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85faea3400, rc 0) 00000100:00100000:1.0:1788574175.607031:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffafe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+11:10501:x1875455668935680:12345-192.168.204.51@tcp:101:chown.0 Request processed in 1021us (2130us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574175.607048:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 27 00000100:00100000:2.0:1788574175.610501:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574175.610609:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668935808 00000100:00100000:0.0:1788574175.610620:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668935808 00000100:00100000:0.0:1788574175.610686:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 6 00000100:00100000:0.0:1788574175.610696:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffafe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:659467ff-94af-418e-92fe-11e4323a48aa+11:10501:x1875455668935808:12345-192.168.204.51@tcp:900:chown.0 00000100:00100000:0.0:1788574175.610780:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffafe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:659467ff-94af-418e-92fe-11e4323a48aa+11:10501:x1875455668935808:12345-192.168.204.51@tcp:900:chown.0 Request processed in 85us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574175.610788:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 6 00000100:00100000:3.0:1788574175.614007:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574175.614301:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668936064 00000100:00100000:0.0:1788574175.614312:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668936064 00000100:00100000:0.0:1788574175.614380:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 28 00000100:00100000:0.0:1788574175.614392:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa328e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+11:10501:x1875455668936064:12345-192.168.204.51@tcp:36:chown.0 00010000:00010000:0.0:1788574175.614459:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574175.614493:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3400/0x5bf8706fdac8c0c6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d670f expref: 11 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574175.614517:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9c85d20f2000) 00010000:00010000:0.0:1788574175.614523:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788574175.614559:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f600/0x5bf8706fdac8c0cd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574175.614594:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f600/0x5bf8706fdac8c0cd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574175.614604:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f600/0x5bf8706fdac8c0cd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788574175.618750:0:6471:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00010000:00010000:0.0:1788574175.618877:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8c080 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574175.618891:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8c080 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574175.618900:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8c080 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574175.618906:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32e000 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:0.0:1788574175.618912:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8c080 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574175.618921:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8c080 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574175.618936:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9c85d20f2600) 00010000:00010000:0.0:1788574175.618939:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574175.618943:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8c080 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574175.618949:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8c080 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574175.618971:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f200/0x5bf8706fdac8c087 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574175.618986:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f200/0x5bf8706fdac8c087 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574175.618992:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f200/0x5bf8706fdac8c087 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574175.618996:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32f200 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:0.0:1788574175.618999:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f200/0x5bf8706fdac8c087 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574175.619004:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f200/0x5bf8706fdac8c087 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574175.619011:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9c85d20f2000) 00010000:00010000:0.0:1788574175.619013:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574175.619016:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f200/0x5bf8706fdac8c087 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574175.619032:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f200/0x5bf8706fdac8c087 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574175.619050:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8c09c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574175.619056:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8c09c lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574175.619062:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8c09c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574175.619067:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85c152f400 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:0.0:1788574175.619075:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8c09c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574175.619081:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8c09c lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574175.619096:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c85c6b83400) 00010000:00010000:0.0:1788574175.619099:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788574175.619102:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8c09c lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574175.619108:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8c09c lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788574175.619335:0:6492:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008f275b92 reply state 00000000f470863e transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f600/0x5bf8706fdac8c0cd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.619350:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f600/0x5bf8706fdac8c0cd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.619357:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9c85d20f2000) 00010000:00010000:1.0:1788574175.619360:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1788574175.619362:0:6492:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788574175.619377:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:1.0:1788574175.619495:0:6492:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1788574175.619515:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa328e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+7:10501:x1875455668936064:12345-192.168.204.51@tcp:36:chown.0 Request processed in 5122us (5518us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788574175.619524:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 28 00010000:00010000:3.0:1788574175.620443:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f600/0x5bf8706fdac8c0cd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574175.620455:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f600/0x5bf8706fdac8c0cd lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574175.620462:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f600/0x5bf8706fdac8c0cd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574175.620468:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85c152f600 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:3.0:1788574175.620472:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f600/0x5bf8706fdac8c0cd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574175.620480:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f600/0x5bf8706fdac8c0cd lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574175.620494:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9c85d20f2000) 00010000:00010000:3.0:1788574175.620497:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788574175.620500:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f600/0x5bf8706fdac8c0cd lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574175.620505:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f600/0x5bf8706fdac8c0cd lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574175.637948:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574175.638068:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668936192 00000100:00100000:1.0:1788574175.638079:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668936192 00000100:00100000:1.0:1788574175.638169:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 29 00000100:00100000:1.0:1788574175.638180:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffafed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+6:10502:x1875455668936192:12345-192.168.204.51@tcp:101:touch.500 00010000:00010000:1.0:1788574175.638252:0:7439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574175.638277:0:7439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c0d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6716 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788574175.643517:0:7439:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 5179us 00010000:00010000:2.0:1788574175.656163:0:7439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f400/0x5bf8706fdac8c0db lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574175.656223:0:7439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f400/0x5bf8706fdac8c0db lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574175.656250:0:7439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f400/0x5bf8706fdac8c0db lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574175.656268:0:7439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f200/0x5bf8706fdac8c0e2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574175.656275:0:7439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f200/0x5bf8706fdac8c0e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574175.656282:0:7439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f200/0x5bf8706fdac8c0e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574175.656406:0:7439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8c0e9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574175.656414:0:7439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8c0e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574175.656432:0:7439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8c0e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788574175.656461:0:7439:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788574175.656465:0:7439:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788574175.656500:0:7439:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8c0e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574175.656511:0:7439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f400/0x5bf8706fdac8c0db lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574175.656517:0:7439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f400/0x5bf8706fdac8c0db lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574175.656547:0:7439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f400/0x5bf8706fdac8c0db lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574175.656554:0:7439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32f400 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:2.0:1788574175.656558:0:7439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f400/0x5bf8706fdac8c0db lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574175.656566:0:7439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f400/0x5bf8706fdac8c0db lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574175.656577:0:7439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c85c6b83400) 00010000:00010000:2.0:1788574175.656579:0:7439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788574175.656584:0:7439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f400/0x5bf8706fdac8c0db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574175.656590:0:7439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f400/0x5bf8706fdac8c0db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574175.656601:0:7439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f200/0x5bf8706fdac8c0e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574175.656607:0:7439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f200/0x5bf8706fdac8c0e2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574175.656612:0:7439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f200/0x5bf8706fdac8c0e2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574175.656616:0:7439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32f200 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:2.0:1788574175.656619:0:7439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f200/0x5bf8706fdac8c0e2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574175.656634:0:7439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f200/0x5bf8706fdac8c0e2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574175.656641:0:7439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9c85d20f2500) 00010000:00010000:2.0:1788574175.656644:0:7439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788574175.656646:0:7439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f200/0x5bf8706fdac8c0e2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574175.656652:0:7439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f200/0x5bf8706fdac8c0e2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574175.656693:0:7439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c0d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6716 expref: 8 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574175.656708:0:7439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8c0e9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6716 expref: 7 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574175.656715:0:7439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9c85d20f2600) 00010000:00010000:2.0:1788574175.656717:0:7439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788574175.656719:0:7439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85fa32e000, rc 0) 00000100:00100000:2.0:1788574175.656795:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffafed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+7:10502:x1875455668936192:12345-192.168.204.51@tcp:101:touch.500 Request processed in 18616us (18859us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574175.656805:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 29 00000100:00100000:1.0:1788574175.663737:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574175.663818:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668936448 00000100:00100000:3.0:1788574175.663831:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668936448 00000100:00100000:3.0:1788574175.663927:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 30 00000100:00100000:3.0:1788574175.663938:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+7:10502:x1875455668936448:12345-192.168.204.51@tcp:101:touch.500 00010000:00010000:3.0:1788574175.663962:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574175.663984:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c860204b800/0x5bf8706fdac8c0f0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d671d expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574175.664123:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c860204b400/0x5bf8706fdac8c0f7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574175.664140:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c860204b400/0x5bf8706fdac8c0f7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574175.664156:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c860204b400/0x5bf8706fdac8c0f7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574175.664256:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c860204a600/0x5bf8706fdac8c0fe lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574175.664265:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c860204a600/0x5bf8706fdac8c0fe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574175.664273:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c860204a600/0x5bf8706fdac8c0fe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788574175.664847:0:6494:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:3.0:1788574175.665011:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c860204aa00/0x5bf8706fdac8c105 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574175.665022:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c860204aa00/0x5bf8706fdac8c105 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574175.665038:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c860204aa00/0x5bf8706fdac8c105 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574175.665074:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c860204b400/0x5bf8706fdac8c0f7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574175.665081:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c860204b400/0x5bf8706fdac8c0f7 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574175.665163:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c860204b400/0x5bf8706fdac8c0f7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574175.665168:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c860204b400 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:3.0:1788574175.665173:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c860204b400/0x5bf8706fdac8c0f7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574175.665180:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c860204b400/0x5bf8706fdac8c0f7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574175.665332:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9c85d20f2600) 00010000:00010000:3.0:1788574175.665336:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574175.665340:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c860204b400/0x5bf8706fdac8c0f7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574175.665346:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c860204b400/0x5bf8706fdac8c0f7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788574175.665362:0:6494:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001324b55e reply state 00000000dc4ea516 transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff9c860204a600/0x5bf8706fdac8c0fe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574175.665372:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c860204a600/0x5bf8706fdac8c0fe lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574175.665385:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xcdab4b64 (ffff9c85fa2c1a00) 00010000:00010000:3.0:1788574175.665387:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788574175.665391:0:6494:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788574175.665507:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c860204b800/0x5bf8706fdac8c0f0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d671d expref: 10 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574175.665527:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c860204aa00/0x5bf8706fdac8c105 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d671d expref: 9 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574175.665546:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9c85fa28c200) 00010000:00010000:3.0:1788574175.665549:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788574175.665552:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c860204aa00, rc 0) 00000100:00100000:3.0:1788574175.665851:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+10:10502:x1875455668936448:12345-192.168.204.51@tcp:101:touch.500 Request processed in 1913us (2122us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788574175.665860:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 30 00000100:00100000:2.0:1788574175.671576:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574175.671792:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668936704 00000100:00100000:0.0:1788574175.671801:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668936704 00000100:00100000:0.0:1788574175.671895:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 31 00000100:00100000:0.0:1788574175.671906:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffafdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+10:10502:x1875455668936704:12345-192.168.204.51@tcp:36:touch.500 00010000:00010000:0.0:1788574175.671970:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574175.672000:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c860204aa00/0x5bf8706fdac8c105 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d671d expref: 10 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574175.672030:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9c85fa28c200) 00010000:00010000:0.0:1788574175.672048:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788574175.672119:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8c113 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574175.672133:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8c113 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574175.672142:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8c113 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788574175.672302:0:6492:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000eb869379 reply state 00000000fb1661f3 transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8c113 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574175.672315:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8c113 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574175.672321:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9c85c6b83d00) 00010000:00010000:0.0:1788574175.672324:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788574175.672326:0:6492:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788574175.672640:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffafdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+11:10502:x1875455668936704:12345-192.168.204.51@tcp:36:touch.500 Request processed in 735us (1073us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1788574175.672648:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 31 00000100:00100000:2.0:1788574175.676016:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574175.676119:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668936832 00000100:00100000:3.0:1788574175.676130:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668936832 00000100:00100000:3.0:1788574175.676222:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 32 00000100:00100000:3.0:1788574175.676233:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffafd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+11:10502:x1875455668936832:12345-192.168.204.51@tcp:101:touch.500 00010000:00010000:3.0:1788574175.676263:0:7439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574175.676308:0:7439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617200/0x5bf8706fdac8c11a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6724 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574175.676376:0:7439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617200/0x5bf8706fdac8c11a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6724 expref: 12 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574175.676392:0:7439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617200/0x5bf8706fdac8c11a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6724 expref: 12 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574175.676436:0:7439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9c85c6b83d00) 00010000:00010000:3.0:1788574175.676440:0:7439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788574175.676445:0:7439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c84c2617200, rc 0) 00000100:00100000:3.0:1788574175.676498:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffafd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+12:10502:x1875455668936832:12345-192.168.204.51@tcp:101:touch.500 Request processed in 268us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574175.676505:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 32 00000100:00100000:1.0:1788574175.681623:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574175.681704:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668936960 00000100:00100000:2.0:1788574175.681716:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668936960 00000100:00100000:2.0:1788574175.681768:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 24 00000100:00100000:2.0:1788574175.681798:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2392:x1875455668936960:12345-192.168.204.51@tcp:8:touch.500 00010000:00080000:2.0:1788574175.681838:0:8411:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 659467ff-94af-418e-92fe-11e4323a48aa@192.168.204.51@tcp t0 exp 0000000000000000 cur 315 last 0 00000020:00000080:2.0:1788574175.681870:0:8411:0:(genops.c:1385:class_connect()) connect: client 659467ff-94af-418e-92fe-11e4323a48aa, cookie 0x5bf8706fdac8c121 00002000:00100000:2.0:1788574175.681885:0:8411:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 659467ff-94af-418e-92fe-11e4323a48aa/ffff9c85faf2c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788574175.681901:0:8411:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788574175.682000:0:8411:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788574175.682163:0:8411:0:(import.c:65:import_set_state_nolock()) ffff9c85faf2b800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788574175.682511:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:659467ff-94af-418e-92fe-11e4323a48aa+6:2392:x1875455668936960:12345-192.168.204.51@tcp:8:touch.500 Request processed in 711us (896us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574175.682520:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 24 00000100:00100000:2.0:1788574175.685676:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574175.685758:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668937088 00000100:00100000:0.0:1788574175.685770:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668937088 00000100:00100000:0.0:1788574175.685852:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 25 00000100:00100000:0.0:1788574175.685863:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffaff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:659467ff-94af-418e-92fe-11e4323a48aa+6:0:x1875455668937088:12345-192.168.204.51@tcp:2:touch.500 00000100:00080000:3.0:1788574175.686218:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1788574175.695021:0:8404:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00100000:2.0:1788574175.695037:0:8404:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 659467ff-94af-418e-92fe-11e4323a48aa 00000100:00100000:0.0:1788574175.695266:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffaff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:659467ff-94af-418e-92fe-11e4323a48aa+5:0:x1875455668937088:12345-192.168.204.51@tcp:2:touch.500 Request processed in 9398us (9593us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1788574175.695279:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 25 00000100:00100000:2.0:1788574175.703324:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574175.703546:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668937344 00000100:00100000:3.0:1788574175.703562:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668937344 00000100:00100000:3.0:1788574175.703627:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 2 00000100:00100000:3.0:1788574175.703636:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffafd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:659467ff-94af-418e-92fe-11e4323a48aa+12:10502:x1875455668937344:12345-192.168.204.51@tcp:35:touch.500 00000100:00100000:3.0:1788574175.704005:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffafd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:659467ff-94af-418e-92fe-11e4323a48aa+13:10502:x1875455668937344:12345-192.168.204.51@tcp:35:touch.500 Request processed in 369us (702us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788574175.704013:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 2 00000100:00100000:1.0:1788574175.735583:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574175.736482:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668937472 00000100:00100000:3.0:1788574175.736496:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668937472 00000100:00100000:3.0:1788574175.736582:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 33 00000100:00100000:3.0:1788574175.736595:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+13:10503:x1875455668937472:12345-192.168.204.51@tcp:101:rm.0 00010000:00010000:3.0:1788574175.736626:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574175.736650:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617c00/0x5bf8706fdac8c128 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d672b expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574175.736735:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617600/0x5bf8706fdac8c12f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574175.736751:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617600/0x5bf8706fdac8c12f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574175.736781:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617600/0x5bf8706fdac8c12f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788574175.736833:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788574175.736836:0:6494:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788574175.736897:0:6494:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617600/0x5bf8706fdac8c12f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574175.736932:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617c00/0x5bf8706fdac8c128 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d672b expref: 15 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574175.736954:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617600/0x5bf8706fdac8c12f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d672b expref: 14 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574175.736963:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9c85d20f2600) 00010000:00010000:3.0:1788574175.736966:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788574175.736970:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c84c2617600, rc 0) 00000100:00100000:3.0:1788574175.737064:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+14:10503:x1875455668937472:12345-192.168.204.51@tcp:101:rm.0 Request processed in 472us (1494us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574175.737071:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 33 00000100:00100000:3.0:1788574175.742949:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574175.743079:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668937728 00000100:00100000:0.0:1788574175.743099:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668937728 00000100:00100000:0.0:1788574175.743166:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 34 00000100:00100000:0.0:1788574175.743177:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa328700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+14:10503:x1875455668937728:12345-192.168.204.51@tcp:101:rm.0 00010000:00010000:0.0:1788574175.743231:0:7439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574175.743254:0:7439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152e000/0x5bf8706fdac8c136 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6732 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788574175.743389:0:7439:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788574175.743772:0:7439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152e000/0x5bf8706fdac8c136 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6732 expref: 16 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574175.743789:0:7439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c85c6b83400) 00010000:00010000:0.0:1788574175.743792:0:7439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788574175.743797:0:7439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152e000/0x5bf8706fdac8c136 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6732 expref: 16 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574175.743812:0:7439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85c152e000, rc 0) 00000100:00100000:0.0:1788574175.743882:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa328700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+15:10503:x1875455668937728:12345-192.168.204.51@tcp:101:rm.0 Request processed in 707us (941us total) trans 4294967305 rc 301/301 00000100:00100000:0.0:1788574175.743890:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 34 00000100:00100000:1.0:1788574175.754671:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574175.754899:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668937856 00000100:00100000:0.0:1788574175.754911:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668937856 00000100:00100000:0.0:1788574175.754975:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 3 00000100:00100000:0.0:1788574175.754986:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:659467ff-94af-418e-92fe-11e4323a48aa+15:10503:x1875455668937856:12345-192.168.204.51@tcp:37:rm.0 00000100:00100000:0.0:1788574175.759831:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:659467ff-94af-418e-92fe-11e4323a48aa+15:10503:x1875455668937856:12345-192.168.204.51@tcp:37:rm.0 Request processed in 4831us (5155us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574175.759846:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 3 00000100:00100000:2.0:1788574175.763486:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574175.763582:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668938112 00000100:00100000:3.0:1788574175.763593:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668938112 00000100:00100000:3.0:1788574175.763680:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 4 00000100:00100000:3.0:1788574175.763691:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85d01f5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:659467ff-94af-418e-92fe-11e4323a48aa+15:10503:x1875455668938112:12345-192.168.204.51@tcp:35:rm.0 00000100:00100000:3.0:1788574175.763939:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85d01f5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:659467ff-94af-418e-92fe-11e4323a48aa+16:10503:x1875455668938112:12345-192.168.204.51@tcp:35:rm.0 Request processed in 250us (462us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1788574175.763970:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 4 00000100:00100000:1.0:1788574175.771430:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574175.771599:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668938368 00000100:00100000:0.0:1788574175.771610:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668938368 00000100:00100000:0.0:1788574175.771672:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 35 00000100:00100000:0.0:1788574175.771681:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+16:10503:x1875455668938368:12345-192.168.204.51@tcp:101:rm.0 00010000:00010000:0.0:1788574175.771710:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574175.771754:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152e000/0x5bf8706fdac8c144 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6739 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574175.771868:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f600/0x5bf8706fdac8c14b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574175.771884:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f600/0x5bf8706fdac8c14b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574175.771895:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f600/0x5bf8706fdac8c14b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788574175.771911:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788574175.772027:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152e000/0x5bf8706fdac8c144 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6739 expref: 19 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574175.772048:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f600/0x5bf8706fdac8c14b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6739 expref: 18 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574175.772058:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9c85d20f2600) 00010000:00010000:0.0:1788574175.772062:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788574175.772066:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85c152f600, rc 0) 00000100:00100000:0.0:1788574175.772474:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+18:10503:x1875455668938368:12345-192.168.204.51@tcp:101:rm.0 Request processed in 793us (1065us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788574175.772482:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 35 00000100:00100000:1.0:1788574175.775635:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574175.775723:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668938496 00000100:00100000:3.0:1788574175.775733:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668938496 00000100:00100000:3.0:1788574175.775795:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 36 00000100:00100000:3.0:1788574175.775806:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+18:10503:x1875455668938496:12345-192.168.204.51@tcp:41:rm.0 00000004:00000024:3.0:1788574175.775873:0:6494:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:3.0:1788574175.775961:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+18:10503:x1875455668938496:12345-192.168.204.51@tcp:41:rm.0 Request processed in 157us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574175.775969:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 36 00000100:00100000:3.0:1788574175.778920:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574175.779442:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668938624 00000100:00100000:0.0:1788574175.779456:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668938624 00000100:00100000:0.0:1788574175.779550:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 37 00000100:00100000:0.0:1788574175.779563:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa329f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+18:10503:x1875455668938624:12345-192.168.204.51@tcp:101:rm.0 00010000:00010000:0.0:1788574175.779602:0:7439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574175.779628:0:7439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8c159 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6740 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574175.779704:0:7439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c160 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574175.779722:0:7439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c160 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574175.779734:0:7439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c160 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574175.779748:0:7439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c167 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574175.779756:0:7439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c167 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574175.779762:0:7439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c167 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574175.779896:0:7439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7400/0x5bf8706fdac8c16e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574175.779906:0:7439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7400/0x5bf8706fdac8c16e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574175.779913:0:7439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7400/0x5bf8706fdac8c16e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788574175.779956:0:7439:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788574175.779967:0:7439:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788574175.779990:0:7439:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7400/0x5bf8706fdac8c16e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574175.780006:0:7439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7400/0x5bf8706fdac8c16e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574175.780015:0:7439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c160 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574175.780022:0:7439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c160 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574175.780044:0:7439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c160 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574175.780050:0:7439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d6600 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:0.0:1788574175.780054:0:7439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c160 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574175.780063:0:7439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c160 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574175.780076:0:7439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9c85d20f2600) 00010000:00010000:0.0:1788574175.780080:0:7439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574175.780340:0:7439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c160 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574175.780348:0:7439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c160 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574175.780363:0:7439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c167 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574175.780379:0:7439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c167 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574175.780385:0:7439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c167 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574175.780390:0:7439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d7e00 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:0.0:1788574175.780392:0:7439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c167 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574175.780398:0:7439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c167 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574175.780406:0:7439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xcdab4b64 (ffff9c85fa2c1a00) 00010000:00010000:0.0:1788574175.780408:0:7439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574175.780411:0:7439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c167 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574175.780429:0:7439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c167 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574175.780460:0:7439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8c159 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6740 expref: 20 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574175.780473:0:7439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7400/0x5bf8706fdac8c16e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6740 expref: 19 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574175.780480:0:7439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9c85c6b83d00) 00010000:00010000:0.0:1788574175.780483:0:7439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788574175.780491:0:7439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d20d7400, rc 0) 00000100:00100000:0.0:1788574175.780562:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa329f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+19:10503:x1875455668938624:12345-192.168.204.51@tcp:101:rm.0 Request processed in 1001us (1655us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574175.780570:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 37 00000100:00100000:0.0:1788574175.790528:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574175.790659:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668938880 00000100:00100000:1.0:1788574175.790672:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668938880 00000100:00100000:1.0:1788574175.790854:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 38 00000100:00100000:1.0:1788574175.790874:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8337480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+19:10503:x1875455668938880:12345-192.168.204.51@tcp:36:rm.0 00010000:00010000:1.0:1788574175.790977:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788574175.791031:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7400/0x5bf8706fdac8c16e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6740 expref: 19 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.791070:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617200/0x5bf8706fdac8c11a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6724 expref: 18 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.791094:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9c85c6b83d00) 00010000:00010000:1.0:1788574175.791107:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617600/0x5bf8706fdac8c12f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d672b expref: 17 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.791328:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9c85d20f2600) 00010000:00010000:1.0:1788574175.791347:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788574175.791372:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c175 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.791404:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c175 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.791488:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c175 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.791522:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c17c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.791530:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c17c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.791559:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c17c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.791764:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3200/0x5bf8706fdac8c183 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.791773:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3200/0x5bf8706fdac8c183 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.791796:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3200/0x5bf8706fdac8c183 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788574175.792149:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:1.0:1788574175.792241:0:6492:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 315772049718ns, next at 316771968645ns, rc = 0 00010000:00010000:1.0:1788574175.792375:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3400/0x5bf8706fdac8c18a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.792387:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3400/0x5bf8706fdac8c18a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.792405:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3400/0x5bf8706fdac8c18a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.792412:0:6492:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3400/0x5bf8706fdac8c18a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.792418:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3400/0x5bf8706fdac8c18a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.792424:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3400/0x5bf8706fdac8c18a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.792459:0:6492:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788574175.792516:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3200/0x5bf8706fdac8c183 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.792558:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3200/0x5bf8706fdac8c183 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.792566:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3200/0x5bf8706fdac8c183 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.792572:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85faea3200 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:1.0:1788574175.792576:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3200/0x5bf8706fdac8c183 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.792584:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3200/0x5bf8706fdac8c183 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.792633:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9c85c6b83d00) 00010000:00010000:1.0:1788574175.792651:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788574175.792657:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3200/0x5bf8706fdac8c183 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.792684:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3200/0x5bf8706fdac8c183 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.792714:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c175 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.792721:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c175 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.792745:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c175 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.792750:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85faea2000 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:1.0:1788574175.792753:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c175 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.792792:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c175 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.792802:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9c85d20f2600) 00010000:00010000:1.0:1788574175.792804:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788574175.792807:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c175 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.792825:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c175 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788574175.792870:0:6492:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002cbd933c reply state 00000000126d52e4 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c17c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.792899:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c17c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.792906:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xcdab4b64 (ffff9c85fa2c1a00) 00010000:00010000:1.0:1788574175.792908:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788574175.792935:0:6492:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788574175.793085:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8337480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+18:10503:x1875455668938880:12345-192.168.204.51@tcp:36:rm.0 Request processed in 2200us (2557us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788574175.793094:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 38 00010000:00010000:2.0:1788574175.793384:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788574175.793392:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3400/0x5bf8706fdac8c18a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574175.793398:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85faea3400 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:2.0:1788574175.793401:0:6481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3400/0x5bf8706fdac8c18a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574175.793408:0:6481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3400/0x5bf8706fdac8c18a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574175.793417:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9c85c6b83d00) 00010000:00010000:2.0:1788574175.793425:0:6481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788574175.793444:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3400/0x5bf8706fdac8c18a lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574175.793450:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3400/0x5bf8706fdac8c18a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574175.793481:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574175.793482:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574175.793484:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574175.798817:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574175.799327:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668939136 00000100:00100000:0.0:1788574175.799343:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668939136 00000100:00100000:0.0:1788574175.799414:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 5 00000100:00100000:0.0:1788574175.799556:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:659467ff-94af-418e-92fe-11e4323a48aa+18:10503:x1875455668939136:12345-192.168.204.51@tcp:35:rm.0 00000100:00100000:0.0:1788574175.799899:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:659467ff-94af-418e-92fe-11e4323a48aa+19:10503:x1875455668939136:12345-192.168.204.51@tcp:35:rm.0 Request processed in 348us (1096us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1788574175.804388:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 5 00000100:00100000:0.0:1788574175.804834:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574175.804921:0:11893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668939392 00000100:00100000:1.0:1788574175.804932:0:11893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668939392 00000100:00100000:1.0:1788574175.805026:0:11893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 39 00000100:00100000:1.0:1788574175.805044:0:11893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8335880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:659467ff-94af-418e-92fe-11e4323a48aa+19:10503:x1875455668939392:12345-192.168.204.51@tcp:36:rm.0 00010000:00010000:1.0:1788574175.805125:0:11893:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788574175.805159:0:11893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f600/0x5bf8706fdac8c14b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6739 expref: 19 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.805182:0:11893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8c0e9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6716 expref: 18 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.805236:0:11893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9c85d20f2600) 00010000:00010000:1.0:1788574175.805254:0:11893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8c0aa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6708 expref: 17 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.805285:0:11893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c85c6b83400) 00010000:00010000:1.0:1788574175.805292:0:11893:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788574175.805319:0:11893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3200/0x5bf8706fdac8c191 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.805333:0:11893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3200/0x5bf8706fdac8c191 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.805343:0:11893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3200/0x5bf8706fdac8c191 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.805357:0:11893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c198 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.805364:0:11893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c198 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.805370:0:11893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c198 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.805486:0:11893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8c19f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.805494:0:11893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8c19f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.805500:0:11893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8c19f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788574175.805762:0:11893:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788574175.805782:0:11893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8c19f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.805796:0:11893:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8c19f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.805804:0:11893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8c19f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.805811:0:11893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85faea3e00 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:1.0:1788574175.805817:0:11893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8c19f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.805826:0:11893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8c19f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.805835:0:11893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9c84c34bbb00) 00010000:00010000:1.0:1788574175.805838:0:11893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788574175.805842:0:11893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8c19f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.805849:0:11893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8c19f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.805872:0:11893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3200/0x5bf8706fdac8c191 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.805879:0:11893:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3200/0x5bf8706fdac8c191 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.805886:0:11893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3200/0x5bf8706fdac8c191 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.805892:0:11893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85faea3200 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:1.0:1788574175.805902:0:11893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3200/0x5bf8706fdac8c191 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.805909:0:11893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3200/0x5bf8706fdac8c191 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.805916:0:11893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c84c34bb900) 00010000:00010000:1.0:1788574175.805919:0:11893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788574175.805921:0:11893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3200/0x5bf8706fdac8c191 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.805927:0:11893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3200/0x5bf8706fdac8c191 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788574175.805939:0:11893:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bba15bbb reply state 000000002c6de651 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c198 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.805950:0:11893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c198 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574175.805956:0:11893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9c84c34bb600) 00010000:00010000:1.0:1788574175.805958:0:11893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788574175.805961:0:11893:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788574175.806118:0:11893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8335880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:659467ff-94af-418e-92fe-11e4323a48aa+18:10503:x1875455668939392:12345-192.168.204.51@tcp:36:rm.0 Request processed in 1082us (1284us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1788574175.806127:0:11893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 39 00010000:00010000:0.0:1788574175.892277:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574176.916547:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574177.939381:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574177.940897:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8337100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681609856:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788574177.944671:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574177.944777:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681609856 00000100:00100000:1.0:1788574177.944788:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681609856 00000100:00100000:1.0:1788574177.944836:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788574177.944864:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681609856:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788574177.944920:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788574177.953157:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681609856:12345-0@lo:41:osp-pre-0-1.0 Request processed in 8286us (8485us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574177.953537:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8337100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681609856:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788574177.953733:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00010000:00010000:0.0:1788574178.965335:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574179.482543:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85ffafd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681609984:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788574179.482890:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574179.483013:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788574179.483028:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681610112:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788574179.483088:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574179.483586:0:7533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681610112 00000100:00100000:1.0:1788574179.483599:0:7533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681610112 00000100:00100000:1.0:1788574179.483664:0:7533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788574179.483673:0:7533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681610112:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788574179.483712:0:7533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788574179.483869:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681609984 00000100:00100000:2.0:1788574179.483874:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681609984 00000100:00100000:2.0:1788574179.483932:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788574179.483940:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681609984:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788574179.483961:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788574179.484020:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681609984:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (1139us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574179.484028:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:2.0:1788574179.484050:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788574179.484123:0:7533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681610112:12345-0@lo:41:osp-pre-1-0.0 Request processed in 450us (1033us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574179.484130:0:7533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788574179.484181:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681610112:0@lo:41:osp-pre-1-0.0 00010000:00080000:1.0:1788574179.484259:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85ffafd180 x1875455681609984/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574195 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574179.484284:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85ffafd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681609984:0@lo:13:osp-pre-0-1.0 00000004:00080000:0.0:1788574179.484902:0:8811:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 319464709643ns, next at 320464705711ns, rc = 0 00000100:00100000:2.0:1788574179.484999:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788574179.485024:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8337100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681610240:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788574179.485079:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574179.487371:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681610240 00000100:00100000:0.0:1788574179.487393:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681610240 00000100:00100000:0.0:1788574179.488870:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788574179.488888:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffaffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681610240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788574179.488929:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1788574179.488965:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788574179.493703:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffaffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681610240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4803us (8607us total) trans 0 rc 0/0 00010000:00080000:2.0:1788574179.494701:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85c8337100 x1875455681610240/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574195 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574179.494739:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8337100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681610240:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788574179.496293:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788574179.918401:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574179.918441:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574179.918479:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574179.918511:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574179.918532:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574179.918949:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668939520 00000100:00100000:3.0:1788574179.918961:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668939520 00000100:00100000:3.0:1788574179.919016:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 342 00000100:00100000:3.0:1788574179.919027:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5671c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+13:2395:x1875455668939520:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1788574179.919096:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5671c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+13:2395:x1875455668939520:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 72us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574179.919104:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 342 00000100:00100000:3.0:1788574179.919141:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668939776 00000100:00100000:3.0:1788574179.919145:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668939776 00000100:00100000:3.0:1788574179.919185:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668940032 00000100:00100000:3.0:1788574179.919204:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668940032 00000100:00100000:3.0:1788574179.919226:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668939648 00000100:00100000:3.0:1788574179.919229:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668939648 00000100:00100000:3.0:1788574179.919246:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 236 00000100:00100000:3.0:1788574179.919252:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+5:2395:x1875455668939776:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1788574179.919286:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+5:2395:x1875455668939776:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 34us (845us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574179.919302:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 236 00000100:00100000:3.0:1788574179.919316:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 237 00000100:00100000:3.0:1788574179.919323:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2395:x1875455668940032:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1788574179.919350:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2395:x1875455668940032:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 27us (870us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574179.919356:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 237 00000100:00100000:3.0:1788574179.919369:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 238 00000100:00100000:3.0:1788574179.919375:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3649180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+18:2395:x1875455668939648:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1788574179.919403:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3649180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+18:2395:x1875455668939648:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 28us (891us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574179.919409:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 238 00000100:00080000:2.0:1788574179.919981:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788574179.919988:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788574179.921018:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668939904 00000100:00100000:2.0:1788574179.921035:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668939904 00000100:00100000:2.0:1788574179.921093:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 86 00000100:00100000:2.0:1788574179.921102:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3648a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:659467ff-94af-418e-92fe-11e4323a48aa+5:2395:x1875455668939904:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1788574179.921157:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3648a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:659467ff-94af-418e-92fe-11e4323a48aa+5:2395:x1875455668939904:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 56us (2623us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574179.921164:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 86 00000100:00080000:2.0:1788574179.921204:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788574179.924333:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574179.924419:0:11893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668940160 00000100:00100000:1.0:1788574179.924431:0:11893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668940160 00000100:00100000:1.0:1788574179.924517:0:11893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 239 00000100:00100000:1.0:1788574179.924527:0:11893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3648700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2395:x1875455668940160:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788574179.924603:0:11893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3648700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2395:x1875455668940160:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 77us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574179.924611:0:11893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 239 00000100:00080000:1.0:1788574179.924637:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:02000400:1.0:1788574179.980848:0:13656:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:0.0:1788574179.992084:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574180.500742:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fa32a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:69505170-06bc-41d1-9626-ab1a3c7f32a0:3618:1875455681610368:0@lo:400:kworker.0 00000100:00100000:2.0:1788574180.500824:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574180.500898:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3658380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681610880:0@lo:400:kworker.0 00000100:00100000:2.0:1788574180.500929:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574180.500955:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788574180.500960:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fa32b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875455681610752:0@lo:400:kworker.0 00000100:00100000:2.0:1788574180.500985:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574180.501018:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681610752 00000100:00100000:2.0:1788574180.501026:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681610752 00000100:00100000:2.0:1788574180.501078:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1788574180.501087:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffaff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875455681610752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574180.501150:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffaff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875455681610752:12345-0@lo:400:kworker.0 Request processed in 64us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574180.501158:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1788574180.501234:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fa32b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875455681610752:0@lo:400:kworker.0 00000100:00100000:2.0:1788574180.501274:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fa32ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875455681610496:0@lo:400:kworker.0 00000100:00100000:2.0:1788574180.501300:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574180.501317:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c365a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3619:1875455681611008:0@lo:400:kworker.0 00000100:00100000:2.0:1788574180.501350:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574180.501371:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788574180.501377:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fa328380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681610624:0@lo:400:kworker.0 00000100:00100000:2.0:1788574180.501398:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574180.501425:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681610496 00000100:00100000:2.0:1788574180.501429:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681610496 00000100:00100000:2.0:1788574180.501462:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681611008 00000100:00100000:2.0:1788574180.501466:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681611008 00000100:00100000:2.0:1788574180.501491:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1788574180.501496:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffafc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875455681610496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574180.501529:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffafc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875455681610496:12345-0@lo:400:kworker.0 Request processed in 33us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574180.501535:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1788574180.501545:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1788574180.501550:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffaff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875455681611008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574180.501575:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffaff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875455681611008:12345-0@lo:400:kworker.0 Request processed in 25us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574180.501580:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1788574180.501594:0:7533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681610880 00000100:00100000:2.0:1788574180.501597:0:7533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681610880 00000100:00100000:2.0:1788574180.501618:0:7533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681610624 00000100:00100000:2.0:1788574180.501621:0:7533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681610624 00000100:00100000:2.0:1788574180.501633:0:7533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788574180.501907:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681610368 00000100:00100000:1.0:1788574180.501912:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681610368 00000100:00100000:1.0:1788574180.501941:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1788574180.501947:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5671450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:3618:x1875455681610368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574180.501982:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5671450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:3618:x1875455681610368:12345-0@lo:400:kworker.0 Request processed in 35us (1159us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574180.501987:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1788574180.502014:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788574180.502021:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffafca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681610624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574180.502048:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffafca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681610624:12345-0@lo:400:kworker.0 Request processed in 28us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574180.502053:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788574180.502271:0:7533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffafea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681610880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574180.502305:0:7533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffafea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681610880:12345-0@lo:400:kworker.0 Request processed in 667us (1376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574180.502311:0:7533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00080000:2.0:1788574180.502337:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788574180.502363:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fa328380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681610624:0@lo:400:kworker.0 00000100:00100000:2.0:1788574180.502372:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fa32ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875455681610496:0@lo:400:kworker.0 00000100:00100000:2.0:1788574180.502380:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c365a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3619:1875455681611008:0@lo:400:kworker.0 00000100:00100000:2.0:1788574180.502410:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fa32a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:69505170-06bc-41d1-9626-ab1a3c7f32a0:3618:1875455681610368:0@lo:400:kworker.0 00000100:00100000:2.0:1788574180.502419:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3658380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681610880:0@lo:400:kworker.0 00000100:00100000:2.0:1788574180.507081:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85ffafc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681611264:0@lo:400:kworker.0 00000100:00100000:2.0:1788574180.507158:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574180.507239:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85ffafd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681611776:0@lo:400:kworker.0 00000100:00100000:2.0:1788574180.507263:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574180.507295:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788574180.507301:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85ffafdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681611392:0@lo:400:kworker.0 00000100:00100000:2.0:1788574180.507323:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574180.507340:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3658380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681611904:0@lo:400:kworker.0 00000100:00100000:2.0:1788574180.507364:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574180.507398:0:8815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681611264 00000100:00100000:2.0:1788574180.507407:0:8815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681611264 00000100:00100000:2.0:1788574180.507462:0:8815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681611776 00000100:00100000:2.0:1788574180.507466:0:8815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681611776 00000100:00100000:2.0:1788574180.507491:0:8815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681611392 00000100:00100000:2.0:1788574180.507494:0:8815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681611392 00000100:00100000:2.0:1788574180.507504:0:8815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681611904 00000100:00100000:2.0:1788574180.507506:0:8815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681611904 00000100:00100000:2.0:1788574180.507522:0:8815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788574180.507530:0:8815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c365a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681611264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574180.507738:0:8815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c365a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681611264:12345-0@lo:400:kworker.0 Request processed in 208us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574180.507746:0:8815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788574180.507763:0:8815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788574180.507770:0:8815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa32a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681611776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574180.507800:0:8815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa32a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681611776:12345-0@lo:400:kworker.0 Request processed in 31us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574180.507807:0:8815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788574180.507818:0:8815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788574180.507824:0:8815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa32ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681611392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574180.507852:0:8815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa32ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681611392:12345-0@lo:400:kworker.0 Request processed in 28us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574180.507857:0:8815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788574180.507867:0:8815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788574180.507873:0:8815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601b68050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681611904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574180.507899:0:8815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601b68050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681611904:12345-0@lo:400:kworker.0 Request processed in 26us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574180.507905:0:8815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:2.0:1788574180.508099:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788574180.508129:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85ffafdc00 x1875455681611392/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574196 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574180.508144:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85ffafdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681611392:0@lo:400:kworker.0 00010000:00080000:2.0:1788574180.508155:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3658380 x1875455681611904/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574196 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574180.508163:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3658380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681611904:0@lo:400:kworker.0 00010000:00080000:2.0:1788574180.508184:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85ffafc000 x1875455681611264/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574196 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574180.508216:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85ffafc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681611264:0@lo:400:kworker.0 00010000:00080000:2.0:1788574180.508226:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85ffafd500 x1875455681611776/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574196 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574180.508233:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85ffafd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681611776:0@lo:400:kworker.0 00000100:00100000:1.0:1788574180.508662:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3595c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3620:1875455681611136:0@lo:400:kworker.0 00000100:00100000:1.0:1788574180.508705:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574180.508745:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85ffafd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3620:1875455681611648:0@lo:400:kworker.0 00000100:00100000:1.0:1788574180.508770:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574180.508793:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788574180.508800:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85ffafc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3620:1875455681611520:0@lo:400:kworker.0 00000100:00100000:1.0:1788574180.508821:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574180.508852:0:11893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681611136 00000100:00100000:1.0:1788574180.508858:0:11893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681611136 00000100:00100000:1.0:1788574180.508914:0:11893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681611648 00000100:00100000:1.0:1788574180.508918:0:11893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681611648 00000100:00100000:1.0:1788574180.508939:0:11893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681611520 00000100:00100000:1.0:1788574180.508943:0:11893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681611520 00000100:00100000:1.0:1788574180.508959:0:11893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1788574180.508966:0:11893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c364a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875455681611136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574180.509007:0:11893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c364a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875455681611136:12345-0@lo:400:kworker.0 Request processed in 41us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574180.509014:0:11893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1788574180.509028:0:11893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1788574180.509034:0:11893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c364b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875455681611648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574180.509293:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1788574180.509304:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3649c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875455681611520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574180.509341:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3649c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875455681611520:12345-0@lo:400:kworker.0 Request processed in 40us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574180.509347:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1788574180.509467:0:11893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c364b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875455681611648:12345-0@lo:400:kworker.0 Request processed in 432us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574180.509473:0:11893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:1.0:1788574180.509493:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788574180.509497:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788574180.509529:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85ffafc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3620:1875455681611520:0@lo:400:kworker.0 00010000:00080000:1.0:1788574180.509552:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3595c00 x1875455681611136/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574196 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574180.509562:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3595c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3620:1875455681611136:0@lo:400:kworker.0 00010000:00080000:1.0:1788574180.509581:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85ffafd180 x1875455681611648/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574196 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574180.509589:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85ffafd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3620:1875455681611648:0@lo:400:kworker.0 00000100:00100000:2.0:1788574180.512085:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788574180.512108:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fa32a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681612032:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788574180.512181:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574180.512251:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681612032 00000100:00100000:2.0:1788574180.512259:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681612032 00000100:00100000:2.0:1788574180.512302:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788574180.512312:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa32ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681612032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788574180.512342:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788574180.512387:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa32ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681612032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574180.512394:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00010000:00080000:2.0:1788574180.512430:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85fa32a680 x1875455681612032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574196 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574180.512473:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fa32a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681612032:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788574180.512971:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788574180.512983:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3649500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681612160:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788574180.513018:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574180.514238:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681612160 00000100:00100000:1.0:1788574180.514251:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681612160 00000100:00100000:1.0:1788574180.514301:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788574180.514310:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3594700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681612160:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788574180.514331:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788574180.514388:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3594700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681612160:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (1370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574180.514394:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00010000:00080000:3.0:1788574180.514772:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3649500 x1875455681612160/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574196 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574180.514790:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3649500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681612160:0@lo:13:osp-pre-1-1.0 00000004:00080000:2.0:1788574181.019873:0:6471:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:2.0:1788574181.019915:0:6471:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:2.0:1788574181.019924:0:6471:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:2.0:1788574181.019973:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c860204a600/0x5bf8706fdac8c0fe lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574181.019996:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c860204a600/0x5bf8706fdac8c0fe lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574181.020009:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c860204a600/0x5bf8706fdac8c0fe lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574181.020015:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c860204a600 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:2.0:1788574181.020020:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c860204a600/0x5bf8706fdac8c0fe lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574181.020027:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c860204a600/0x5bf8706fdac8c0fe lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574181.020047:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xcdab4b64 (ffff9c85fa2c1a00) 00010000:00010000:2.0:1788574181.020050:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788574181.020055:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c860204a600/0x5bf8706fdac8c0fe lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574181.020061:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c860204a600/0x5bf8706fdac8c0fe lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574181.021477:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8c113 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574181.021515:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8c113 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574181.021522:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8c113 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574181.021527:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85c152f400 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:2.0:1788574181.021531:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8c113 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574181.021538:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8c113 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574181.021554:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9c85c6b83d00) 00010000:00010000:2.0:1788574181.021557:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788574181.021561:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8c113 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574181.021567:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8c113 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574181.021612:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c17c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574181.021619:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c17c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574181.021624:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c17c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574181.021628:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85faea2e00 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:2.0:1788574181.021638:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c17c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574181.021645:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c17c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574181.021653:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xcdab4b64 (ffff9c85fa2c1a00) 00010000:00010000:2.0:1788574181.021656:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788574181.021659:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c17c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574181.021664:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c17c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xcdab4b64 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574181.021681:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c198 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574181.021686:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c198 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574181.021692:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c198 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574181.021697:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85faea2000 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:2.0:1788574181.021700:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c198 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574181.021705:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c198 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574181.021713:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9c84c34bb600) 00010000:00010000:2.0:1788574181.021715:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788574181.021728:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c198 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574181.021734:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c198 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574181.022090:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788574181.022108:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3594e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681612288:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788574181.022177:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574181.022265:0:8815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681612288 00000100:00100000:3.0:1788574181.022273:0:8815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681612288 00000100:00100000:3.0:1788574181.022331:0:8815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788574181.022340:0:8815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3596680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681612288:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788574181.022374:0:8815:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:3.0:1788574181.022408:0:8815:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x6a9b79df, atime: 0x6a9b79df, ctime: 0x6a9b79df, blocks: 0x0 00010000:00010000:3.0:1788574181.022415:0:8815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a5a947f/0x5bf8706fdac8c1a6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574181.022429:0:8815:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=321s v=(0 0) 00010000:00010000:3.0:1788574181.022443:0:8815:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574181.022450:0:8815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a5a947f/0x5bf8706fdac8c1a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574181.022466:0:8815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a5a947f/0x5bf8706fdac8c1a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574181.022475:0:8815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a5a947f/0x5bf8706fdac8c1a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574181.022483:0:8815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a5a947f/0x5bf8706fdac8c1a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574181.022500:0:8815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788574181.022645:0:8815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3596680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3618:x1875455681612288:12345-0@lo:6:osp-syn-0-0.0 Request processed in 306us (468us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788574181.022653:0:8815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:3.0:1788574181.022679:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788574181.022685:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a5a947f/0x5bf8706fdac8c1a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574181.022704:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c84c2616e00 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:3.0:1788574181.022708:0:6481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a5a947f/0x5bf8706fdac8c1a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574181.022716:0:6481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a5a947f/0x5bf8706fdac8c1a6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574181.022730:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a5a947f/0x5bf8706fdac8c1a6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574181.022737:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a5a947f/0x5bf8706fdac8c1a6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574181.022753:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574181.022755:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574181.022757:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788574181.022789:0:3618:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c84c3594e00/2, rc 0, transno 4294967301 00000100:00100000:3.0:1788574181.022795:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3594e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681612288:0@lo:6:osp-syn-0-0.0 00000100:00080000:3.0:1788574181.027259:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788574181.030053:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788574181.303682:0:13705:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe80a57030 20000000:00000080:3.0:1788574181.303701:0:13705:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c84c3c5bc00 uarg=0000000000000000 20000000:01000000:3.0:1788574181.303742:0:13705:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1788574181.303749:0:13705:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1788574181.303754:0:13705:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:1.0:1788574181.308079:0:13706:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1788574181.308504:0:13705:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:3.0:1788574181.317679:0:13705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:3.0:1788574181.317716:0:13705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:3.0:1788574181.317730:0:13705:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:3.0:1788574181.317748:0:13705:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788574181.317766:0:13705:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c84c2616e00/0x5bf8706fdac8c1ad lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574181.317786:0:13705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c85fa32ea00/0x5bf8706fdac8c033 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d66f3 expref: 12 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574181.317794:0:13705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c85fa32e400/0x5bf8706fdac8c03a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d66fa expref: 12 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574181.317802:0:13705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c85c0031e00/0x5bf8706fdac8c048 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8c041 expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574181.317809:0:13705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c85fa32f000/0x5bf8706fdac8c056 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8c04f expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574181.317816:0:13705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c85c152e600/0x5bf8706fdac8c064 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8c05d expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574181.317823:0:13705:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c85c152ee00/0x5bf8706fdac8c072 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8c06b expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574181.317831:0:13705:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c84c2616e00/0x5bf8706fdac8c1ad lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574181.317873:0:13705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c85c152ee00/0x5bf8706fdac8c072 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5bf8706fdac8c06b expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574181.317901:0:13705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c85c152ee00/0x5bf8706fdac8c072 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5bf8706fdac8c06b expref: 23 pid: 6485 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574181.317927:0:13705:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3596300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13705:1875455681612416:0@lo:104: 00000100:00100000:3.0:1788574181.318014:0:13705:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574181.318644:0:6475:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788574181.318659:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681612416 00000100:00100000:2.0:1788574181.318666:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681612416 00000100:00100000:2.0:1788574181.318711:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788574181.318720:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3771050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:69505170-06bc-41d1-9626-ab1a3c7f32a0+3:13705:x1875455681612416:12345-0@lo:104: 00010000:00010000:2.0:1788574181.318733:0:6475:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff9c85c0030200/0x5bf8706fdac8c06b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8c072 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574181.318784:0:6475:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788574181.318790:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3771050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:69505170-06bc-41d1-9626-ab1a3c7f32a0+3:13705:x1875455681612416:12345-0@lo:104: Request processed in 72us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574181.318797:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:2.0:1788574181.318839:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788574181.318845:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c85c0030200/0x5bf8706fdac8c06b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8c072 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574181.318852:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85c0030200 already unused, calling callback (ffffffffc1472c20) 10000000:00010000:2.0:1788574181.318857:0:6480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c85c0030200/0x5bf8706fdac8c06b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5bf8706fdac8c072 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574181.318866:0:6480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c85c0030200/0x5bf8706fdac8c06b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5bf8706fdac8c072 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788574181.318888:0:6480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c85c0030200/0x5bf8706fdac8c06b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5bf8706fdac8c072 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788574181.318903:0:6480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788574181.318937:0:6480:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9c85c0030200/0x5bf8706fdac8c06b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8c072 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574181.318953:0:6480:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788574181.318981:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c85c0030200/0x5bf8706fdac8c06b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8c072 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574181.318988:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c85c0030200/0x5bf8706fdac8c06b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8c072 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574181.319002:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574181.319004:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574181.319005:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574181.319017:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fa32a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:69505170-06bc-41d1-9626-ab1a3c7f32a0:3618:1875455681612544:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788574181.319046:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788574181.319140:0:13705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c85c152e600/0x5bf8706fdac8c064 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5bf8706fdac8c05d expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574181.319150:0:13705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c85c152e600/0x5bf8706fdac8c064 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5bf8706fdac8c05d expref: 23 pid: 6485 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574181.319159:0:13705:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3596d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13705:1875455681612672:0@lo:104: 00000100:00100000:3.0:1788574181.319181:0:13705:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788574181.319230:0:13705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c85fa32f000/0x5bf8706fdac8c056 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5bf8706fdac8c04f expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574181.319237:0:13705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c85fa32f000/0x5bf8706fdac8c056 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5bf8706fdac8c04f expref: 23 pid: 6485 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574181.319244:0:13705:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3595880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13705:1875455681612800:0@lo:104: 00000100:00100000:3.0:1788574181.319263:0:13705:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788574181.319281:0:13705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c85c0031e00/0x5bf8706fdac8c048 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5bf8706fdac8c041 expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574181.319300:0:13705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c85c0031e00/0x5bf8706fdac8c048 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5bf8706fdac8c041 expref: 23 pid: 6485 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574181.319308:0:13705:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3595500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13705:1875455681612928:0@lo:104: 00000100:00100000:3.0:1788574181.319328:0:13705:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788574181.319351:0:13705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c85fa32e400/0x5bf8706fdac8c03a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d66fa expref: 12 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574181.319372:0:13705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c85fa32e400/0x5bf8706fdac8c03a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d66fa expref: 12 pid: 6487 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574181.319381:0:13705:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3597b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13705:1875455681613056:192.168.204.51@tcp:104: 00010000:00010000:3.0:1788574181.319447:0:13705:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c85fa32ea00/0x5bf8706fdac8c033 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d66f3 expref: 12 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574181.319456:0:13705:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c85fa32ea00/0x5bf8706fdac8c033 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d66f3 expref: 12 pid: 6485 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574181.319464:0:13705:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3596a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13705:1875455681613184:192.168.204.51@tcp:104: 00000100:00100000:3.0:1788574181.319486:0:13705:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c860198b000 going to sleep for 11 seconds 00000100:00100000:3.0:1788574181.319505:0:13705:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3596300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13705:1875455681612416:0@lo:104: 00000100:00100000:2.0:1788574181.319866:0:10311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681612672 00000100:00100000:2.0:1788574181.319882:0:10311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681612672 00000100:00100000:2.0:1788574181.319909:0:10311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681612800 00000100:00100000:2.0:1788574181.319911:0:10311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681612800 00000100:00100000:2.0:1788574181.319921:0:10311:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681612928 00000100:00100000:2.0:1788574181.319923:0:10311:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681612928 00000100:00100000:2.0:1788574181.319934:0:10311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788574181.320073:0:10311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3595f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:69505170-06bc-41d1-9626-ab1a3c7f32a0+5:13705:x1875455681612672:12345-0@lo:104: 00010000:00010000:2.0:1788574181.320086:0:10311:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff9c85faea2c00/0x5bf8706fdac8c05d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8c064 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574181.320146:0:10311:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788574181.320152:0:10311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3595f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:69505170-06bc-41d1-9626-ab1a3c7f32a0+5:13705:x1875455681612672:12345-0@lo:104: Request processed in 212us (970us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574181.320177:0:10311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788574181.320207:0:10311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788574181.320214:0:10311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3597100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:69505170-06bc-41d1-9626-ab1a3c7f32a0+4:13705:x1875455681612800:12345-0@lo:104: 00010000:00010000:2.0:1788574181.320222:0:10311:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff9c85faea3800/0x5bf8706fdac8c04f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8c056 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574181.320258:0:10311:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788574181.320263:0:10311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3597100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:69505170-06bc-41d1-9626-ab1a3c7f32a0+4:13705:x1875455681612800:12345-0@lo:104: Request processed in 50us (1000us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574181.320268:0:10311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788574181.320279:0:10311:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788574181.320592:0:10311:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3595180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:69505170-06bc-41d1-9626-ab1a3c7f32a0+3:13705:x1875455681612928:12345-0@lo:104: 00010000:00010000:2.0:1788574181.320602:0:10311:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff9c85faea2800/0x5bf8706fdac8c041 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8c048 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574181.320638:0:10311:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788574181.320644:0:10311:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3595180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:69505170-06bc-41d1-9626-ab1a3c7f32a0+3:13705:x1875455681612928:12345-0@lo:104: Request processed in 58us (1315us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574181.320650:0:10311:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:2.0:1788574181.320669:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788574181.320675:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c85faea2c00/0x5bf8706fdac8c05d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8c064 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574181.320682:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85faea2c00 already unused, calling callback (ffffffffc1472c20) 10000000:00010000:2.0:1788574181.320686:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c85faea2c00/0x5bf8706fdac8c05d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5bf8706fdac8c064 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574181.320706:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c85faea2c00/0x5bf8706fdac8c05d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5bf8706fdac8c064 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788574181.320713:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c85faea2c00/0x5bf8706fdac8c05d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5bf8706fdac8c064 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788574181.320718:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788574181.320742:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9c85faea2c00/0x5bf8706fdac8c05d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8c064 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574181.320748:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788574181.320767:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c85faea2c00/0x5bf8706fdac8c05d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8c064 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574181.320775:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c85faea2c00/0x5bf8706fdac8c05d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8c064 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574181.320790:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788574181.320793:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c85faea3800/0x5bf8706fdac8c04f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8c056 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574181.320799:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85faea3800 already unused, calling callback (ffffffffc1472c20) 10000000:00010000:2.0:1788574181.320802:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c85faea3800/0x5bf8706fdac8c04f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5bf8706fdac8c056 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574181.320809:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c85faea3800/0x5bf8706fdac8c04f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5bf8706fdac8c056 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788574181.320816:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c85faea3800/0x5bf8706fdac8c04f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5bf8706fdac8c056 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788574181.320827:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788574181.320841:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9c85faea3800/0x5bf8706fdac8c04f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8c056 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574181.320847:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788574181.320854:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c85faea3800/0x5bf8706fdac8c04f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8c056 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574181.320859:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c85faea3800/0x5bf8706fdac8c04f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8c056 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574181.320868:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788574181.320871:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c85faea2800/0x5bf8706fdac8c041 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8c048 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574181.321004:0:7433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681612544 00000100:00100000:1.0:1788574181.321011:0:7433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681612544 00010000:00010000:1.0:1788574181.321036:0:7433:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c85c152ee00/0x5bf8706fdac8c072 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8c06b expref: 24 pid: 6485 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574181.321061:0:7433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788574181.321067:0:7433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa328380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:3618:x1875455681612544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788574181.321089:0:7433:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574181.321095:0:7433:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c85c152ee00/0x5bf8706fdac8c072 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8c06b expref: 24 pid: 6485 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574181.321105:0:7433:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c85c152ee00/0x5bf8706fdac8c072 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5bf8706fdac8c06b expref: 24 pid: 6485 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574181.321118:0:7433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85c152ee00/0x5bf8706fdac8c072 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5bf8706fdac8c06b expref: 24 pid: 6485 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574181.321141:0:7433:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788574181.321177:0:7433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa328380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:69505170-06bc-41d1-9626-ab1a3c7f32a0+23:3618:x1875455681612544:12345-0@lo:103:ldlm_bl.0 Request processed in 110us (2130us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574181.321183:0:7433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788574181.321250:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fa32a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:69505170-06bc-41d1-9626-ab1a3c7f32a0:3618:1875455681612544:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788574181.321844:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85faea2800 already unused, calling callback (ffffffffc1472c20) 10000000:00010000:2.0:1788574181.321848:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c85faea2800/0x5bf8706fdac8c041 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5bf8706fdac8c048 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574181.321855:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c85faea2800/0x5bf8706fdac8c041 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5bf8706fdac8c048 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788574181.321861:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c85faea2800/0x5bf8706fdac8c041 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5bf8706fdac8c048 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788574181.321866:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788574181.322057:0:6481:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9c85faea2800/0x5bf8706fdac8c041 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8c048 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574181.322064:0:6481:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788574181.322168:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c85faea2800/0x5bf8706fdac8c041 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8c048 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574181.322177:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c85faea2800/0x5bf8706fdac8c041 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8c048 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574181.322214:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574181.322217:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574181.322219:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574181.322230:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574181.322244:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fa32b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69505170-06bc-41d1-9626-ab1a3c7f32a0:3619:1875455681613312:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788574181.322435:0:13705:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3596d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13705:1875455681612672:0@lo:104: 00000100:00100000:3.0:1788574181.322447:0:13705:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3595880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13705:1875455681612800:0@lo:104: 00000100:00100000:3.0:1788574181.322456:0:13705:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3595500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13705:1875455681612928:0@lo:104: 00010000:00010000:3.0:1788574181.322504:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574181.322518:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:69505170-06bc-41d1-9626-ab1a3c7f32a0:3620:1875455681613440:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788574181.322549:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574181.322632:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574181.323102:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:69505170-06bc-41d1-9626-ab1a3c7f32a0:3617:1875455681613568:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788574181.323261:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574181.331537:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681613440 00000100:00100000:3.0:1788574181.331552:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681613440 00010000:00010000:3.0:1788574181.331595:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c85fa32f000/0x5bf8706fdac8c056 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8c04f expref: 23 pid: 6485 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574181.331738:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681613312 00000100:00100000:1.0:1788574181.331743:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681613312 00000100:00100000:0.0:1788574181.331838:0:7433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681613568 00000100:00100000:0.0:1788574181.331843:0:7433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681613568 00010000:00010000:0.0:1788574181.331863:0:7433:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c85c0031e00/0x5bf8706fdac8c048 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8c041 expref: 25 pid: 6485 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574181.331902:0:7433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788574181.331994:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788574181.332006:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c335ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69505170-06bc-41d1-9626-ab1a3c7f32a0+25:3617:x1875455681613568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788574181.332022:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574181.332029:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c85c0031e00/0x5bf8706fdac8c048 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8c041 expref: 25 pid: 6485 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574181.332041:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c85c0031e00/0x5bf8706fdac8c048 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5bf8706fdac8c041 expref: 25 pid: 6485 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574181.332062:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85c0031e00/0x5bf8706fdac8c048 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5bf8706fdac8c041 expref: 25 pid: 6485 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574181.332087:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788574181.332162:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c335ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:3617:x1875455681613568:12345-0@lo:103:ldlm_bl.0 Request processed in 160us (8899us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574181.332169:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788574181.332634:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:69505170-06bc-41d1-9626-ab1a3c7f32a0:3617:1875455681613568:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788574181.333310:0:7433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3597480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:69505170-06bc-41d1-9626-ab1a3c7f32a0+23:3620:x1875455681613440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788574181.333328:0:7433:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574181.333335:0:7433:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c85fa32f000/0x5bf8706fdac8c056 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8c04f expref: 23 pid: 6485 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574181.333892:0:7433:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c85fa32f000/0x5bf8706fdac8c056 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5bf8706fdac8c04f expref: 23 pid: 6485 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574181.333907:0:7433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85fa32f000/0x5bf8706fdac8c056 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5bf8706fdac8c04f expref: 23 pid: 6485 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574181.333930:0:7433:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574181.334244:0:7433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3597480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:69505170-06bc-41d1-9626-ab1a3c7f32a0+22:3620:x1875455681613440:12345-0@lo:103:ldlm_bl.0 Request processed in 2332us (11693us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574181.334254:0:7433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00010000:0.0:1788574181.334844:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c85c152e600/0x5bf8706fdac8c064 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8c05d expref: 21 pid: 6485 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574181.335103:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788574181.335116:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c335d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69505170-06bc-41d1-9626-ab1a3c7f32a0+21:3619:x1875455681613312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788574181.335129:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574181.335149:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c85c152e600/0x5bf8706fdac8c064 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8c05d expref: 21 pid: 6485 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574181.335160:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c85c152e600/0x5bf8706fdac8c064 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5bf8706fdac8c05d expref: 21 pid: 6485 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574181.335173:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85c152e600/0x5bf8706fdac8c064 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5bf8706fdac8c05d expref: 21 pid: 6485 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574181.335202:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788574181.335252:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c335d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69505170-06bc-41d1-9626-ab1a3c7f32a0+20:3619:x1875455681613312:12345-0@lo:103:ldlm_bl.0 Request processed in 140us (12620us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574181.335258:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788574181.335308:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fa32b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69505170-06bc-41d1-9626-ab1a3c7f32a0:3619:1875455681613312:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788574181.335536:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:69505170-06bc-41d1-9626-ab1a3c7f32a0:3620:1875455681613440:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788574181.347868:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574181.347996:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574181.348009:0:13705:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3597b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13705:1875455681613056:192.168.204.51@tcp:104: 00000100:00100000:3.0:1788574181.348084:0:13705:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3596a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13705:1875455681613184:192.168.204.51@tcp:104: 00010000:00010000:3.0:1788574181.348121:0:13705:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c84c2616e00/0x5bf8706fdac8c1ad lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574181.348213:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668940288 00000100:00100000:0.0:1788574181.348221:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668940288 00010000:00010000:0.0:1788574181.348257:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c85fa32e400/0x5bf8706fdac8c03a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d66fa expref: 13 pid: 6487 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574181.348369:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668940416 00000100:00100000:0.0:1788574181.348374:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668940416 00010000:00010000:0.0:1788574181.348389:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c85fa32ea00/0x5bf8706fdac8c033 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d66f3 expref: 14 pid: 6485 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574181.348416:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 50 00000100:00100000:0.0:1788574181.348437:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c335ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+14:2394:x1875455668940288:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788574181.348452:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574181.348458:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c85fa32e400/0x5bf8706fdac8c03a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d66fa expref: 14 pid: 6487 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574181.348470:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c85fa32e400/0x5bf8706fdac8c03a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d66fa expref: 14 pid: 6487 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574181.348488:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85fa32e400/0x5bf8706fdac8c03a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d66fa expref: 14 pid: 6487 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574181.348501:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574181.348551:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c335ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+13:2394:x1875455668940288:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 128us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574181.348559:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 50 00000100:00100000:0.0:1788574181.348642:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 51 00000100:00100000:0.0:1788574181.348649:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c335c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+12:2393:x1875455668940416:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788574181.348657:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574181.348661:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c85fa32ea00/0x5bf8706fdac8c033 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d66f3 expref: 12 pid: 6485 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574181.348680:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c85fa32ea00/0x5bf8706fdac8c033 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d66f3 expref: 12 pid: 6485 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574181.348689:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85fa32ea00/0x5bf8706fdac8c033 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d66f3 expref: 12 pid: 6485 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574181.348700:0:6478:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c84c2616e00/0x5bf8706fdac8c1ad lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574181.348708:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c84c2616e00/0x5bf8706fdac8c1ad lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574181.348723:0:6478:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c84c2616e00/0x5bf8706fdac8c1ad lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574181.348731:0:6478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c84c2616e00/0x5bf8706fdac8c1ad lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574181.348738:0:6478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c84c2616e00/0x5bf8706fdac8c1ad lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574181.348744:0:6478:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c84c2616e00/0x5bf8706fdac8c1ad lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574181.348750:0:6478:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c84c2616e00 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:0.0:1788574181.348755:0:6478:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c84c2616e00/0x5bf8706fdac8c1ad lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574181.348763:0:6478:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c84c2616e00/0x5bf8706fdac8c1ad lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574181.348786:0:6478:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c84c2616e00/0x5bf8706fdac8c1ad lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574181.348796:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574181.348821:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c335c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+11:2393:x1875455668940416:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 172us (826us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574181.348828:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 51 00010000:00010000:3.0:1788574181.350741:0:13705:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c84c2616e00/0x5bf8706fdac8c1ad lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574181.350758:0:13705:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c84c2616e00/0x5bf8706fdac8c1ad lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574181.350766:0:13705:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c84c2616e00/0x5bf8706fdac8c1ad lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13705 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574182.041460:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788574182.346420:0:13754:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc99d53170 20000000:00000080:3.0:1788574182.346439:0:13754:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c84c3c3b800 uarg=0000000000000000 20000000:01000000:3.0:1788574182.346482:0:13754:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:3.0:1788574182.346488:0:13754:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:3.0:1788574182.346492:0:13754:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:1.0:1788574182.351810:0:13755:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:3.0:1788574182.352060:0:13754:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:3.0:1788574182.352162:0:13754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:3.0:1788574182.352222:0:13754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:3.0:1788574182.352239:0:13754:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:3.0:1788574182.352252:0:13754:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788574182.352273:0:13754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c84c2616e00/0x5bf8706fdac8c1b4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574182.352289:0:13754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c84c2616e00/0x5bf8706fdac8c1b4 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574182.352300:0:13754:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c84c2616e00/0x5bf8706fdac8c1b4 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574182.352320:0:13754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c84c2616e00/0x5bf8706fdac8c1b4 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574182.352328:0:13754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c84c2616e00/0x5bf8706fdac8c1b4 lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574182.352335:0:13754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c84c2616e00/0x5bf8706fdac8c1b4 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574182.352341:0:13754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c84c2616e00 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:3.0:1788574182.352346:0:13754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c84c2616e00/0x5bf8706fdac8c1b4 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574182.352354:0:13754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c84c2616e00/0x5bf8706fdac8c1b4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574182.352366:0:13754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c84c2616e00/0x5bf8706fdac8c1b4 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574182.352374:0:13754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c84c2616e00/0x5bf8706fdac8c1b4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574182.352381:0:13754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c84c2616e00/0x5bf8706fdac8c1b4 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788574182.422480:0:6490:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788574182.422487:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c85f7fb1000 from 7 10000000:01000000:2.0:1788574182.422492:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788574182.422540:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85fa32e800/0x5bf8706fdac8c1bb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574182.422552:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c85fa32e800/0x5bf8706fdac8c1bb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574182.422563:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c85fa32e800/0x5bf8706fdac8c1bb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574182.422588:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85e56c1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681613696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788574182.422672:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574182.422725:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85e57d6300 going to sleep for 11 seconds 00000100:00100000:1.0:1788574182.422850:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681613696 00000100:00100000:1.0:1788574182.422858:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681613696 00000100:00100000:1.0:1788574182.422915:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1788574182.422924:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5672850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+20:6490:x1875455681613696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788574182.422937:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574182.422951:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85faea3400/0x5bf8706fdac8c1c2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8c1bb expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574182.422974:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85faea3400/0x5bf8706fdac8c1c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8c1bb expref: 21 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574182.422985:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85faea3400/0x5bf8706fdac8c1c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8c1bb expref: 21 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574182.422995:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85faea3400, rc 0) 00000100:00100000:1.0:1788574182.423049:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5672850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+21:6490:x1875455681613696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574182.423056:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:0.0:1788574182.425881:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85e56c1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681613696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788574182.425910:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c85fa32e800/0x5bf8706fdac8c1bb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8c1c2 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574182.425923:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c85fa32e800/0x5bf8706fdac8c1bb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8c1c2 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574182.426007:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8335500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681613824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788574182.426067:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574182.426111:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c3597d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788574182.426167:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681613824 00000100:00100000:2.0:1788574182.426173:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681613824 00000100:00100000:2.0:1788574182.426341:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:2.0:1788574182.426351:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5673050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+21:6490:x1875455681613824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788574182.426490:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5673050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+21:6490:x1875455681613824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 141us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574182.426497:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:0.0:1788574182.426836:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8335500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681613824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788574182.426867:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8335500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681613952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788574182.426908:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574182.426934:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c3597d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788574182.428271:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681613952 00000100:00100000:3.0:1788574182.428282:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681613952 00000100:00100000:3.0:1788574182.428321:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1788574182.428328:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5671850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+21:6490:x1875455681613952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788574182.428459:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5671850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+21:6490:x1875455681613952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 131us (1550us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574182.428472:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:0.0:1788574182.428586:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8335500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681613952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788574182.432991:0:13759:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8335500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:13759:1875455681614080:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788574182.433075:0:13759:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574182.433122:0:13759:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85fa3daf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788574182.433272:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681614080 00000100:00100000:3.0:1788574182.433280:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681614080 00000100:00100000:3.0:1788574182.433327:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1788574182.433338:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5673450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+21:13759:x1875455681614080:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788574182.433466:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5673450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+21:13759:x1875455681614080:12345-0@lo:502:llog_process_th.0 Request processed in 129us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574182.433473:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1788574182.433861:0:13759:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8335500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:13759:1875455681614080:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788574182.433896:0:13759:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788574182.433907:0:13759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788574182.433909:0:13759:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788574182.433916:0:13759:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c85f7fb1000 00000020:00000080:0.0:1788574182.433919:0:13759:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788574182.433988:0:13759:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788574182.433993:0:13759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788574182.433995:0:13759:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788574182.433997:0:13759:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788574182.433999:0:13759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788574182.434001:0:13759:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788574182.434004:0:13759:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c85f7fb1000 00000020:00000080:0.0:1788574182.434006:0:13759:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788574182.434042:0:13759:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8335500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:13759:1875455681614208:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788574182.434082:0:13759:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574182.434098:0:13759:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85fa3daf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788574182.436561:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681614208 00000100:00100000:3.0:1788574182.436576:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681614208 00000100:00100000:3.0:1788574182.436632:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1788574182.436642:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5670850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+21:13759:x1875455681614208:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788574182.436794:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5670850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+21:13759:x1875455681614208:12345-0@lo:502:llog_process_th.0 Request processed in 153us (2711us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574182.436802:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1788574182.436868:0:13759:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8335500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:13759:1875455681614208:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788574182.436904:0:13759:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788574182.436911:0:13759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574182.436913:0:13759:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788574182.436918:0:13759:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1788574182.436985:0:6490:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1788574182.437005:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788574182.437016:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85fa32e800/0x5bf8706fdac8c1bb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8c1c2 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574182.437029:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c85fa32e800/0x5bf8706fdac8c1bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8c1c2 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788574182.437046:0:6490:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788574182.437048:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c85fad3f000 from 7 10000000:01000000:3.0:1788574182.437052:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788574182.437081:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c84c2616e00/0x5bf8706fdac8c1c9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574182.437090:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c84c2616e00/0x5bf8706fdac8c1c9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574182.437100:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c84c2616e00/0x5bf8706fdac8c1c9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574182.437119:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3596a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681614336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788574182.447036:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574182.447097:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8600213e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788574182.447158:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681614336 00000100:00100000:3.0:1788574182.447167:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681614336 00000100:00100000:3.0:1788574182.447243:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1788574182.447253:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5670c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+21:6490:x1875455681614336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788574182.447269:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574182.447286:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c84c2617c00/0x5bf8706fdac8c1d0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8c1c9 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574182.447314:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c84c2617c00/0x5bf8706fdac8c1d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8c1c9 expref: 22 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574182.447325:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c84c2617c00/0x5bf8706fdac8c1d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8c1c9 expref: 22 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574182.447334:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c84c2617c00, rc 0) 00000100:00100000:3.0:1788574182.447384:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5670c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+22:6490:x1875455681614336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574182.447391:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:2.0:1788574182.447525:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3596a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681614336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788574182.447543:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c84c2616e00/0x5bf8706fdac8c1c9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8c1d0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574182.447552:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c84c2616e00/0x5bf8706fdac8c1c9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8c1d0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574182.447639:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85e56c1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681614464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788574182.447670:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574182.447700:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85e57d6300 going to sleep for 11 seconds 00000100:00100000:3.0:1788574182.447970:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681614464 00000100:00100000:3.0:1788574182.448047:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681614464 00000100:00100000:3.0:1788574182.448081:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:3.0:1788574182.448088:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5672c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+22:6490:x1875455681614464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788574182.448242:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5672c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+22:6490:x1875455681614464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 153us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574182.448250:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1788574182.448483:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85e56c1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681614464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788574182.448623:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85e56c1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681614592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788574182.448664:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574182.448696:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85e57d6300 going to sleep for 11 seconds 00000100:00100000:3.0:1788574182.452060:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681614592 00000100:00100000:3.0:1788574182.452074:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681614592 00000100:00100000:3.0:1788574182.452138:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1788574182.452148:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5673c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+22:6490:x1875455681614592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788574182.452313:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5673c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+22:6490:x1875455681614592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 166us (3648us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574182.452321:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1788574182.452399:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85e56c1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681614592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788574182.453899:0:13763:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3597b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:13763:1875455681614720:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788574182.453982:0:13763:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574182.454025:0:13763:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8600213480 going to sleep for 11 seconds 00000100:00100000:2.0:1788574182.454071:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681614720 00000100:00100000:2.0:1788574182.454084:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681614720 00000100:00100000:2.0:1788574182.454128:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1788574182.454149:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5672450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+22:13763:x1875455681614720:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788574182.454293:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5672450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+22:13763:x1875455681614720:12345-0@lo:502:llog_process_th.0 Request processed in 156us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574182.454301:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:3.0:1788574182.455734:0:13763:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3597b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:13763:1875455681614720:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788574182.455776:0:13763:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788574182.455787:0:13763:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574182.455789:0:13763:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788574182.455798:0:13763:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c85fad3f000 00000020:00000080:3.0:1788574182.455807:0:13763:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788574182.455868:0:13763:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788574182.456165:0:13763:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574182.456168:0:13763:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788574182.456174:0:13763:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788574182.456177:0:13763:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574182.456179:0:13763:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788574182.456182:0:13763:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c85fad3f000 00000020:00000080:3.0:1788574182.456185:0:13763:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788574182.456442:0:13763:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3597b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:13763:1875455681614848:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788574182.459906:0:13763:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574182.460841:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681614848 00000100:00100000:3.0:1788574182.460853:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681614848 00000100:00100000:3.0:1788574182.460919:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1788574182.460929:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5670450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+22:13763:x1875455681614848:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788574182.462572:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5670450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+22:13763:x1875455681614848:12345-0@lo:502:llog_process_th.0 Request processed in 1638us (2665us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574182.462585:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1788574182.462661:0:13763:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8600213480 going to sleep for 11 seconds 00000100:00100000:3.0:1788574182.462688:0:13763:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3597b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:13763:1875455681614848:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788574182.462725:0:13763:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788574182.464054:0:13763:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574182.464062:0:13763:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788574182.464071:0:13763:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1788574182.464216:0:6490:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1788574182.464243:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788574182.464254:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c84c2616e00/0x5bf8706fdac8c1c9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8c1d0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574182.464285:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c84c2616e00/0x5bf8706fdac8c1c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8c1d0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788574182.464296:0:6490:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788574182.464299:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c85fa390800 from 7 10000000:01000000:3.0:1788574182.464302:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788574182.464339:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c84c2617e00/0x5bf8706fdac8c1d7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574182.464347:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c84c2617e00/0x5bf8706fdac8c1d7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574182.464356:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c84c2617e00/0x5bf8706fdac8c1d7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574182.464383:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3597b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681614976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788574182.464456:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574182.464489:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8600213480 going to sleep for 11 seconds 00000100:00100000:3.0:1788574182.466515:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681614976 00000100:00100000:3.0:1788574182.466533:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681614976 00000100:00100000:3.0:1788574182.466606:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1788574182.466617:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5670050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+22:6490:x1875455681614976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788574182.466635:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574182.466653:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c84c2616c00/0x5bf8706fdac8c1de lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8c1d7 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574182.466682:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c84c2616c00/0x5bf8706fdac8c1de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8c1d7 expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574182.466710:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c84c2616c00/0x5bf8706fdac8c1de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8c1d7 expref: 23 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574182.466719:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c84c2616c00, rc 0) 00000100:00100000:3.0:1788574182.466806:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5670050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+23:6490:x1875455681614976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 190us (2349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574182.466814:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1788574182.474752:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3597b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681614976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788574182.474783:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c84c2617e00/0x5bf8706fdac8c1d7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8c1de expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574182.474797:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c84c2617e00/0x5bf8706fdac8c1d7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8c1de expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574182.474888:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3597b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681615104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788574182.474947:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574182.475008:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8600213480 going to sleep for 11 seconds 00000100:00100000:3.0:1788574182.475037:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681615104 00000100:00100000:3.0:1788574182.475043:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681615104 00000100:00100000:3.0:1788574182.475086:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:3.0:1788574182.475095:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e564fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+23:6490:x1875455681615104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788574182.475257:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e564fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+23:6490:x1875455681615104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 162us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574182.475265:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:3.0:1788574182.475309:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3597b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681615104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788574182.475354:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3597b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681615232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788574182.475393:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574182.475427:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8600213480 going to sleep for 11 seconds 00000040:00080000:0.0:1788574182.485456:0:13764:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788574182.485756:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681615232 00000100:00100000:3.0:1788574182.485765:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681615232 00000100:00100000:3.0:1788574182.485814:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1788574182.485823:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e564e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+23:6490:x1875455681615232:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788574182.485978:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e564e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+23:6490:x1875455681615232:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 155us (10583us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574182.485986:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1788574182.486041:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3597b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681615232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788574182.509007:0:13765:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3597b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:13765:1875455681615360:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788574182.509095:0:13765:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574182.509162:0:13765:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8600213cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788574182.511059:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681615360 00000100:00100000:0.0:1788574182.511073:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681615360 00000100:00100000:0.0:1788574182.511127:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1788574182.511144:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e564c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+23:13765:x1875455681615360:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788574182.511319:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e564c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+23:13765:x1875455681615360:12345-0@lo:502:llog_process_th.0 Request processed in 183us (2224us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574182.511328:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1788574182.511518:0:13765:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3597b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:13765:1875455681615360:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788574182.511551:0:13765:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788574182.511560:0:13765:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574182.511562:0:13765:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788574182.511569:0:13765:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c85fa390800 00000020:00000080:3.0:1788574182.511571:0:13765:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788574182.511630:0:13765:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788574182.511633:0:13765:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574182.511634:0:13765:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788574182.511637:0:13765:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788574182.511639:0:13765:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574182.511640:0:13765:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788574182.511650:0:13765:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c85fa390800 00000020:00000080:3.0:1788574182.511652:0:13765:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788574182.511693:0:13765:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3597b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:13765:1875455681615488:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788574182.511731:0:13765:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574182.511747:0:13765:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8600213cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788574182.512595:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681615488 00000100:00100000:0.0:1788574182.512606:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681615488 00000100:00100000:0.0:1788574182.512648:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:0.0:1788574182.512664:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e564c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+23:13765:x1875455681615488:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788574182.512787:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e564c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+23:13765:x1875455681615488:12345-0@lo:502:llog_process_th.0 Request processed in 125us (1055us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574182.512795:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1788574182.515101:0:13765:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3597b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:13765:1875455681615488:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788574182.515158:0:13765:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788574182.515167:0:13765:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574182.515169:0:13765:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788574182.515175:0:13765:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1788574182.515440:0:6490:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1788574182.515464:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788574182.515474:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c84c2617e00/0x5bf8706fdac8c1d7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8c1de expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574182.515486:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c84c2617e00/0x5bf8706fdac8c1d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8c1de expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788574182.515505:0:6490:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788574182.515508:0:6490:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c85c2bfb800 from 7 10000000:01000000:0.0:1788574182.515510:0:6490:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788574182.515545:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7a00/0x5bf8706fdac8c1e5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574182.515552:0:6490:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7a00/0x5bf8706fdac8c1e5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574182.515560:0:6490:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7a00/0x5bf8706fdac8c1e5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574182.515581:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8335180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681615616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788574182.515641:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574182.515670:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c53cb900 going to sleep for 11 seconds 00000100:00100000:3.0:1788574182.516244:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681615616 00000100:00100000:3.0:1788574182.516252:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681615616 00000100:00100000:3.0:1788574182.516298:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1788574182.516306:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e564e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+23:6490:x1875455681615616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788574182.516320:0:6486:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574182.516333:0:6486:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c84c2616600/0x5bf8706fdac8c1ec lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8c1e5 expref: -99 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574182.516357:0:6486:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c84c2616600/0x5bf8706fdac8c1ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8c1e5 expref: 24 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574182.516368:0:6486:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c84c2616600/0x5bf8706fdac8c1ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8c1e5 expref: 24 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574182.516376:0:6486:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c84c2616600, rc 0) 00000100:00100000:3.0:1788574182.516439:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e564e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:6490:x1875455681615616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574182.516446:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1788574182.516584:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8335180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681615616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788574182.516601:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7a00/0x5bf8706fdac8c1e5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8c1ec expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574182.516611:0:6490:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7a00/0x5bf8706fdac8c1e5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8c1ec expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574182.516673:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3597b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681615744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788574182.516702:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574182.516719:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8600213480 going to sleep for 11 seconds 00000100:00100000:3.0:1788574182.517703:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681615744 00000100:00100000:3.0:1788574182.517712:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681615744 00000100:00100000:3.0:1788574182.518906:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1788574182.518921:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e564f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:6490:x1875455681615744:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788574182.522353:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e564f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:6490:x1875455681615744:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 3429us (5640us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574182.522369:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:0.0:1788574182.532041:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3597b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681615744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788574182.532105:0:6490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8337b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681615872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788574182.532225:0:6490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574182.532268:0:6490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c53cb900 going to sleep for 11 seconds 00000100:00100000:1.0:1788574182.532363:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681615872 00000100:00100000:1.0:1788574182.532370:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681615872 00000100:00100000:1.0:1788574182.532430:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:1.0:1788574182.532441:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e564d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:6490:x1875455681615872:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788574182.532572:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e564d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:6490:x1875455681615872:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 132us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574182.532580:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:0.0:1788574182.534739:0:6490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8337b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69505170-06bc-41d1-9626-ab1a3c7f32a0:6490:1875455681615872:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788574182.536668:0:13768:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788574182.537086:0:13770:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3595500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:13770:1875455681616000:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788574182.537174:0:13770:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574182.537223:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681616000 00000100:00100000:3.0:1788574182.537230:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681616000 00000100:00100000:3.0:1788574182.537276:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:3.0:1788574182.537285:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e564dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:13770:x1875455681616000:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788574182.537397:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e564dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:13770:x1875455681616000:12345-0@lo:502:llog_process_th.0 Request processed in 112us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574182.537424:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:3.0:1788574182.537487:0:13770:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8600213e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788574182.537522:0:13770:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3595500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:13770:1875455681616000:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788574182.537552:0:13770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788574182.537561:0:13770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574182.537564:0:13770:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788574182.537572:0:13770:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c85c2bfb800 00000020:00000080:3.0:1788574182.537574:0:13770:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788574182.545385:0:13770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788574182.545471:0:13770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574182.545474:0:13770:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788574182.545480:0:13770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788574182.545485:0:13770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574182.545486:0:13770:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788574182.545491:0:13770:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c85c2bfb800 00000020:00000080:3.0:1788574182.545493:0:13770:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788574182.546755:0:13770:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3595500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:13770:1875455681616128:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788574182.546837:0:13770:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574182.546878:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681616128 00000100:00100000:3.0:1788574182.546885:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681616128 00000100:00100000:3.0:1788574182.546930:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:3.0:1788574182.546939:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e564d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:13770:x1875455681616128:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788574182.550165:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e564d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:13770:x1875455681616128:12345-0@lo:502:llog_process_th.0 Request processed in 3218us (3320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574182.550178:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:3.0:1788574182.550272:0:13770:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85e57dcd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788574182.550297:0:13770:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3595500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69505170-06bc-41d1-9626-ab1a3c7f32a0:13770:1875455681616128:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788574182.550331:0:13770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788574182.550339:0:13770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574182.550347:0:13770:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788574182.550352:0:13770:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1788574182.551886:0:6490:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1788574182.551924:0:6490:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788574182.551936:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7a00/0x5bf8706fdac8c1e5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8c1ec expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574182.551948:0:6490:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7a00/0x5bf8706fdac8c1e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8c1ec expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574183.059665:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788574183.059687:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8337b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681616256:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788574183.059767:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788574183.059976:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574183.060030:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681616256 00000100:00100000:0.0:1788574183.060050:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681616256 00000100:00100000:0.0:1788574183.060102:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788574183.060113:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3595500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681616256:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788574183.060147:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788574183.060291:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3595500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681616256:12345-0@lo:41:osp-pre-0-1.0 Request processed in 179us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574183.060298:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788574183.060382:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8337b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681616256:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788574183.240968:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574183.241067:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668940544 00000100:00100000:1.0:1788574183.241078:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668940544 00000100:00100000:1.0:1788574183.241140:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 364 00000100:00100000:1.0:1788574183.241152:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e564e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+11:6164:x1875455668940544:12345-192.168.204.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788574183.241170:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574183.241661:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85faea3200/0x5bf8706fdac8c1f3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6747 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574183.241694:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85faea3200/0x5bf8706fdac8c1f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6747 expref: 12 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574183.241706:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85faea3200/0x5bf8706fdac8c1f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6747 expref: 12 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574183.241717:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85faea3200, rc 0) 00000100:00100000:1.0:1788574183.241793:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e564e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+12:6164:x1875455668940544:12345-192.168.204.51@tcp:101:ll_cfg_requeue.0 Request processed in 644us (834us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574183.241800:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 364 00000100:00100000:0.0:1788574183.250491:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574183.250586:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668940672 00000100:00100000:3.0:1788574183.250597:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668940672 00000100:00100000:3.0:1788574183.250658:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 365 00000100:00100000:3.0:1788574183.250669:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e564f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+12:6164:x1875455668940672:12345-192.168.204.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788574183.250948:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e564f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+12:6164:x1875455668940672:12345-192.168.204.51@tcp:501:ll_cfg_requeue.0 Request processed in 272us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574183.250958:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 365 00000100:00100000:0.0:1788574183.255590:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574183.255691:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668940800 00000100:00100000:1.0:1788574183.255703:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668940800 00000100:00100000:1.0:1788574183.255779:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 366 00000100:00100000:1.0:1788574183.255791:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e564d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+12:6164:x1875455668940800:12345-192.168.204.51@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788574183.255936:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e564d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+12:6164:x1875455668940800:12345-192.168.204.51@tcp:503:ll_cfg_requeue.0 Request processed in 147us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574183.255953:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 366 00000100:00100000:2.0:1788574183.267881:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574183.268019:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668940928 00000100:00100000:1.0:1788574183.268029:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668940928 00000100:00100000:1.0:1788574183.268097:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 367 00000100:00100000:1.0:1788574183.268107:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e564c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+12:10787:x1875455668940928:12345-192.168.204.51@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788574183.268539:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e564c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+12:10787:x1875455668940928:12345-192.168.204.51@tcp:502:llog_process_th.0 Request processed in 431us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574183.268549:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 367 00000100:00100000:0.0:1788574183.295248:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574183.295340:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668941056 00000100:00100000:3.0:1788574183.295352:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668941056 00000100:00100000:3.0:1788574183.295431:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 368 00000100:00100000:3.0:1788574183.295445:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e564cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+12:10787:x1875455668941056:12345-192.168.204.51@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788574183.295657:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e564cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+12:10787:x1875455668941056:12345-192.168.204.51@tcp:502:llog_process_th.0 Request processed in 214us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574183.296333:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 368 00000100:00100000:0.0:1788574183.320363:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574183.320521:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668941184 00000100:00100000:1.0:1788574183.320530:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668941184 00000100:00100000:1.0:1788574183.320587:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 369 00000100:00100000:1.0:1788574183.320597:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e564ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+12:6164:x1875455668941184:12345-192.168.204.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788574183.320614:0:6485:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574183.320632:0:6485:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85faea2800/0x5bf8706fdac8c1fa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x652b547cf44d674e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574183.320660:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85faea2800/0x5bf8706fdac8c1fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d674e expref: 13 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574183.320672:0:6485:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85faea2800/0x5bf8706fdac8c1fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d674e expref: 13 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574183.320699:0:6485:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85faea2800, rc 0) 00000100:00100000:1.0:1788574183.320760:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e564ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+13:6164:x1875455668941184:12345-192.168.204.51@tcp:101:ll_cfg_requeue.0 Request processed in 164us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574183.320767:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 369 00000100:00100000:0.0:1788574183.323732:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574183.323820:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668941312 00000100:00100000:3.0:1788574183.323830:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668941312 00000100:00100000:3.0:1788574183.323893:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 370 00000100:00100000:3.0:1788574183.323904:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c5362850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+13:6164:x1875455668941312:12345-192.168.204.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788574183.324371:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c5362850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+13:6164:x1875455668941312:12345-192.168.204.51@tcp:501:ll_cfg_requeue.0 Request processed in 467us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574183.324407:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 370 00000100:00100000:0.0:1788574183.327996:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574183.328116:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668941440 00000100:00100000:1.0:1788574183.328128:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668941440 00000100:00100000:1.0:1788574183.328186:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 371 00000100:00100000:1.0:1788574183.328227:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e564f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+13:6164:x1875455668941440:12345-192.168.204.51@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788574183.328401:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e564f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+13:6164:x1875455668941440:12345-192.168.204.51@tcp:503:ll_cfg_requeue.0 Request processed in 165us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574183.328410:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 371 00000100:00100000:0.0:1788574183.341645:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574183.344079:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668941568 00000100:00100000:1.0:1788574183.344096:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668941568 00000100:00100000:1.0:1788574183.344169:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 372 00000100:00100000:1.0:1788574183.344181:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c820f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+13:10790:x1875455668941568:12345-192.168.204.51@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788574183.344381:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c820f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+13:10790:x1875455668941568:12345-192.168.204.51@tcp:502:llog_process_th.0 Request processed in 202us (2745us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574183.344401:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 372 00000100:00100000:0.0:1788574183.372238:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574183.372438:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668941696 00000100:00100000:3.0:1788574183.372449:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668941696 00000100:00100000:3.0:1788574183.372512:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 373 00000100:00100000:3.0:1788574183.372522:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c820d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+13:10790:x1875455668941696:12345-192.168.204.51@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788574183.372663:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c820d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+13:10790:x1875455668941696:12345-192.168.204.51@tcp:502:llog_process_th.0 Request processed in 141us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574183.372672:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 373 00000040:00080000:0.0:1788574183.507913:0:13764:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1788574183.572584:0:13768:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788574184.084107:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574184.595390:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788574184.595414:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85e56c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681616512:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788574184.595496:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574184.595574:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c364ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681616384:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788574184.595602:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574184.595639:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681616512 00000100:00100000:1.0:1788574184.595647:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681616512 00000100:00100000:1.0:1788574184.595716:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788574184.595740:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681616512:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788574184.595746:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8336a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681616640:0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788574184.595769:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788574184.595773:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574184.595829:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681616512:12345-0@lo:13:osp-pre-0-1.0 Request processed in 104us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574184.595851:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788574184.595866:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681616640 00000100:00100000:1.0:1788574184.595870:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681616640 00000100:00100000:1.0:1788574184.595887:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788574184.595893:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8337b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3620:x1875455681616640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788574184.595903:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788574184.595929:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8337b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3620:x1875455681616640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 36us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574184.595935:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788574184.595956:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8336a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681616640:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788574184.595972:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85e56c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681616512:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788574184.595997:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681616384 00000100:00100000:3.0:1788574184.596002:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681616384 00000100:00100000:3.0:1788574184.596027:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788574184.596047:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681616384:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788574184.596073:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788574184.596119:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681616384:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574184.596125:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788574184.596263:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c364ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681616384:0@lo:41:osp-pre-1-0.0 00000100:00080000:2.0:1788574184.597850:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788574185.032986:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574185.033027:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574185.033059:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574185.033094:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574185.033116:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574185.033129:0:11893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668941952 00000100:00100000:1.0:1788574185.033141:0:11893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668941952 00000100:00100000:0.0:1788574185.033142:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574185.033176:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668942464 00000100:00100000:0.0:1788574185.033180:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668942464 00000100:00100000:0.0:1788574185.033241:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668942080 00000100:00100000:0.0:1788574185.033245:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668942080 00000100:00100000:1.0:1788574185.033249:0:11893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668942336 00000100:00100000:1.0:1788574185.033254:0:11893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668942336 00000100:00100000:0.0:1788574185.033265:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 246 00000100:00100000:0.0:1788574185.033278:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8336a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+5:2393:x1875455668941952:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788574185.033284:0:11893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 247 00000100:00100000:1.0:1788574185.033295:0:11893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8335500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2393:x1875455668942464:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788574185.033368:0:11893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8335500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2393:x1875455668942464:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 74us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574185.033377:0:11893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 247 00000100:00100000:2.0:1788574185.033398:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 248 00000100:00100000:3.0:1788574185.033435:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668942208 00000100:00100000:3.0:1788574185.033440:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668942208 00000100:00100000:3.0:1788574185.033472:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 91 00000100:00100000:3.0:1788574185.033480:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8335180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:659467ff-94af-418e-92fe-11e4323a48aa+5:2393:x1875455668942208:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1788574185.033520:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8337800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+5:2393:x1875455668942080:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1788574185.033607:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8336a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+5:2393:x1875455668941952:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 332us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574185.034239:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8335180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:659467ff-94af-418e-92fe-11e4323a48aa+5:2393:x1875455668942208:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 757us (1208us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574185.034248:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 91 00000100:00100000:3.0:1788574185.034287:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668941824 00000100:00100000:3.0:1788574185.034306:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668941824 00000100:00100000:3.0:1788574185.034337:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 374 00000100:00100000:3.0:1788574185.034344:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c820f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+13:2393:x1875455668941824:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1788574185.034385:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c820f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+13:2393:x1875455668941824:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 41us (1290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574185.034392:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 374 00000100:00080000:3.0:1788574185.034432:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788574185.034437:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788574185.034439:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788574185.034618:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8337800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+5:2393:x1875455668942080:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 1100us (1499us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574185.034715:0:11893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 249 00000100:00100000:0.0:1788574185.034729:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 246 00000100:00100000:1.0:1788574185.034895:0:11893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8334e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2393:x1875455668942336:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788574185.036042:0:11893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8334e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2393:x1875455668942336:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 1302us (2882us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574185.036055:0:11893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 249 00000100:00100000:2.0:1788574185.038789:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 248 00010000:00010000:3.0:1788574185.109221:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574185.620147:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788574185.620168:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c364b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681616768:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788574185.620263:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574185.620869:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681616768 00000100:00100000:1.0:1788574185.620879:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681616768 00000100:00100000:1.0:1788574185.620975:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788574185.620987:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8337100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681616768:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788574185.621019:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788574185.621087:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8337100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681616768:12345-0@lo:13:osp-pre-1-1.0 Request processed in 103us (823us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574185.621094:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:3.0:1788574185.621300:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788574185.621964:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c364b100 x1875455681616768/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574201 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574185.621984:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c364b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681616768:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788574185.622216:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3596d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875455681617024:0@lo:400:kworker.0 00000100:00100000:3.0:1788574185.622268:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574185.622295:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3594a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3619:1875455681617536:0@lo:400:kworker.0 00000100:00100000:3.0:1788574185.622318:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574185.622360:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3595c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1875455681618048:0@lo:400:kworker.0 00000100:00100000:3.0:1788574185.622386:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574185.622406:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788574185.622412:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3596300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681617152:0@lo:400:kworker.0 00000100:00100000:3.0:1788574185.622438:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574185.622459:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3594000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1875455681617664:0@lo:400:kworker.0 00000100:00100000:3.0:1788574185.622482:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574185.622499:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85de9bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1875455681618176:0@lo:400:kworker.0 00000100:00100000:3.0:1788574185.622522:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574185.622550:0:7533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681617152 00000100:00100000:3.0:1788574185.622557:0:7533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681617152 00000100:00100000:3.0:1788574185.622608:0:7533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788574185.622615:0:7533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c300ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681617152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574185.622657:0:7533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c300ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681617152:12345-0@lo:400:kworker.0 Request processed in 42us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574185.622663:0:7533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788574185.622689:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681617024 00000100:00100000:3.0:1788574185.622692:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681617024 00000100:00100000:3.0:1788574185.622710:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681617536 00000100:00100000:3.0:1788574185.622713:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681617536 00000100:00100000:3.0:1788574185.622733:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681618048 00000100:00100000:3.0:1788574185.622736:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681618048 00000100:00100000:3.0:1788574185.622748:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681617664 00000100:00100000:3.0:1788574185.622751:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681617664 00000100:00100000:3.0:1788574185.622762:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681618176 00000100:00100000:3.0:1788574185.622764:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681618176 00000100:00100000:3.0:1788574185.622791:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1788574185.622799:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de93b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875455681617024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574185.622829:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de93b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875455681617024:12345-0@lo:400:kworker.0 Request processed in 32us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574185.622835:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1788574185.622847:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1788574185.622853:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de938700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875455681617536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574185.622881:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de938700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875455681617536:12345-0@lo:400:kworker.0 Request processed in 28us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574185.622887:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1788574185.622898:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1788574185.622903:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3009c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875455681618048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574185.622929:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3009c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875455681618048:12345-0@lo:400:kworker.0 Request processed in 26us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574185.622941:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1788574185.622954:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1788574185.623266:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c300aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875455681617664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574185.623302:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c300aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875455681617664:12345-0@lo:400:kworker.0 Request processed in 342us (819us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574185.623308:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1788574185.623321:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1788574185.623328:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffaf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875455681618176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574185.623370:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffaf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875455681618176:12345-0@lo:400:kworker.0 Request processed in 43us (847us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574185.623377:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00080000:3.0:1788574185.623394:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788574185.623398:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788574185.623424:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3596300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681617152:0@lo:400:kworker.0 00010000:00080000:3.0:1788574185.623436:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3594000 x1875455681617664/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574201 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574185.623446:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3594000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1875455681617664:0@lo:400:kworker.0 00010000:00080000:3.0:1788574185.623455:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85de9bd500 x1875455681618176/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574201 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574185.623464:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85de9bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1875455681618176:0@lo:400:kworker.0 00000100:00100000:3.0:1788574185.623473:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3596d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875455681617024:0@lo:400:kworker.0 00000100:00100000:3.0:1788574185.623481:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3594a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3619:1875455681617536:0@lo:400:kworker.0 00000100:00100000:3.0:1788574185.623490:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3595c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1875455681618048:0@lo:400:kworker.0 00000100:00100000:2.0:1788574185.623662:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3595880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:69505170-06bc-41d1-9626-ab1a3c7f32a0:3618:1875455681616896:0@lo:400:kworker.0 00000100:00100000:2.0:1788574185.623708:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574185.623748:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3597800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681617408:0@lo:400:kworker.0 00000100:00100000:2.0:1788574185.623773:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574185.623806:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3596a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681617920:0@lo:400:kworker.0 00000100:00100000:2.0:1788574185.623829:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574185.623848:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788574185.623854:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3594380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875455681617280:0@lo:400:kworker.0 00000100:00100000:2.0:1788574185.623874:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574185.623902:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3597b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681617792:0@lo:400:kworker.0 00000100:00100000:2.0:1788574185.623926:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574185.623943:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85de939180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681618304:0@lo:400:kworker.0 00000100:00100000:2.0:1788574185.623963:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574185.623993:0:8815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681617920 00000100:00100000:2.0:1788574185.623997:0:8815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681617920 00000100:00100000:2.0:1788574185.624026:0:8815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681617792 00000100:00100000:2.0:1788574185.624029:0:8815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681617792 00000100:00100000:2.0:1788574185.624053:0:8815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681618304 00000100:00100000:2.0:1788574185.624057:0:8815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681618304 00000100:00100000:2.0:1788574185.624080:0:8815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788574185.624086:0:8815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3618:x1875455681617920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574185.624122:0:8815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3618:x1875455681617920:12345-0@lo:400:kworker.0 Request processed in 36us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574185.624128:0:8815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788574185.624140:0:8815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788574185.624145:0:8815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faff3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681617792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574185.624172:0:8815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faff3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681617792:12345-0@lo:400:kworker.0 Request processed in 26us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574185.624185:0:8815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788574185.624217:0:8815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788574185.624224:0:8815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faff1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681618304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574185.624254:0:8815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faff1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681618304:12345-0@lo:400:kworker.0 Request processed in 31us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574185.624260:0:8815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:2.0:1788574185.624281:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788574185.624292:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681617408 00000100:00100000:2.0:1788574185.624296:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681617408 00000100:00100000:2.0:1788574185.624316:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788574185.624322:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681617408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574185.624364:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681617408:12345-0@lo:400:kworker.0 Request processed in 42us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574185.624370:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788574185.624396:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3597b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681617792:0@lo:400:kworker.0 00010000:00080000:2.0:1788574185.624406:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85de939180 x1875455681618304/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574201 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574185.624415:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85de939180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681618304:0@lo:400:kworker.0 00000100:00100000:2.0:1788574185.624424:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3597800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681617408:0@lo:400:kworker.0 00000100:00100000:2.0:1788574185.624432:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3596a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681617920:0@lo:400:kworker.0 00000100:00100000:2.0:1788574185.624453:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681617280 00000100:00100000:2.0:1788574185.624456:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681617280 00000100:00100000:2.0:1788574185.624476:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1788574185.624481:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875455681617280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574185.624519:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875455681617280:12345-0@lo:400:kworker.0 Request processed in 38us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574185.624525:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1788574185.624547:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3594380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875455681617280:0@lo:400:kworker.0 00000100:00100000:1.0:1788574185.626122:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788574185.626143:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85e56c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681618432:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788574185.626239:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574185.626351:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681618432 00000100:00100000:0.0:1788574185.626371:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681618432 00000100:00100000:0.0:1788574185.626422:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788574185.626430:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c364a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681618432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788574185.626450:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788574185.626490:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c364a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681618432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574185.626497:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00010000:00080000:1.0:1788574185.626582:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85e56c1f80 x1875455681618432/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574201 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574185.626600:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85e56c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681618432:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788574185.627923:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681616896 00000100:00100000:3.0:1788574185.627933:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681616896 00000100:00100000:3.0:1788574185.627988:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:3.0:1788574185.627996:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c820c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:3618:x1875455681616896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574185.628052:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c820c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:3618:x1875455681616896:12345-0@lo:400:kworker.0 Request processed in 56us (4343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574185.628059:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:2.0:1788574185.628920:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3595880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:69505170-06bc-41d1-9626-ab1a3c7f32a0:3618:1875455681616896:0@lo:400:kworker.0 00010000:00010000:2.0:1788574186.131667:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574187.155994:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788574187.159067:0:8404:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000100:00100000:0.0:1788574188.179449:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788574188.179473:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85e56c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681618560:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788574188.179876:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574188.179985:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681618560 00000100:00100000:3.0:1788574188.179995:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681618560 00000100:00100000:3.0:1788574188.180054:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788574188.180066:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3723b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681618560:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788574188.180116:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00010000:00010000:1.0:1788574188.180168:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574188.181038:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3723b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681618560:12345-0@lo:41:osp-pre-0-1.0 Request processed in 971us (1158us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574188.181048:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788574188.182319:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85e56c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681618560:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788574189.206171:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574189.718467:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681618688:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788574189.718543:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574189.718572:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788574189.718587:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faff2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681618816:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788574189.718619:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574189.719426:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681618688 00000100:00100000:1.0:1788574189.719434:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681618688 00000100:00100000:1.0:1788574189.719492:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681618816 00000100:00100000:1.0:1788574189.719496:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681618816 00000100:00100000:1.0:1788574189.719516:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788574189.719525:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffaf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681618688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788574189.719559:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788574189.719617:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffaf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681618688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (1075us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574189.719625:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788574189.719643:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788574189.719651:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faff0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681618816:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788574189.719681:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788574189.719707:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faff0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681618816:12345-0@lo:13:osp-pre-0-1.0 Request processed in 58us (1087us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574189.719713:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788574189.719792:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3648000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681618944:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788574189.719828:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574189.719885:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faff2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681618816:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788574189.720140:0:7533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681618944 00000100:00100000:1.0:1788574189.720146:0:7533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681618944 00000100:00100000:1.0:1788574189.720209:0:7533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788574189.720217:0:7533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de939180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681618944:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788574189.720241:0:7533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788574189.720298:0:7533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de939180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681618944:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574189.720305:0:7533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788574189.720521:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3648000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681618944:0@lo:41:osp-pre-1-0.0 00000100:00080000:3.0:1788574189.721486:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788574189.721529:0:3620:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:3.0:1788574189.721536:0:3620:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c84c3594e00, transno 4294967301 00000100:00100000:3.0:1788574189.721567:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681618688:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788574190.153743:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574190.153787:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574190.153822:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574190.153865:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574190.153883:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574190.153940:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574190.153969:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668942720 00000100:00100000:0.0:1788574190.153978:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668942720 00000100:00100000:0.0:1788574190.154028:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668943232 00000100:00100000:0.0:1788574190.154032:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668943232 00000100:00100000:0.0:1788574190.154044:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668942848 00000100:00100000:0.0:1788574190.154046:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668942848 00000100:00100000:0.0:1788574190.154058:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668943104 00000100:00100000:0.0:1788574190.154061:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668943104 00000100:00100000:0.0:1788574190.154076:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 256 00000100:00100000:0.0:1788574190.154085:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+5:2393:x1875455668942720:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1788574190.154170:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+5:2393:x1875455668942720:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 85us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574190.154179:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 256 00000100:00100000:0.0:1788574190.154235:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 257 00000100:00100000:0.0:1788574190.154242:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2393:x1875455668943232:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1788574190.154281:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2393:x1875455668943232:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 39us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574190.154287:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 257 00000100:00100000:0.0:1788574190.154299:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 258 00000100:00100000:0.0:1788574190.154304:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+5:2393:x1875455668942848:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1788574190.154325:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+5:2393:x1875455668942848:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 21us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574190.154330:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 258 00000100:00100000:0.0:1788574190.154339:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 259 00000100:00100000:0.0:1788574190.154344:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2393:x1875455668943104:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1788574190.154382:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2393:x1875455668943104:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 38us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574190.154388:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 259 00000100:00100000:3.0:1788574190.155162:0:8815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668942976 00000100:00100000:3.0:1788574190.155170:0:8815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668942976 00000100:00100000:3.0:1788574190.155264:0:8815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 95 00000100:00100000:3.0:1788574190.155273:0:8815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:659467ff-94af-418e-92fe-11e4323a48aa+5:2393:x1875455668942976:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1788574190.155327:0:8815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:659467ff-94af-418e-92fe-11e4323a48aa+5:2393:x1875455668942976:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 55us (1539us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574190.155334:0:8815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 95 00000100:00080000:3.0:1788574190.155459:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788574190.155464:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788574190.155467:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788574190.156672:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668942592 00000100:00100000:2.0:1788574190.156685:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668942592 00000100:00100000:2.0:1788574190.156808:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 376 00000100:00100000:2.0:1788574190.156818:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c820ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+13:2393:x1875455668942592:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1788574190.156881:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c820ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+13:2393:x1875455668942592:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 65us (3014us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574190.156888:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 376 00010000:00010000:3.0:1788574190.227547:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574190.739647:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788574190.739673:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681619072:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788574190.739747:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574190.740024:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c364b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681619328:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788574190.740053:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574190.740095:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681619072 00000100:00100000:1.0:1788574190.740104:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681619072 00000100:00100000:1.0:1788574190.740151:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681619328 00000100:00100000:1.0:1788574190.740154:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681619328 00000100:00100000:1.0:1788574190.740170:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788574190.740178:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3648000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681619072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788574190.740222:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788574190.740268:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3648000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681619072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574190.740275:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788574190.740304:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788574190.740310:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c364ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681619328:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788574190.740321:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788574190.740483:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788574190.740493:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faff2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69505170-06bc-41d1-9626-ab1a3c7f32a0:3619:1875455681619200:0@lo:400:kworker.0 00000100:00100000:3.0:1788574190.740530:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574190.740568:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681619200 00000100:00100000:3.0:1788574190.740572:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681619200 00000100:00100000:3.0:1788574190.740603:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:3.0:1788574190.740610:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c820fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:3619:x1875455681619200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574190.740643:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c820fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:3619:x1875455681619200:12345-0@lo:400:kworker.0 Request processed in 34us (113us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574190.740650:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:3.0:1788574190.740695:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faff2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69505170-06bc-41d1-9626-ab1a3c7f32a0:3619:1875455681619200:0@lo:400:kworker.0 00000100:00080000:3.0:1788574190.740719:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788574190.744489:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3725180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681619584:0@lo:400:kworker.0 00000100:00100000:2.0:1788574190.744560:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574190.744594:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1875455681620096:0@lo:400:kworker.0 00000100:00100000:2.0:1788574190.744618:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574190.744654:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1875455681620608:0@lo:400:kworker.0 00000100:00100000:2.0:1788574190.744677:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574190.744702:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788574190.744708:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3724380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875455681619712:0@lo:400:kworker.0 00000100:00100000:2.0:1788574190.744736:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574190.744753:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681620224:0@lo:400:kworker.0 00000100:00100000:2.0:1788574190.744777:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574190.744812:0:11893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681620096 00000100:00100000:2.0:1788574190.744820:0:11893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681620096 00000100:00100000:2.0:1788574190.744879:0:11893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681620608 00000100:00100000:2.0:1788574190.744883:0:11893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681620608 00010000:00080000:3.0:1788574190.745137:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3c2c700 x1875455681619072/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574206 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574190.745162:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681619072:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788574190.745186:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788574190.745269:0:11893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681619712 00000100:00100000:2.0:1788574190.745273:0:11893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681619712 00000100:00100000:0.0:1788574190.745357:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3726a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875455681619456:0@lo:400:kworker.0 00000100:00100000:0.0:1788574190.745392:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574190.751571:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c364ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681619328:12345-0@lo:13:osp-pre-1-1.0 Request processed in 11249us (11505us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574190.751587:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788574190.751638:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2335880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681619840:0@lo:400:kworker.0 00000100:00100000:1.0:1788574190.751701:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574190.751731:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681620352:0@lo:400:kworker.0 00000100:00100000:1.0:1788574190.751751:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788574190.751794:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c364b100 x1875455681619328/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574206 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574190.751817:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c364b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681619328:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788574190.751851:0:7533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681619584 00000100:00100000:1.0:1788574190.751857:0:7533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681619584 00000100:00100000:1.0:1788574190.752422:0:7533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681619840 00000100:00100000:1.0:1788574190.752429:0:7533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681619840 00000100:00100000:1.0:1788574190.752455:0:7533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788574190.752463:0:7533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681619584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574190.752537:0:7533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681619584:12345-0@lo:400:kworker.0 Request processed in 74us (7976us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574190.752544:0:7533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788574190.752556:0:7533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788574190.752562:0:7533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3649500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681619840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574190.752589:0:7533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3649500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681619840:12345-0@lo:400:kworker.0 Request processed in 27us (888us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574190.752610:0:7533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788574190.752647:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2335880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681619840:0@lo:400:kworker.0 00000100:00100000:1.0:1788574190.752676:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3725180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681619584:0@lo:400:kworker.0 00000100:00100000:2.0:1788574190.752806:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681620224 00000100:00100000:2.0:1788574190.752811:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681620224 00000100:00100000:2.0:1788574190.752841:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681620352 00000100:00100000:2.0:1788574190.752844:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681620352 00000100:00100000:2.0:1788574190.752862:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788574190.752869:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa0e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681620224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574190.752924:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa0e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681620224:12345-0@lo:400:kworker.0 Request processed in 56us (8146us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574190.752931:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788574190.752943:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788574190.752950:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3648a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681620352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574190.752981:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3648a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681620352:12345-0@lo:400:kworker.0 Request processed in 31us (1228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574190.752987:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788574190.753014:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681620352:0@lo:400:kworker.0 00000100:00100000:2.0:1788574190.753052:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681620224:0@lo:400:kworker.0 00000100:00100000:0.0:1788574190.756376:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3618:1875455681619968:0@lo:400:kworker.0 00000100:00100000:0.0:1788574190.756442:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574190.756482:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681619456 00000100:00100000:3.0:1788574190.756490:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681619456 00000100:00100000:3.0:1788574190.756541:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1788574190.756565:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875455681620096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574190.756649:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875455681620096:12345-0@lo:400:kworker.0 Request processed in 86us (12030us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574190.756657:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1788574190.756674:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1788574190.756680:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875455681620608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574190.756707:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875455681620608:12345-0@lo:400:kworker.0 Request processed in 28us (12030us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574190.756714:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1788574190.756724:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1788574190.756730:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875455681619712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574190.756756:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875455681619712:12345-0@lo:400:kworker.0 Request processed in 26us (12019us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574190.756761:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1788574190.756771:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788574190.756776:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875455681619456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574190.756802:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875455681619456:12345-0@lo:400:kworker.0 Request processed in 26us (11409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574190.756808:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788574190.756866:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3724380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875455681619712:0@lo:400:kworker.0 00010000:00080000:3.0:1788574190.756881:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c36ae300 x1875455681620096/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574206 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574190.756892:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1875455681620096:0@lo:400:kworker.0 00010000:00080000:3.0:1788574190.757668:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c36ed880 x1875455681620608/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574206 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574190.757691:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1875455681620608:0@lo:400:kworker.0 00000100:00100000:0.0:1788574190.762402:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3618:1875455681620480:0@lo:400:kworker.0 00000100:00100000:0.0:1788574190.762494:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574190.763626:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3726a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875455681619456:0@lo:400:kworker.0 00000100:00100000:3.0:1788574190.763992:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681619968 00000100:00100000:3.0:1788574190.764000:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681619968 00000100:00080000:2.0:1788574190.764119:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788574190.764169:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681620480 00000100:00100000:3.0:1788574190.764174:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681620480 00000100:00100000:2.0:1788574190.764360:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788574190.764373:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875455681619968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574190.764475:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875455681619968:12345-0@lo:400:kworker.0 Request processed in 106us (8032us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574190.764483:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788574190.764501:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788574190.764507:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875455681620480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574190.764537:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875455681620480:12345-0@lo:400:kworker.0 Request processed in 31us (2043us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574190.764543:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1788574190.764610:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3618:1875455681619968:0@lo:400:kworker.0 00000100:00100000:1.0:1788574190.764622:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3618:1875455681620480:0@lo:400:kworker.0 00000100:00080000:3.0:1788574190.767174:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788574191.251424:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574192.275444:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574193.299475:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574193.299659:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681620736:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788574193.299739:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574193.299955:0:7533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681620736 00000100:00100000:0.0:1788574193.300023:0:7533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681620736 00000100:00100000:0.0:1788574193.300300:0:7533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788574193.300312:0:7533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffaf7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681620736:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788574193.300354:0:7533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788574193.300417:0:7533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffaf7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681620736:12345-0@lo:41:osp-pre-0-1.0 Request processed in 108us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574193.300424:0:7533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788574193.303524:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681620736:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1788574193.749363:0:13764:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1788574193.812037:0:13768:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788574194.324099:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574194.835581:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788574194.835604:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c364b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681620864:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788574194.835671:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574194.835783:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681620864 00000100:00100000:1.0:1788574194.835791:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681620864 00000100:00100000:1.0:1788574194.835856:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788574194.835865:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681620864:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788574194.835897:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788574194.835937:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681620864:12345-0@lo:41:osp-pre-1-0.0 Request processed in 73us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574194.835944:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788574194.836135:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c364b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681620864:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788574194.838099:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c364b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681620992:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788574194.838144:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788574194.838158:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681621120:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788574194.838176:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574194.839386:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574194.843044:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681620992 00000100:00100000:2.0:1788574194.843059:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681620992 00000100:00100000:2.0:1788574194.843137:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681621120 00000100:00100000:2.0:1788574194.843140:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681621120 00000100:00100000:2.0:1788574194.843174:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788574194.843185:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681620992:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788574194.843233:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1788574194.843577:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788574194.843643:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681620992:12345-0@lo:13:osp-pre-0-1.0 Request processed in 460us (5476us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574194.843651:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788574194.843668:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788574194.843675:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffaf6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681621120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788574194.843699:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788574194.843816:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c364b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681620992:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788574194.844159:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffaf6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681621120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 483us (4778us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574194.844177:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788574194.850440:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681621120:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788574195.274978:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574195.275025:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574195.275058:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574195.275086:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574195.275107:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574195.275130:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574195.275243:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668943616 00000100:00100000:1.0:1788574195.275253:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668943616 00000100:00100000:1.0:1788574195.275323:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668943872 00000100:00100000:1.0:1788574195.275327:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668943872 00000100:00100000:1.0:1788574195.275339:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668943488 00000100:00100000:1.0:1788574195.275353:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668943488 00000100:00100000:1.0:1788574195.275368:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668944000 00000100:00100000:1.0:1788574195.275370:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668944000 00000100:00100000:1.0:1788574195.275385:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 266 00000100:00100000:1.0:1788574195.275393:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+5:2395:x1875455668943616:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788574195.275483:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+5:2395:x1875455668943616:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 90us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574195.275504:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 266 00000100:00100000:1.0:1788574195.275522:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 267 00000100:00100000:1.0:1788574195.275529:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2395:x1875455668943872:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788574195.275568:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2395:x1875455668943872:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 39us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574195.275574:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 267 00000100:00100000:1.0:1788574195.275586:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 268 00000100:00100000:1.0:1788574195.275592:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+5:2395:x1875455668943488:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788574195.275616:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+5:2395:x1875455668943488:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 25us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574195.275623:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 268 00000100:00100000:1.0:1788574195.275634:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 269 00000100:00100000:1.0:1788574195.275640:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2395:x1875455668944000:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788574195.275662:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2395:x1875455668944000:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 23us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574195.275667:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 269 00000100:00080000:0.0:1788574195.276829:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788574195.276846:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788574195.276942:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668943360 00000100:00100000:2.0:1788574195.276952:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668943360 00000100:00100000:2.0:1788574195.277046:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 378 00000100:00100000:2.0:1788574195.277056:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c820cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+13:2395:x1875455668943360:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1788574195.277431:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668943744 00000100:00100000:3.0:1788574195.277438:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668943744 00000100:00100000:3.0:1788574195.277494:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 98 00000100:00100000:3.0:1788574195.277502:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:659467ff-94af-418e-92fe-11e4323a48aa+5:2395:x1875455668943744:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1788574195.277559:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:659467ff-94af-418e-92fe-11e4323a48aa+5:2395:x1875455668943744:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 58us (2451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574195.277567:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 98 00000100:00100000:2.0:1788574195.278704:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c820cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+13:2395:x1875455668943360:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 1643us (3730us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574195.278721:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 378 00000100:00080000:1.0:1788574195.278759:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788574195.347849:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574195.859463:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c364b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681621248:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788574195.859537:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574195.859665:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681621248 00000100:00100000:1.0:1788574195.859674:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681621248 00000100:00100000:1.0:1788574195.859743:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788574195.859755:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681621248:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788574195.859786:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788574195.859836:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681621248:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574195.859857:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00010000:00080000:1.0:1788574195.859905:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c364b100 x1875455681621248/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574211 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574195.859939:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c364b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681621248:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1788574195.860061:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788574195.864043:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85de9bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875455681621760:0@lo:400:kworker.0 00000100:00100000:3.0:1788574195.864132:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574195.864186:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3596a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681622272:0@lo:400:kworker.0 00000100:00100000:3.0:1788574195.864225:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574195.864241:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3594a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681622784:0@lo:400:kworker.0 00000100:00100000:3.0:1788574195.864258:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574195.864277:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788574195.864282:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faff2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681621632:0@lo:400:kworker.0 00000100:00100000:3.0:1788574195.864300:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574195.864314:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3594380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3620:1875455681622144:0@lo:400:kworker.0 00000100:00100000:3.0:1788574195.864329:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574195.864348:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3595c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3620:1875455681622656:0@lo:400:kworker.0 00000100:00100000:3.0:1788574195.864365:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574195.864396:0:8815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681622272 00000100:00100000:3.0:1788574195.864403:0:8815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681622272 00000100:00100000:3.0:1788574195.864439:0:8815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681622784 00000100:00100000:3.0:1788574195.864441:0:8815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681622784 00000100:00100000:3.0:1788574195.864469:0:8815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788574195.864476:0:8815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3594000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681622272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574195.864520:0:8815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3594000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681622272:12345-0@lo:400:kworker.0 Request processed in 44us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574195.864526:0:8815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788574195.864541:0:8815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788574195.864546:0:8815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3596300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681622784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574195.864566:0:8815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3596300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681622784:12345-0@lo:400:kworker.0 Request processed in 21us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574195.864571:0:8815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788574195.864592:0:7533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681621632 00000100:00100000:3.0:1788574195.864596:0:7533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681621632 00000100:00100000:3.0:1788574195.864619:0:7533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788574195.864624:0:7533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601835c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681621632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574195.864654:0:7533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601835c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681621632:12345-0@lo:400:kworker.0 Request processed in 29us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574195.864660:0:7533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788574195.864678:0:11893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681621760 00000100:00100000:3.0:1788574195.864682:0:11893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681621760 00000100:00100000:3.0:1788574195.864703:0:11893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681622144 00000100:00100000:3.0:1788574195.864706:0:11893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681622144 00000100:00100000:3.0:1788574195.864722:0:11893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681622656 00000100:00100000:3.0:1788574195.864725:0:11893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681622656 00000100:00100000:3.0:1788574195.864738:0:11893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1788574195.864743:0:11893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3596d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875455681621760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574195.864770:0:11893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3596d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875455681621760:12345-0@lo:400:kworker.0 Request processed in 26us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574195.864775:0:11893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1788574195.864785:0:11893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1788574195.864790:0:11893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601835500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875455681622144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574195.864813:0:11893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601835500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875455681622144:12345-0@lo:400:kworker.0 Request processed in 23us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574195.864818:0:11893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1788574195.864827:0:11893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1788574195.864832:0:11893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601835180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875455681622656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574195.864855:0:11893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601835180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875455681622656:12345-0@lo:400:kworker.0 Request processed in 23us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574195.864870:0:11893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00080000:3.0:1788574195.864897:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788574195.864902:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788574195.864933:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faff2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681621632:0@lo:400:kworker.0 00010000:00080000:3.0:1788574195.864946:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3594380 x1875455681622144/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574211 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574195.864957:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3594380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3620:1875455681622144:0@lo:400:kworker.0 00010000:00080000:3.0:1788574195.864967:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3595c00 x1875455681622656/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574211 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574195.864975:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3595c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3620:1875455681622656:0@lo:400:kworker.0 00000100:00100000:3.0:1788574195.864983:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85de9bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875455681621760:0@lo:400:kworker.0 00000100:00100000:3.0:1788574195.864991:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3596a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681622272:0@lo:400:kworker.0 00010000:00080000:3.0:1788574195.864999:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3594a80 x1875455681622784/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574211 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574195.865007:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3594a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681622784:0@lo:400:kworker.0 00000100:00100000:0.0:1788574195.865288:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85ffaf4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875455681621504:0@lo:400:kworker.0 00000100:00100000:0.0:1788574195.865319:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574195.865346:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3595880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3618:1875455681622016:0@lo:400:kworker.0 00000100:00100000:0.0:1788574195.865367:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574195.865392:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3597b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3618:1875455681622528:0@lo:400:kworker.0 00000100:00100000:0.0:1788574195.865410:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574195.865427:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1788574195.865432:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85ffaf6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:69505170-06bc-41d1-9626-ab1a3c7f32a0:3618:1875455681621376:0@lo:400:kworker.0 00000100:00100000:0.0:1788574195.865457:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574195.865477:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3594e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681621888:0@lo:400:kworker.0 00000100:00100000:0.0:1788574195.865496:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574195.865511:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3597800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681622400:0@lo:400:kworker.0 00000100:00100000:0.0:1788574195.865529:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574195.865544:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85ffafd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681622912:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788574195.865566:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574195.865592:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681621376 00000100:00100000:0.0:1788574195.865596:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681621376 00000100:00100000:0.0:1788574195.865625:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:0.0:1788574195.865632:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c820e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:3618:x1875455681621376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574195.865665:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c820e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:3618:x1875455681621376:12345-0@lo:400:kworker.0 Request processed in 34us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574195.865682:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:0.0:1788574195.865710:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681621888 00000100:00100000:0.0:1788574195.865714:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681621888 00000100:00100000:0.0:1788574195.865734:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788574195.865739:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffafdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681621888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574195.865769:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffafdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681621888:12345-0@lo:400:kworker.0 Request processed in 30us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574195.865774:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788574195.865791:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681621504 00000100:00100000:0.0:1788574195.865794:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681621504 00000100:00100000:0.0:1788574195.865813:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681622016 00000100:00100000:0.0:1788574195.865816:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681622016 00000100:00100000:0.0:1788574195.865834:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1788574195.865839:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffafc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875455681621504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574195.865866:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffafc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875455681621504:12345-0@lo:400:kworker.0 Request processed in 27us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574195.865872:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1788574195.865881:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681622528 00000100:00100000:0.0:1788574195.865883:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681622528 00000100:00100000:0.0:1788574195.865898:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1788574195.865904:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffafd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875455681622016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574195.865937:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffafd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875455681622016:12345-0@lo:400:kworker.0 Request processed in 33us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574195.865943:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1788574195.865955:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1788574195.865961:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffafc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875455681622528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574195.866004:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffafc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875455681622528:12345-0@lo:400:kworker.0 Request processed in 43us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574195.866010:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00080000:0.0:1788574195.866035:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788574195.866044:0:8815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681622400 00000100:00100000:0.0:1788574195.866048:0:8815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681622400 00000100:00100000:0.0:1788574195.866068:0:8815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788574195.866074:0:8815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffaff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681622400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574195.866101:0:8815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffaff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681622400:12345-0@lo:400:kworker.0 Request processed in 27us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574195.866106:0:8815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788574195.866131:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85ffaf6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:69505170-06bc-41d1-9626-ab1a3c7f32a0:3618:1875455681621376:0@lo:400:kworker.0 00000100:00100000:0.0:1788574195.866140:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3594e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681621888:0@lo:400:kworker.0 00000100:00100000:0.0:1788574195.866161:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3597800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681622400:0@lo:400:kworker.0 00000100:00100000:0.0:1788574195.866170:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85ffaf4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875455681621504:0@lo:400:kworker.0 00000100:00100000:0.0:1788574195.866178:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3595880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3618:1875455681622016:0@lo:400:kworker.0 00000100:00100000:0.0:1788574195.866185:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3597b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3618:1875455681622528:0@lo:400:kworker.0 00000100:00100000:1.0:1788574195.866318:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681622912 00000100:00100000:1.0:1788574195.866322:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681622912 00000100:00100000:1.0:1788574195.866358:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788574195.866365:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3658380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681622912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788574195.866381:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788574195.866420:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3658380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681622912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (852us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574195.866425:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00010000:00080000:1.0:1788574195.866454:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85ffafd180 x1875455681622912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574211 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574195.866468:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85ffafd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681622912:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788574196.371525:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574197.395354:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574198.419762:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574198.419981:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788574198.420005:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c365b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681623040:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788574198.420080:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574198.420650:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681623040 00000100:00100000:0.0:1788574198.420661:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681623040 00000100:00100000:0.0:1788574198.420726:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788574198.420736:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de9bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681623040:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788574198.420775:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788574198.420840:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de9bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681623040:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574198.420867:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788574198.421069:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c365b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681623040:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788574199.443853:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574199.956408:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c365a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681623168:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788574199.956489:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574199.956583:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788574199.956590:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c364b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681623296:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788574199.956622:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574199.956704:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681623296 00000100:00100000:1.0:1788574199.956713:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681623296 00000100:00100000:1.0:1788574199.956781:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788574199.956793:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa0e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681623296:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788574199.956823:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788574199.956875:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa0e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681623296:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574199.956882:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788574199.956928:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c364b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681623296:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788574199.957023:0:7533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681623168 00000100:00100000:0.0:1788574199.957028:0:7533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681623168 00000100:00100000:0.0:1788574199.957064:0:7533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788574199.957089:0:7533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa0e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681623168:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788574199.957112:0:7533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788574199.957152:0:7533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa0e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681623168:12345-0@lo:41:osp-pre-1-0.0 Request processed in 65us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574199.957158:0:7533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788574199.957289:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c365b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681623424:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788574199.957321:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574199.957509:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c365a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681623168:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788574199.957568:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681623424 00000100:00100000:0.0:1788574199.957573:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681623424 00000100:00100000:0.0:1788574199.957606:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788574199.957613:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3597b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681623424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788574199.957626:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788574199.957667:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3597b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681623424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 54us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574199.957674:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:2.0:1788574199.957861:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788574199.957980:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c365b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681623424:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788574200.392668:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574200.392713:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574200.392763:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574200.392810:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668944128 00000100:00100000:0.0:1788574200.392820:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668944384 00000100:00100000:2.0:1788574200.392826:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668944128 00000100:00100000:0.0:1788574200.392828:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668944384 00000100:00100000:2.0:1788574200.392893:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 380 00000100:00100000:2.0:1788574200.392904:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c820c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+13:2394:x1875455668944128:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1788574200.392941:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668944256 00000100:00100000:3.0:1788574200.392948:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668944256 00000100:00100000:2.0:1788574200.392986:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c820c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+13:2394:x1875455668944128:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 83us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574200.392994:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 380 00000100:00100000:0.0:1788574200.393014:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 276 00000100:00100000:0.0:1788574200.393025:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c364b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+5:2394:x1875455668944384:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1788574200.393080:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c364b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+5:2394:x1875455668944384:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 58us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574200.393086:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 276 00000100:00080000:1.0:1788574200.394349:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788574200.394360:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788574200.398796:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 277 00000100:00100000:3.0:1788574200.398814:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffafd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+5:2394:x1875455668944256:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1788574200.399353:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffafd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+5:2394:x1875455668944256:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 543us (6587us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574200.399364:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 277 00000100:00100000:1.0:1788574200.413340:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574200.413512:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668944512 00000100:00100000:3.0:1788574200.413524:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668944512 00000100:00100000:3.0:1788574200.413638:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 27 00000100:00100000:3.0:1788574200.413650:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3726a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:659467ff-94af-418e-92fe-11e4323a48aa+5:2392:x1875455668944512:12345-192.168.204.51@tcp:9:kworker.0 00000020:00000080:3.0:1788574200.413687:0:8409:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8c121 00000100:00080000:3.0:1788574200.413699:0:8409:0:(import.c:65:import_set_state_nolock()) ffff9c85faf2b800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788574200.413753:0:8409:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:2.0:1788574200.413929:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788574200.413938:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3726a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:659467ff-94af-418e-92fe-11e4323a48aa+2:2392:x1875455668944512:12345-192.168.204.51@tcp:9:kworker.0 Request processed in 290us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574200.413962:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 27 00010000:00010000:0.0:1788574200.414073:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574200.414670:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574200.414724:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574200.414803:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668944640 00000100:00100000:0.0:1788574200.414819:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668944640 00000100:00100000:0.0:1788574200.414889:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668944768 00000100:00100000:0.0:1788574200.414892:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668944768 00000100:00100000:0.0:1788574200.414916:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 278 00000100:00100000:0.0:1788574200.414924:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3724380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2393:x1875455668944640:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1788574200.414987:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3724380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2393:x1875455668944640:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 63us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574200.414994:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 278 00000100:00100000:0.0:1788574200.415007:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 279 00000100:00100000:0.0:1788574200.415013:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3725180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2393:x1875455668944768:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1788574200.415040:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3725180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2393:x1875455668944768:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 27us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574200.415046:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 279 00000100:00080000:2.0:1788574200.415280:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788574200.415285:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788574200.467463:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574200.979618:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:69505170-06bc-41d1-9626-ab1a3c7f32a0:3618:1875455681623552:0@lo:400:kworker.0 00000100:00100000:1.0:1788574200.979700:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574200.979722:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875455681623680:0@lo:400:kworker.0 00000100:00100000:1.0:1788574200.979759:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681624064:0@lo:400:kworker.0 00000100:00100000:2.0:1788574200.979767:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574200.979795:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3619:1875455681624192:0@lo:400:kworker.0 00000100:00100000:1.0:1788574200.979798:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574200.979828:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574200.979846:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681624576:0@lo:400:kworker.0 00000100:00100000:2.0:1788574200.979849:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1875455681624704:0@lo:400:kworker.0 00000100:00100000:2.0:1788574200.979886:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574200.979891:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574200.979908:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c2bdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681625216:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788574200.979919:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681625088:0@lo:400:kworker.0 00000100:00100000:2.0:1788574200.979939:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574200.979950:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574200.979966:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788574200.979969:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681623552 00000100:00100000:2.0:1788574200.979974:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681623808:0@lo:400:kworker.0 00000100:00100000:0.0:1788574200.979979:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681623552 00000100:00100000:1.0:1788574200.979993:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788574200.980003:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875455681623936:0@lo:400:kworker.0 00000100:00100000:2.0:1788574200.980010:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574200.980036:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:2.0:1788574200.980038:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1875455681624320:0@lo:400:kworker.0 00000100:00100000:1.0:1788574200.980041:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574200.980076:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681624448:0@lo:400:kworker.0 00000100:00100000:2.0:1788574200.980083:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574200.980108:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1875455681624832:0@lo:400:kworker.0 00000100:00100000:1.0:1788574200.980115:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574200.980136:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574200.980138:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681624960:0@lo:400:kworker.0 00000100:00100000:2.0:1788574200.980162:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681623680 00000100:00100000:2.0:1788574200.980168:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681623680 00000100:00100000:2.0:1788574200.980205:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681624192 00000100:00100000:2.0:1788574200.980208:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681624192 00000100:00100000:2.0:1788574200.980229:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681624704 00000100:00100000:2.0:1788574200.980232:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681624704 00000100:00100000:2.0:1788574200.980243:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681623936 00000100:00100000:2.0:1788574200.980246:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681623936 00000100:00100000:2.0:1788574200.980256:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681624320 00000100:00100000:2.0:1788574200.980258:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681624320 00000100:00100000:2.0:1788574200.980269:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681624832 00000100:00100000:2.0:1788574200.980279:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681624832 00000100:00100000:2.0:1788574200.980295:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1788574200.980301:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2bdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875455681623680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574200.980338:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c820c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:3618:x1875455681623552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574200.980363:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2bdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875455681623680:12345-0@lo:400:kworker.0 Request processed in 61us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574200.980371:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1788574200.980382:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c820c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:3618:x1875455681623552:12345-0@lo:400:kworker.0 Request processed in 335us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574200.980391:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1788574200.980392:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:2.0:1788574200.980403:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2bdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875455681624192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574200.980431:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681624064 00000100:00100000:0.0:1788574200.980436:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681624064 00000100:00100000:2.0:1788574200.980438:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2bdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875455681624192:12345-0@lo:400:kworker.0 Request processed in 37us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574200.980446:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1788574200.980462:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1788574200.980464:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681623808 00000100:00100000:0.0:1788574200.980468:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681623808 00000100:00100000:2.0:1788574200.980472:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2bdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875455681624704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574200.980488:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788574200.980496:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c2335880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681624064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574200.980508:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2bdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875455681624704:12345-0@lo:400:kworker.0 Request processed in 39us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574200.980516:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1788574200.980533:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1788574200.980535:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574200.980543:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c2335880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681624064:12345-0@lo:400:kworker.0 Request processed in 47us (745us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574200.980544:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa32a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875455681623936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574200.980560:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788574200.980576:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:69505170-06bc-41d1-9626-ab1a3c7f32a0:3618:1875455681623552:0@lo:400:kworker.0 00000100:00100000:0.0:1788574200.980577:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788574200.980587:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa32a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875455681623936:12345-0@lo:400:kworker.0 Request processed in 43us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574200.980588:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2bdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681623808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574200.980601:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1788574200.980610:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681624064:0@lo:400:kworker.0 00000100:00100000:2.0:1788574200.980618:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1788574200.980628:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2bdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875455681624320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574200.980634:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2bdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681623808:12345-0@lo:400:kworker.0 Request processed in 49us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574200.980642:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788574200.980647:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875455681623936:0@lo:400:kworker.0 00000100:00100000:2.0:1788574200.980669:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2bdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875455681624320:12345-0@lo:400:kworker.0 Request processed in 42us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574200.980670:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1788574200.980680:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2bdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875455681624832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574200.980695:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1788574200.980709:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681624576 00000100:00100000:1.0:1788574200.980714:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681624576 00000100:00080000:2.0:1788574200.980719:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788574200.980724:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788574200.980739:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681625088 00000100:00100000:3.0:1788574200.980793:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681624448 00000100:00100000:3.0:1788574200.980802:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681624448 00000100:00100000:3.0:1788574200.980821:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681624960 00000100:00100000:3.0:1788574200.980824:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681624960 00000100:00100000:3.0:1788574200.980846:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788574200.980854:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e56c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681624576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574200.980895:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681625088 00000100:00100000:1.0:1788574200.980919:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788574200.980926:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8ab1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681624448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574200.981912:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681623808:0@lo:400:kworker.0 00010000:00080000:2.0:1788574200.981930:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85faf3f480 x1875455681624320/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574216 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574200.981940:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1875455681624320:0@lo:400:kworker.0 00000100:00100000:2.0:1788574200.981953:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875455681623680:0@lo:400:kworker.0 00000100:00100000:2.0:1788574200.981963:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3619:1875455681624192:0@lo:400:kworker.0 00000100:00100000:2.0:1788574200.981974:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1875455681624704:0@lo:400:kworker.0 00000100:00100000:2.0:1788574200.981994:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788574200.982008:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8ab3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681625344:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788574200.982069:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574200.982158:0:8409:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1788574200.982166:0:8409:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00080000:2.0:1788574200.982185:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788574200.982248:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e56c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681624576:12345-0@lo:400:kworker.0 Request processed in 1393us (2357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574200.982255:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8ab1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681624448:12345-0@lo:400:kworker.0 Request processed in 1330us (2140us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574200.982257:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788574200.982261:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788574200.982278:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788574200.982282:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788574200.982670:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2bdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875455681624832:12345-0@lo:400:kworker.0 Request processed in 1867us (2409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574200.982680:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1788574200.983290:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681625216 00000100:00100000:0.0:1788574200.983415:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681625216 00000100:00100000:1.0:1788574200.985757:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa32b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3618:x1875455681625088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574200.985785:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681624448:0@lo:400:kworker.0 00000100:00100000:2.0:1788574200.985806:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681624576:0@lo:400:kworker.0 00000100:00100000:1.0:1788574200.985879:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa32b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3618:x1875455681625088:12345-0@lo:400:kworker.0 Request processed in 3590us (5928us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574200.985891:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00010000:00080000:2.0:1788574200.985897:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85faf5ce00 x1875455681625088/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574216 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574200.985910:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681625088:0@lo:400:kworker.0 00000100:00100000:1.0:1788574200.985935:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681625344 00000100:00100000:1.0:1788574200.985944:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681625344 00010000:00080000:2.0:1788574200.985949:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85faf3e300 x1875455681624832/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574216 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574200.985978:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1875455681624832:0@lo:400:kworker.0 00000100:00100000:1.0:1788574200.985982:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788574200.985993:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2bdca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3619:x1875455681625344:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788574200.986021:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788574200.986094:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2bdca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3619:x1875455681625344:12345-0@lo:13:osp-pre-1-1.0 Request processed in 102us (4024us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574200.986101:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00010000:00080000:1.0:1788574200.986155:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85c8ab3100 x1875455681625344/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574216 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574200.986180:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8ab3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681625344:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788574200.986293:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8ab1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681624960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574200.986346:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788574200.986356:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8ab1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681624960:12345-0@lo:400:kworker.0 Request processed in 4070us (5823us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574200.986358:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2bdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681625216:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788574200.986371:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00002000:00000024:0.0:1788574200.986377:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788574200.986431:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2bdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681625216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (6492us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574200.986439:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00010000:00080000:3.0:1788574200.986617:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85c2bdf100 x1875455681625216/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574216 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574200.986633:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c2bdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681625216:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1788574200.989572:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85faf5e680 x1875455681624960/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574216 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574200.989591:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681624960:0@lo:400:kworker.0 00010000:00010000:3.0:1788574201.491658:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574202.518794:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788574203.030907:0:13768:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788574203.539521:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c365b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681625472:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788574203.539613:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574203.539775:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681625472 00000100:00100000:0.0:1788574203.539783:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681625472 00000100:00100000:0.0:1788574203.539840:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788574203.539851:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2bdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681625472:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788574203.539889:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788574203.539957:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2bdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681625472:12345-0@lo:41:osp-pre-0-1.0 Request processed in 108us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574203.539964:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788574203.540439:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c365b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681625472:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788574203.540636:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788574203.987854:0:13764:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788574204.567835:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574205.075748:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8ab3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681625600:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788574205.075832:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574205.075937:0:7533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681625600 00000100:00100000:2.0:1788574205.075947:0:7533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681625600 00000100:00100000:3.0:1788574205.076013:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788574205.076027:0:7533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788574205.076030:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3595880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681625728:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788574205.076042:0:7533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8ab1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681625600:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788574205.076069:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:2.0:1788574205.076091:0:7533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788574205.076110:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681625728 00000100:00100000:3.0:1788574205.076115:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681625728 00000100:00100000:3.0:1788574205.076164:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788574205.076171:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3597800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681625728:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788574205.076221:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788574205.076353:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8ab3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681625600:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788574205.076513:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788574205.076532:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c365a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681625856:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788574205.077487:0:7533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8ab1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681625600:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1445us (1649us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574205.077497:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3597800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681625728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1326us (1427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574205.077497:0:7533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788574205.077503:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574205.077522:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788574205.077541:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681625856 00000100:00100000:3.0:1788574205.077548:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681625856 00000100:00100000:3.0:1788574205.077575:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788574205.077581:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8ab3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681625856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788574205.077598:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788574205.077754:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3595880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681625728:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788574205.078650:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8ab3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681625856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1065us (1146us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574205.078662:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:3.0:1788574205.078692:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788574205.078785:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c365a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681625856:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788574205.534947:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574205.534993:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574205.535021:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574205.535042:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574205.535065:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574205.535091:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668945024 00000100:00100000:2.0:1788574205.535100:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668945024 00000100:00100000:2.0:1788574205.535158:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668945280 00000100:00100000:2.0:1788574205.535161:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668945280 00000100:00100000:2.0:1788574205.535174:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668945152 00000100:00100000:2.0:1788574205.535177:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668945152 00000100:00100000:2.0:1788574205.535216:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668945408 00000100:00100000:2.0:1788574205.535219:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668945408 00000100:00100000:2.0:1788574205.535235:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 286 00000100:00100000:2.0:1788574205.535245:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2bddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+5:2396:x1875455668945024:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1788574205.535333:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2bddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+5:2396:x1875455668945024:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 90us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574205.535341:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 286 00000100:00100000:2.0:1788574205.535358:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 287 00000100:00100000:2.0:1788574205.535364:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2bdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2396:x1875455668945280:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1788574205.535386:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2bdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2396:x1875455668945280:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 23us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574205.535392:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 287 00000100:00100000:2.0:1788574205.535403:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 288 00000100:00100000:2.0:1788574205.535408:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2bdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+5:2396:x1875455668945152:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1788574205.535430:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2bdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+5:2396:x1875455668945152:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 22us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574205.535436:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 288 00000100:00100000:2.0:1788574205.535446:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 289 00000100:00100000:2.0:1788574205.535452:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2bde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2396:x1875455668945408:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1788574205.535473:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2bde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2396:x1875455668945408:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 22us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574205.535479:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 289 00000100:00100000:2.0:1788574205.535502:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668944896 00000100:00100000:2.0:1788574205.535506:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668944896 00000100:00100000:2.0:1788574205.535541:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 382 00000100:00100000:2.0:1788574205.535548:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c820e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+13:2396:x1875455668944896:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1788574205.535573:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c820e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+13:2396:x1875455668944896:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 26us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574205.535579:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 382 00000100:00080000:2.0:1788574205.535614:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788574205.535618:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788574205.592290:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574206.099480:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c2bded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875455681626112:0@lo:400:kworker.0 00000100:00100000:2.0:1788574206.099562:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574206.099620:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3618:1875455681626624:0@lo:400:kworker.0 00000100:00100000:2.0:1788574206.099644:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574206.099669:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3618:1875455681627136:0@lo:400:kworker.0 00000100:00100000:2.0:1788574206.099690:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574206.099714:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1788574206.099720:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c2bde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:69505170-06bc-41d1-9626-ab1a3c7f32a0:3618:1875455681625984:0@lo:400:kworker.0 00000100:00100000:2.0:1788574206.099751:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574206.099773:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c2bdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681626496:0@lo:400:kworker.0 00000100:00100000:2.0:1788574206.099796:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574206.099812:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681627008:0@lo:400:kworker.0 00000100:00100000:2.0:1788574206.099834:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574206.099851:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c26b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681627520:0@lo:400:kworker.0 00000100:00100000:2.0:1788574206.099871:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574206.099898:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c2bdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875455681626368:0@lo:400:kworker.0 00000100:00100000:2.0:1788574206.099921:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574206.099957:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681626880:0@lo:400:kworker.0 00000100:00100000:2.0:1788574206.099979:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574206.099995:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681627392:0@lo:400:kworker.0 00000100:00100000:2.0:1788574206.100012:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574206.100028:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788574206.100032:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c2bddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681626240:0@lo:400:kworker.0 00000100:00100000:2.0:1788574206.100048:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574206.100060:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3620:1875455681626752:0@lo:400:kworker.0 00000100:00100000:2.0:1788574206.100076:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574206.100090:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3620:1875455681627264:0@lo:400:kworker.0 00000100:00100000:2.0:1788574206.100106:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574206.100127:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681626112 00000100:00100000:2.0:1788574206.100134:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681626112 00000100:00100000:2.0:1788574206.100171:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681626624 00000100:00100000:2.0:1788574206.100173:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681626624 00000100:00100000:2.0:1788574206.100224:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681627136 00000100:00100000:2.0:1788574206.100227:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681627136 00000100:00100000:2.0:1788574206.100239:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681626368 00000100:00100000:2.0:1788574206.100242:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681626368 00000100:00100000:2.0:1788574206.100251:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681626752 00000100:00100000:2.0:1788574206.100253:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681626752 00000100:00100000:2.0:1788574206.100263:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681627264 00000100:00100000:2.0:1788574206.100265:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681627264 00000100:00100000:2.0:1788574206.100279:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1788574206.100288:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c26ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875455681626112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574206.100342:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c26ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875455681626112:12345-0@lo:400:kworker.0 Request processed in 55us (780us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574206.100349:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1788574206.100374:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1788574206.100380:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c26ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875455681626624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574206.100408:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c26ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875455681626624:12345-0@lo:400:kworker.0 Request processed in 29us (764us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574206.100414:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:2.0:1788574206.100425:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1788574206.100431:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c26bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875455681627136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574206.100457:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c26bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875455681627136:12345-0@lo:400:kworker.0 Request processed in 26us (766us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574206.100463:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1788574206.100474:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1788574206.100479:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c26b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875455681626368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574206.100507:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c26b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875455681626368:12345-0@lo:400:kworker.0 Request processed in 28us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574206.100513:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1788574206.100522:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1788574206.100529:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c26bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875455681626752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574206.100568:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c26bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875455681626752:12345-0@lo:400:kworker.0 Request processed in 40us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574206.100574:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1788574206.100586:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1788574206.100591:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c26b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875455681627264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574206.100615:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c26b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875455681627264:12345-0@lo:400:kworker.0 Request processed in 24us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574206.100621:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1788574206.100654:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681625984 00000100:00100000:2.0:1788574206.100658:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681625984 00000100:00100000:2.0:1788574206.100681:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:2.0:1788574206.100687:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c820f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:3618:x1875455681625984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574206.100716:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c820f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:3618:x1875455681625984:12345-0@lo:400:kworker.0 Request processed in 29us (964us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574206.100722:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:2.0:1788574206.100748:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681626496 00000100:00100000:2.0:1788574206.100751:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681626496 00000100:00100000:2.0:1788574206.100772:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681626240 00000100:00100000:2.0:1788574206.100775:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681626240 00000100:00100000:2.0:1788574206.100787:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788574206.100792:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c26b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681626496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574206.100823:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c26b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681626496:12345-0@lo:400:kworker.0 Request processed in 31us (1027us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574206.100830:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788574206.100840:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788574206.100846:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c26baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681626240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574206.100872:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c26baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681626240:12345-0@lo:400:kworker.0 Request processed in 27us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574206.100878:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788574206.100895:0:8815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681627008 00000100:00100000:2.0:1788574206.100898:0:8815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681627008 00000100:00100000:2.0:1788574206.100917:0:8815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681627520 00000100:00100000:2.0:1788574206.100919:0:8815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681627520 00000100:00100000:2.0:1788574206.100930:0:8815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681626880 00000100:00100000:2.0:1788574206.100933:0:8815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681626880 00000100:00100000:2.0:1788574206.100942:0:8815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681627392 00000100:00100000:2.0:1788574206.100945:0:8815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681627392 00000100:00100000:2.0:1788574206.100979:0:8815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788574206.100984:0:8815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c26b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681627008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574206.101016:0:8815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c26b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681627008:12345-0@lo:400:kworker.0 Request processed in 31us (1180us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574206.101021:0:8815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788574206.101031:0:8815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788574206.101036:0:8815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c26bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681627520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574206.101059:0:8815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c26bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681627520:12345-0@lo:400:kworker.0 Request processed in 23us (1187us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574206.101064:0:8815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788574206.101072:0:8815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788574206.101077:0:8815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c26b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681626880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574206.101098:0:8815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c26b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681626880:12345-0@lo:400:kworker.0 Request processed in 20us (1117us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574206.101103:0:8815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788574206.101111:0:8815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788574206.101116:0:8815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c26bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681627392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574206.101140:0:8815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c26bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681627392:12345-0@lo:400:kworker.0 Request processed in 24us (1127us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574206.101145:0:8815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:2.0:1788574206.101183:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788574206.101208:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788574206.101211:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788574206.101247:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c2bddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681626240:0@lo:400:kworker.0 00010000:00080000:2.0:1788574206.101260:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85faf5ce00 x1875455681626752/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574222 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574206.101283:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3620:1875455681626752:0@lo:400:kworker.0 00010000:00080000:2.0:1788574206.101295:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85faf3d180 x1875455681627264/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574222 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574206.101304:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3620:1875455681627264:0@lo:400:kworker.0 00000100:00100000:2.0:1788574206.101314:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c2bdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875455681626368:0@lo:400:kworker.0 00000100:00100000:2.0:1788574206.101323:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681626880:0@lo:400:kworker.0 00010000:00080000:2.0:1788574206.101332:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85faf3f480 x1875455681627392/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574222 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574206.101340:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681627392:0@lo:400:kworker.0 00000100:00100000:2.0:1788574206.101382:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c2bde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:69505170-06bc-41d1-9626-ab1a3c7f32a0:3618:1875455681625984:0@lo:400:kworker.0 00000100:00100000:2.0:1788574206.101391:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c2bdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681626496:0@lo:400:kworker.0 00000100:00100000:2.0:1788574206.101400:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681627008:0@lo:400:kworker.0 00010000:00080000:2.0:1788574206.101408:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c26b8e00 x1875455681627520/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574222 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574206.101415:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c26b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681627520:0@lo:400:kworker.0 00000100:00100000:2.0:1788574206.101424:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c2bded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875455681626112:0@lo:400:kworker.0 00000100:00100000:2.0:1788574206.101432:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3618:1875455681626624:0@lo:400:kworker.0 00000100:00100000:2.0:1788574206.101439:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3618:1875455681627136:0@lo:400:kworker.0 00000100:00100000:0.0:1788574206.101935:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788574206.101960:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c365a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681627648:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788574206.102003:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574206.102037:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681627648 00000100:00100000:0.0:1788574206.102042:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681627648 00000100:00100000:0.0:1788574206.102073:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788574206.102080:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c365b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681627648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788574206.102101:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788574206.102136:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c365b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681627648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574206.102142:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00010000:00080000:0.0:1788574206.102171:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c365a300 x1875455681627648/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574222 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574206.102184:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c365a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681627648:0@lo:13:osp-pre-1-0.0 00000001:00100000:0.0:1788574206.103309:0:8404:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 659467ff-94af-418e-92fe-11e4323a48aa 00000020:00000080:0.0:1788574206.103317:0:8404:0:(genops.c:885:class_export_put()) final put ffff9c85faf2c000/659467ff-94af-418e-92fe-11e4323a48aa 00000020:00000080:3.0:1788574206.103380:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85faf2c000/659467ff-94af-418e-92fe-11e4323a48aa for lustre-OST0000 00000020:00000080:3.0:1788574206.103431:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c85faf2b800 for lustre-OST0000 00000100:00100000:2.0:1788574206.105519:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788574206.105548:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c26b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681627776:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788574206.105618:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574206.105962:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681627776 00000100:00100000:0.0:1788574206.105970:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681627776 00000100:00100000:0.0:1788574206.106020:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788574206.106030:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c26bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681627776:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788574206.106054:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00010000:00080000:2.0:1788574206.106272:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c26b8e00 x1875455681627776/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574222 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574206.106291:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c26b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681627776:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788574206.106460:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c26bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681627776:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574206.106473:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00010000:00010000:0.0:1788574206.611963:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574207.635428:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574208.659688:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574208.668430:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788574208.668454:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c365a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681627904:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788574208.668530:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574208.668604:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681627904 00000100:00100000:0.0:1788574208.668612:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681627904 00000100:00100000:0.0:1788574208.668659:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788574208.668669:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffaf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681627904:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788574208.668704:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788574208.668752:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffaf4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681627904:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574208.668758:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788574208.668807:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c365a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681627904:0@lo:41:osp-pre-0-1.0 00000001:02000400:3.0:1788574208.779419:0:14037:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 22:10:06 (1788574206) 00010000:00010000:0.0:1788574209.683433:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574210.195478:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85ffaf6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681628032:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788574210.195554:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574210.195685:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681628032 00000100:00100000:0.0:1788574210.195694:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681628032 00000100:00100000:0.0:1788574210.195771:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788574210.195782:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c26b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681628032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788574210.195811:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788574210.195862:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c26b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681628032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574210.195880:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788574210.195925:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85ffaf6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681628032:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788574210.196183:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788574210.198380:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85ffaf6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681628160:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788574210.198454:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574210.198570:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681628160 00000100:00100000:0.0:1788574210.198591:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681628160 00000100:00100000:0.0:1788574210.198643:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788574210.198652:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c26b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681628160:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788574210.198685:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788574210.198740:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c26b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681628160:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574210.198747:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788574210.198909:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85ffaf6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681628160:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788574210.200056:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3594e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681628288:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788574210.200110:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574210.202233:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681628288 00000100:00100000:1.0:1788574210.202247:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681628288 00000100:00100000:1.0:1788574210.202383:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788574210.202393:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffaf6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681628288:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788574210.202423:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788574210.202507:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffaf6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681628288:12345-0@lo:13:osp-pre-0-1.0 Request processed in 115us (2395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574210.202514:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788574210.203315:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3594e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681628288:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788574210.204927:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788574210.633681:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574210.634053:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574210.634086:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574210.634117:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574210.634138:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574210.634229:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668945792 00000100:00100000:0.0:1788574210.634240:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668945792 00000100:00100000:0.0:1788574210.634301:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668946048 00000100:00100000:0.0:1788574210.634305:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668946048 00000100:00100000:0.0:1788574210.634317:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668945664 00000100:00100000:0.0:1788574210.634319:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668945664 00000100:00100000:0.0:1788574210.634330:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668945920 00000100:00100000:0.0:1788574210.634332:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668945920 00000100:00100000:0.0:1788574210.634348:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 296 00000100:00100000:0.0:1788574210.634357:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3594e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+5:2393:x1875455668945792:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1788574210.634442:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3594e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+5:2393:x1875455668945792:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 86us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574210.634451:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 296 00000100:00100000:0.0:1788574210.634468:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 297 00000100:00100000:0.0:1788574210.634475:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3594a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2393:x1875455668946048:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1788574210.634500:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3594a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2393:x1875455668946048:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 27us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574210.634506:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 297 00000100:00100000:0.0:1788574210.634535:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 298 00000100:00100000:0.0:1788574210.634541:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3596a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+5:2393:x1875455668945664:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1788574210.634565:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3596a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+5:2393:x1875455668945664:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 25us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574210.634571:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 298 00000100:00100000:0.0:1788574210.634582:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 299 00000100:00100000:0.0:1788574210.634588:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3595c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2393:x1875455668945920:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1788574210.634608:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3595c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2393:x1875455668945920:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 22us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574210.634614:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 299 00000100:00100000:1.0:1788574210.635155:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668945536 00000100:00100000:1.0:1788574210.635161:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668945536 00000100:00100000:1.0:1788574210.635222:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 384 00000100:00100000:1.0:1788574210.635230:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c860022b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+13:2393:x1875455668945536:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788574210.635264:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c860022b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+13:2393:x1875455668945536:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 35us (1593us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574210.635270:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 384 00000100:00080000:3.0:1788574210.635430:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788574210.635435:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788574210.707980:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574210.836155:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574210.836292:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668946176 00000100:00100000:0.0:1788574210.836301:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668946176 00000100:00100000:0.0:1788574210.836369:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 40 00000100:00100000:0.0:1788574210.836381:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3594380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+5:11080:x1875455668946176:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788574210.836404:0:7439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574210.836490:0:7439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c201 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6755 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574210.836560:0:7439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7400/0x5bf8706fdac8c208 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574210.836575:0:7439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7400/0x5bf8706fdac8c208 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574210.836588:0:7439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7400/0x5bf8706fdac8c208 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788574210.836655:0:7439:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788574210.836659:0:7439:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788574210.836699:0:7439:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7400/0x5bf8706fdac8c208 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574210.836725:0:7439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c201 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6755 expref: 7 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574210.836743:0:7439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7400/0x5bf8706fdac8c208 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6755 expref: 6 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574210.836752:0:7439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c85c6b83b00) 00010000:00010000:0.0:1788574210.836755:0:7439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788574210.836760:0:7439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d20d7400, rc 0) 00000100:00100000:0.0:1788574210.836837:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3594380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+6:11080:x1875455668946176:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 458us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574210.836844:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 40 00000100:00100000:2.0:1788574210.854453:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574210.854653:0:11893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668946304 00000100:00100000:0.0:1788574210.854664:0:11893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668946304 00000100:00100000:0.0:1788574210.854723:0:11893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 41 00000100:00100000:0.0:1788574210.854734:0:11893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c26b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:659467ff-94af-418e-92fe-11e4323a48aa+6:11081:x1875455668946304:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788574210.854754:0:11893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574210.854774:0:11893:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c20f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d675c expref: -99 pid: 11893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574210.854848:0:11893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8c216 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574210.854890:0:11893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8c216 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574210.854902:0:11893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8c216 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574210.854919:0:11893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c21d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574210.854926:0:11893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c21d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574210.854933:0:11893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c21d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574210.854993:0:11893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6e00/0x5bf8706fdac8c224 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574210.855002:0:11893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6e00/0x5bf8706fdac8c224 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574210.855010:0:11893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6e00/0x5bf8706fdac8c224 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788574210.855045:0:11893:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788574210.855049:0:11893:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788574210.855068:0:11893:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6e00/0x5bf8706fdac8c224 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574210.855079:0:11893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8c216 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574210.855096:0:11893:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8c216 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574210.855103:0:11893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8c216 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574210.855109:0:11893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d6400 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:0.0:1788574210.855113:0:11893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8c216 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574210.855122:0:11893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8c216 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574210.855134:0:11893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c85c6b83b00) 00010000:00010000:0.0:1788574210.855137:0:11893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574210.855142:0:11893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8c216 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574210.855148:0:11893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8c216 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574210.855172:0:11893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c21d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574210.855179:0:11893:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c21d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574210.855184:0:11893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c21d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574210.855236:0:11893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d6600 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:0.0:1788574210.855246:0:11893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c21d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574210.855253:0:11893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c21d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574210.855262:0:11893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9c85c6b83000) 00010000:00010000:0.0:1788574210.855265:0:11893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574210.855268:0:11893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c21d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574210.855275:0:11893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c21d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574210.855306:0:11893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c20f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d675c expref: 8 pid: 11893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574210.855320:0:11893:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6e00/0x5bf8706fdac8c224 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d675c expref: 7 pid: 11893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574210.855326:0:11893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9c85c6b83800) 00010000:00010000:0.0:1788574210.855329:0:11893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788574210.855331:0:11893:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d20d6e00, rc 0) 00000100:00100000:0.0:1788574210.855625:0:11893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c26b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:659467ff-94af-418e-92fe-11e4323a48aa+7:11081:x1875455668946304:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 892us (1181us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574210.855633:0:11893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 41 00000100:00100000:1.0:1788574210.860641:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574210.860739:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668946432 00000100:00100000:2.0:1788574210.860749:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668946432 00000100:00100000:2.0:1788574210.860820:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 7 00000100:00100000:2.0:1788574210.860831:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8ab1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:659467ff-94af-418e-92fe-11e4323a48aa+7:11081:x1875455668946432:12345-192.168.204.51@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1788574210.860940:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8ab1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:659467ff-94af-418e-92fe-11e4323a48aa+7:11081:x1875455668946432:12345-192.168.204.51@tcp:900:lhsmtool_posix.0 Request processed in 110us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574210.860948:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 7 00000100:00100000:1.0:1788574210.865012:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574210.865542:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668946688 00000100:00100000:2.0:1788574210.865553:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668946688 00000100:00100000:2.0:1788574210.865625:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 42 00000100:00100000:2.0:1788574210.865636:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+7:11081:x1875455668946688:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788574210.865673:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574210.865697:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ee00/0x5bf8706fdac8c22b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6763 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574210.866122:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8c232 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574210.866138:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8c232 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574210.866248:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8c232 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574210.866307:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e600/0x5bf8706fdac8c239 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574210.866316:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e600/0x5bf8706fdac8c239 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574210.866323:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e600/0x5bf8706fdac8c239 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574210.866565:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f800/0x5bf8706fdac8c240 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574210.866574:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f800/0x5bf8706fdac8c240 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574210.866581:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f800/0x5bf8706fdac8c240 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788574210.866590:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1788574210.866684:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8c232 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574210.866692:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8c232 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574210.866699:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8c232 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574210.866705:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32fe00 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:2.0:1788574210.866709:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8c232 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574210.866717:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8c232 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574210.866729:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9c85c6b83800) 00010000:00010000:2.0:1788574210.866732:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788574210.866737:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8c232 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574210.866743:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8c232 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574210.866756:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e600/0x5bf8706fdac8c239 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574210.866762:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e600/0x5bf8706fdac8c239 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574210.866768:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e600/0x5bf8706fdac8c239 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574210.866793:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32e600 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:2.0:1788574210.866796:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e600/0x5bf8706fdac8c239 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574210.866802:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e600/0x5bf8706fdac8c239 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574210.866810:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9c85c90c8300) 00010000:00010000:2.0:1788574210.866813:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788574210.866816:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e600/0x5bf8706fdac8c239 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574210.866821:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e600/0x5bf8706fdac8c239 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574210.868580:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ee00/0x5bf8706fdac8c22b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6763 expref: 10 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574210.868605:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f800/0x5bf8706fdac8c240 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6763 expref: 9 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574210.868614:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c85c90c8800) 00010000:00010000:2.0:1788574210.868617:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788574210.868620:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85fa32f800, rc 0) 00000100:00100000:2.0:1788574210.868685:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+9:11081:x1875455668946688:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 3051us (3682us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1788574210.868693:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 42 00000100:00100000:2.0:1788574210.880060:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574210.884127:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668946816 00000100:00100000:0.0:1788574210.884143:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668946816 00000100:00100000:0.0:1788574210.884393:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 43 00000100:00100000:0.0:1788574210.884405:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c26b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+9:11081:x1875455668946816:12345-192.168.204.51@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788574210.884543:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c26b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+9:11081:x1875455668946816:12345-192.168.204.51@tcp:59:lhsmtool_posix.0 Request processed in 140us (4492us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574210.884551:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 43 00000100:00100000:1.0:1788574210.892488:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574210.892923:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668946944 00000100:00100000:2.0:1788574210.892937:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668946944 00000100:00100000:2.0:1788574210.893027:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 44 00000100:00100000:2.0:1788574210.893039:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+5:11081:x1875455668946944:12345-192.168.204.51@tcp:59:lhsmtool_posix.0 00000004:00080000:0.0:1788574210.900143:0:6494:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 7040us 00000100:00100000:0.0:1788574210.919764:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+5:11081:x1875455668946944:12345-192.168.204.51@tcp:59:lhsmtool_posix.0 Request processed in 26714us (27277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574210.919783:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 44 00000040:00080000:3.0:1788574211.159623:0:13764:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788574211.219575:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c365a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681628416:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788574211.219587:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c26b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681628544:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788574211.219684:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1788574211.220896:0:13768:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788574211.221137:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681628416 00000100:00100000:2.0:1788574211.221146:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681628416 00000100:00100000:2.0:1788574211.221214:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788574211.221223:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3595880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681628416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788574211.221255:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788574211.221581:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8ab3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:69505170-06bc-41d1-9626-ab1a3c7f32a0:3618:1875455681628672:0@lo:400:kworker.0 00000100:00100000:2.0:1788574211.221799:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3595880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681628416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 576us (2118us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574211.221809:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:2.0:1788574211.221835:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788574211.221841:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c365a300 x1875455681628416/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574227 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574211.221884:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c365a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681628416:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788574211.221900:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574211.223154:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574211.223387:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8ab0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875455681628800:0@lo:400:kworker.0 00000100:00100000:3.0:1788574211.223445:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681628672 00000100:00100000:3.0:1788574211.223457:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681628672 00000100:00100000:3.0:1788574211.223522:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:3.0:1788574211.223532:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8600229850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:3618:x1875455681628672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574211.223617:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8600229850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:3618:x1875455681628672:12345-0@lo:400:kworker.0 Request processed in 86us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574211.223624:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:3.0:1788574211.223693:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8ab3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:69505170-06bc-41d1-9626-ab1a3c7f32a0:3618:1875455681628672:0@lo:400:kworker.0 00000100:00100000:3.0:1788574211.223718:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788574211.223728:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8ab0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875455681629056:0@lo:400:kworker.0 00000100:00100000:0.0:1788574211.223765:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574211.223778:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8ab3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681628928:0@lo:400:kworker.0 00000100:00100000:3.0:1788574211.223826:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574211.223886:0:7533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681628928 00000100:00100000:0.0:1788574211.223896:0:7533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681628928 00000100:00100000:3.0:1788574211.223923:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574211.223961:0:7533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788574211.223971:0:11893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681628800 00000100:00100000:0.0:1788574211.223973:0:7533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faff2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681628928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574211.223979:0:11893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681628800 00000100:00100000:3.0:1788574211.224015:0:11893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681629056 00000100:00100000:3.0:1788574211.224018:0:11893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681629056 00000100:00100000:3.0:1788574211.224040:0:11893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1788574211.224048:0:11893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c365a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875455681628800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574211.224093:0:11893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c365a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875455681628800:12345-0@lo:400:kworker.0 Request processed in 44us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574211.224111:0:11893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1788574211.224137:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1788574211.224150:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3d9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875455681629056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574211.224224:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8ab0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875455681628800:0@lo:400:kworker.0 00000100:00100000:2.0:1788574211.224264:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3d9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875455681629056:12345-0@lo:400:kworker.0 Request processed in 113us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574211.224276:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1788574211.224284:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8ab0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875455681629056:0@lo:400:kworker.0 00000100:00100000:0.0:1788574211.224297:0:7533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faff2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681628928:12345-0@lo:400:kworker.0 Request processed in 323us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574211.224306:0:7533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788574211.224334:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8ab3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681628928:0@lo:400:kworker.0 00000100:00100000:2.0:1788574211.224392:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681628544 00000100:00100000:2.0:1788574211.224398:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681628544 00000100:00100000:2.0:1788574211.224453:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788574211.224459:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681628544:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788574211.224477:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788574211.224515:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681628544:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (2617us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574211.224538:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00010000:00080000:2.0:1788574211.224574:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c26b8700 x1875455681628544/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574227 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574211.224592:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c26b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681628544:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788574211.225621:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681629568:0@lo:400:kworker.0 00000100:00100000:2.0:1788574211.225664:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574211.225693:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788574211.225699:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681629184:0@lo:400:kworker.0 00000100:00100000:2.0:1788574211.225720:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574211.225734:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c26b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681629696:0@lo:400:kworker.0 00000100:00100000:2.0:1788574211.225753:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574211.225782:0:8815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681629568 00000100:00100000:2.0:1788574211.225786:0:8815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681629568 00000100:00100000:2.0:1788574211.225826:0:8815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681629696 00000100:00100000:2.0:1788574211.225829:0:8815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681629696 00000100:00100000:2.0:1788574211.225847:0:8815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788574211.225868:0:8815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2bded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681629568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574211.225905:0:8815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2bded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681629568:12345-0@lo:400:kworker.0 Request processed in 38us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574211.225911:0:8815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788574211.226105:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3619:1875455681629312:0@lo:400:kworker.0 00000100:00100000:1.0:1788574211.226135:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574211.226153:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1875455681629824:0@lo:400:kworker.0 00000100:00100000:1.0:1788574211.226169:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574211.226185:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788574211.226208:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1875455681629440:0@lo:400:kworker.0 00000100:00100000:1.0:1788574211.226226:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574211.226241:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1875455681629952:0@lo:400:kworker.0 00000100:00100000:1.0:1788574211.226257:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574211.226280:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681629312 00000100:00100000:1.0:1788574211.226283:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681629312 00000100:00100000:1.0:1788574211.226310:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681629824 00000100:00100000:1.0:1788574211.226312:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681629824 00000100:00100000:1.0:1788574211.226325:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681629440 00000100:00100000:1.0:1788574211.226327:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681629440 00000100:00100000:1.0:1788574211.226338:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681629952 00000100:00100000:1.0:1788574211.226340:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681629952 00000100:00100000:1.0:1788574211.226353:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1788574211.226359:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8ab0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875455681629312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574211.226391:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8ab0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875455681629312:12345-0@lo:400:kworker.0 Request processed in 32us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574211.226397:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1788574211.226410:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1788574211.226415:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8ab1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875455681629824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574211.226454:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8ab1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875455681629824:12345-0@lo:400:kworker.0 Request processed in 39us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574211.226460:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1788574211.226470:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1788574211.226475:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8ab0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875455681629440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574211.226500:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8ab0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875455681629440:12345-0@lo:400:kworker.0 Request processed in 25us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574211.226507:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1788574211.226520:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1788574211.226526:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8ab0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875455681629952:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788574211.226538:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788574211.226549:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788574211.226556:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788574211.226561:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8ab0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875455681629952:12345-0@lo:400:kworker.0 Request processed in 33us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574211.226569:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00010000:00080000:1.0:1788574211.226618:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85faf3e300 x1875455681629440/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574227 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574211.226631:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1875455681629440:0@lo:400:kworker.0 00010000:00080000:1.0:1788574211.226640:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85faf5ce00 x1875455681629952/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574227 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574211.226648:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1875455681629952:0@lo:400:kworker.0 00000100:00100000:1.0:1788574211.226657:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3619:1875455681629312:0@lo:400:kworker.0 00000100:00100000:1.0:1788574211.226663:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf5e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1875455681629824:0@lo:400:kworker.0 00000100:00100000:2.0:1788574211.226875:0:8815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788574211.226884:0:8815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2bde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681629696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574211.226917:0:8815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2bde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681629696:12345-0@lo:400:kworker.0 Request processed in 36us (1165us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574211.227257:0:8815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788574211.227287:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681629184 00000100:00100000:2.0:1788574211.227292:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681629184 00000100:00100000:2.0:1788574211.227315:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788574211.227321:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2bdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681629184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574211.227357:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2bdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681629184:12345-0@lo:400:kworker.0 Request processed in 37us (1637us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574211.227363:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788574211.227399:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681629184:0@lo:400:kworker.0 00000100:00100000:2.0:1788574211.227410:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c26b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681629696:0@lo:400:kworker.0 00000100:00100000:2.0:1788574211.227419:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681629568:0@lo:400:kworker.0 00010000:00010000:2.0:1788574211.731594:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574212.757551:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574213.071101:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574213.071639:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668947072 00000100:00100000:0.0:1788574213.071654:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668947072 00000100:00100000:0.0:1788574213.071787:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 45 00000100:00100000:0.0:1788574213.071802:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3d9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+9:11123:x1875455668947072:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:0.0:1788574213.071898:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574213.071926:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7c00/0x5bf8706fdac8c24e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d676a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574213.072018:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8c255 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574213.072039:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8c255 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574213.072055:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8c255 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574213.072072:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8c25c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574213.072080:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8c25c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574213.072087:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8c25c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574213.072150:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8c255 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574213.072158:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8c255 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574213.072165:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8c255 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574213.072171:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d7200 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:0.0:1788574213.072182:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8c255 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574213.072222:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8c255 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574213.072399:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c85c6b83b00) 00010000:00010000:0.0:1788574213.072403:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574213.072409:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8c255 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574213.072417:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8c255 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574213.072432:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8c25c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574213.072439:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8c25c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574213.072444:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8c25c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574213.072449:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d6800 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:0.0:1788574213.072453:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8c25c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574213.072458:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8c25c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574213.072465:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9c85c6b83000) 00010000:00010000:0.0:1788574213.072467:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574213.072476:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8c25c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574213.072483:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8c25c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574213.072541:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7c00/0x5bf8706fdac8c24e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d676a expref: 10 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574213.072552:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c85c6b83b00) 00010000:00010000:0.0:1788574213.072555:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574213.072559:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7c00/0x5bf8706fdac8c24e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d676a expref: 10 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574213.072568:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d20d7c00, rc 0) 00000100:00100000:0.0:1788574213.072661:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3d9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+9:11123:x1875455668947072:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 862us (1749us total) trans 0 rc 301/301 00000100:00100000:0.0:1788574213.072669:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 45 00000100:00080000:3.0:1788574213.073029:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788574213.094901:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574213.094958:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668947328 00000100:00100000:2.0:1788574213.094972:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668947328 00000100:00100000:2.0:1788574213.095043:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 46 00000100:00100000:2.0:1788574213.095056:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2bdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+9:11123:x1875455668947328:12345-192.168.204.51@tcp:36:lfs.0 00010000:00010000:2.0:1788574213.095130:0:7439:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788574213.095166:0:7439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7400/0x5bf8706fdac8c208 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6755 expref: 9 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574213.095186:0:7439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c85c6b83b00) 00010000:00010000:2.0:1788574213.095215:0:7439:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788574213.095300:0:7439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ea00/0x5bf8706fdac8c263 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574213.095317:0:7439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ea00/0x5bf8706fdac8c263 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574213.095343:0:7439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ea00/0x5bf8706fdac8c263 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574213.095357:0:7439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e400/0x5bf8706fdac8c26a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574213.095380:0:7439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e400/0x5bf8706fdac8c26a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574213.095387:0:7439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e400/0x5bf8706fdac8c26a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574213.100053:0:7439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f000/0x5bf8706fdac8c271 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574213.100084:0:7439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f000/0x5bf8706fdac8c271 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574213.100098:0:7439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f000/0x5bf8706fdac8c271 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788574213.100118:0:7439:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006336ab4b reply state 000000002b2722bc transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f000/0x5bf8706fdac8c271 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574213.100130:0:7439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f000/0x5bf8706fdac8c271 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574213.100138:0:7439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c85ec19ac00) 00010000:00010000:2.0:1788574213.100141:0:7439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788574213.100146:0:7439:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788574213.100153:0:7439:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1788574213.100163:0:7439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ea00/0x5bf8706fdac8c263 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574213.102823:0:7439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ea00/0x5bf8706fdac8c263 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574213.102835:0:7439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ea00/0x5bf8706fdac8c263 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574213.102842:0:7439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32ea00 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:2.0:1788574213.102849:0:7439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ea00/0x5bf8706fdac8c263 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574213.102860:0:7439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ea00/0x5bf8706fdac8c263 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574213.102880:0:7439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c85ec19a800) 00010000:00010000:2.0:1788574213.102883:0:7439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788574213.102888:0:7439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ea00/0x5bf8706fdac8c263 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574213.102896:0:7439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ea00/0x5bf8706fdac8c263 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788574213.102920:0:7439:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006336ab4b reply state 000000002b2722bc transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e400/0x5bf8706fdac8c26a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574213.102934:0:7439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e400/0x5bf8706fdac8c26a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574213.102942:0:7439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9c85ec19ad00) 00010000:00010000:2.0:1788574213.102945:0:7439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788574213.102948:0:7439:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1788574213.103133:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2bdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+10:11123:x1875455668947328:12345-192.168.204.51@tcp:36:lfs.0 Request processed in 8071us (8239us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1788574213.103156:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 46 00000100:00100000:2.0:1788574213.182871:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574213.188040:0:11893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668947456 00000100:00100000:1.0:1788574213.188062:0:11893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668947456 00000100:00100000:1.0:1788574213.188239:0:11893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 47 00000100:00100000:1.0:1788574213.188253:0:11893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2bddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:659467ff-94af-418e-92fe-11e4323a48aa+10:11131:x1875455668947456:12345-192.168.204.51@tcp:101:lctl.0 00010000:00010000:1.0:1788574213.188298:0:11893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574213.188329:0:11893:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8c278 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6771 expref: -99 pid: 11893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574213.188417:0:11893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8c27f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574213.188433:0:11893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8c27f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574213.188447:0:11893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8c27f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788574213.188513:0:11893:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788574213.188517:0:11893:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788574213.188576:0:11893:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8c27f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574213.188609:0:11893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8c278 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6771 expref: 12 pid: 11893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574213.188630:0:11893:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8c27f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6771 expref: 11 pid: 11893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574213.188639:0:11893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c84c34f0a00) 00010000:00010000:1.0:1788574213.188641:0:11893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788574213.188645:0:11893:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85faea2200, rc 0) 00000100:00100000:1.0:1788574213.188744:0:11893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2bddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:659467ff-94af-418e-92fe-11e4323a48aa+11:11131:x1875455668947456:12345-192.168.204.51@tcp:101:lctl.0 Request processed in 495us (5887us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574213.188759:0:11893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 47 00000040:00080000:3.0:1788574213.204019:0:13764:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1788574213.268111:0:13768:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788574213.279935:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574213.280065:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668947584 00000100:00100000:0.0:1788574213.280079:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668947584 00000100:00100000:0.0:1788574213.280160:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 48 00000100:00100000:0.0:1788574213.280173:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8ab2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+11:11137:x1875455668947584:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:0.0:1788574213.280232:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574213.280262:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7c00/0x5bf8706fdac8c286 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6778 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574213.280347:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8c28d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574213.280387:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8c28d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574213.280402:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8c28d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574213.280415:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8c294 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574213.280423:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8c294 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574213.280430:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8c294 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574213.280531:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7400/0x5bf8706fdac8c29b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574213.280540:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7400/0x5bf8706fdac8c29b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574213.280547:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7400/0x5bf8706fdac8c29b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788574213.280591:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1788574213.280595:0:6494:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788574213.280645:0:6494:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7400/0x5bf8706fdac8c29b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574213.280661:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8c28d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574213.280679:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8c28d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574213.280687:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8c28d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574213.280694:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d6800 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:0.0:1788574213.280698:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8c28d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574213.280707:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8c28d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574213.280722:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c84c34f0a00) 00010000:00010000:0.0:1788574213.280725:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574213.280731:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8c28d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574213.280738:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8c28d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574213.280756:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8c294 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574213.280762:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8c294 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574213.280769:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8c294 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574213.280774:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d7200 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:0.0:1788574213.280783:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8c294 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574213.280790:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8c294 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574213.280798:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9c85ec19ad00) 00010000:00010000:0.0:1788574213.280801:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574213.280804:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8c294 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574213.280826:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8c294 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574213.280857:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7c00/0x5bf8706fdac8c286 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6778 expref: 13 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574213.280872:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7400/0x5bf8706fdac8c29b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6778 expref: 12 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574213.280880:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c85ec19ac00) 00010000:00010000:0.0:1788574213.280883:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788574213.280885:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d20d7400, rc 0) 00000100:00100000:0.0:1788574213.280973:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8ab2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+12:11137:x1875455668947584:12345-192.168.204.51@tcp:101:bash.0 Request processed in 803us (1057us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574213.280982:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 48 00000100:00100000:3.0:1788574213.284536:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574213.284742:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668947840 00000100:00100000:2.0:1788574213.284756:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668947840 00000100:00100000:2.0:1788574213.284868:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 49 00000100:00100000:2.0:1788574213.284881:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3d98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+12:11137:x1875455668947840:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:2.0:1788574213.284909:0:7439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574213.284936:0:7439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f400/0x5bf8706fdac8c2a2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d677f expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574213.285247:0:7439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f200/0x5bf8706fdac8c2a9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574213.285269:0:7439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f200/0x5bf8706fdac8c2a9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574213.285282:0:7439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f200/0x5bf8706fdac8c2a9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574213.285616:0:7439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ea00/0x5bf8706fdac8c2b0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574213.285643:0:7439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ea00/0x5bf8706fdac8c2b0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574213.285658:0:7439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ea00/0x5bf8706fdac8c2b0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788574213.286090:0:7439:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:2.0:1788574213.286339:0:7439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ec00/0x5bf8706fdac8c2b7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574213.286351:0:7439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ec00/0x5bf8706fdac8c2b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574213.286360:0:7439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ec00/0x5bf8706fdac8c2b7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574213.286395:0:7439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f200/0x5bf8706fdac8c2a9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574213.286403:0:7439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f200/0x5bf8706fdac8c2a9 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574213.286410:0:7439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f200/0x5bf8706fdac8c2a9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574213.286417:0:7439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32f200 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:2.0:1788574213.286423:0:7439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f200/0x5bf8706fdac8c2a9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574213.286431:0:7439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f200/0x5bf8706fdac8c2a9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574213.286443:0:7439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c85ec19ac00) 00010000:00010000:2.0:1788574213.286446:0:7439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788574213.286452:0:7439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f200/0x5bf8706fdac8c2a9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574213.286459:0:7439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f200/0x5bf8706fdac8c2a9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788574213.286486:0:7439:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005085e1cb reply state 0000000061ae9517 transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ea00/0x5bf8706fdac8c2b0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574213.286499:0:7439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ea00/0x5bf8706fdac8c2b0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574213.286506:0:7439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c85ec19a800) 00010000:00010000:2.0:1788574213.286508:0:7439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788574213.286513:0:7439:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788574213.286556:0:7439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f400/0x5bf8706fdac8c2a2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d677f expref: 15 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574213.286573:0:7439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ec00/0x5bf8706fdac8c2b7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d677f expref: 14 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574213.286580:0:7439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c85ec19a900) 00010000:00010000:2.0:1788574213.286582:0:7439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788574213.286585:0:7439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85fa32ec00, rc 0) 00000100:00100000:2.0:1788574213.286673:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3d98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+15:11137:x1875455668947840:12345-192.168.204.51@tcp:101:bash.0 Request processed in 1795us (2153us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1788574213.286683:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 49 00000100:00100000:2.0:1788574213.293752:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574213.293796:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668947968 00000100:00100000:3.0:1788574213.293826:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668947968 00000100:00100000:3.0:1788574213.293905:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 28 00000100:00100000:3.0:1788574213.293916:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c26b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2392:x1875455668947968:12345-192.168.204.51@tcp:8:bash.0 00010000:00080000:3.0:1788574213.293968:0:8410:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 659467ff-94af-418e-92fe-11e4323a48aa@192.168.204.51@tcp t0 exp 0000000000000000 cur 353 last 0 00000020:00000080:3.0:1788574213.294016:0:8410:0:(genops.c:1385:class_connect()) connect: client 659467ff-94af-418e-92fe-11e4323a48aa, cookie 0x5bf8706fdac8c2c5 00002000:00100000:3.0:1788574213.294032:0:8410:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 659467ff-94af-418e-92fe-11e4323a48aa/ffff9c85ffb64800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788574213.294058:0:8410:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788574213.294263:0:8410:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788574213.294318:0:8410:0:(import.c:65:import_set_state_nolock()) ffff9c85ffb67800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788574213.294491:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c26b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:659467ff-94af-418e-92fe-11e4323a48aa+6:2392:x1875455668947968:12345-192.168.204.51@tcp:8:bash.0 Request processed in 575us (752us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574213.294501:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 28 00000100:00100000:1.0:1788574213.302748:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574213.302917:0:8815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668948096 00000100:00100000:2.0:1788574213.302941:0:8815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668948096 00000100:00080000:3.0:1788574213.303079:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788574213.303175:0:8815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 29 00000100:00100000:2.0:1788574213.303229:0:8815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8ab2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:659467ff-94af-418e-92fe-11e4323a48aa+6:0:x1875455668948096:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:2.0:1788574213.303256:0:8815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574213.303299:0:8815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a6d2d339/0x5bf8706fdac8c2cc lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6786 expref: -99 pid: 8815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788574213.303326:0:8815:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788574213.303352:0:8815:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=353s v=(0 0) 00010000:00010000:2.0:1788574213.303357:0:8815:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574213.303367:0:8815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6d2d339/0x5bf8706fdac8c2cc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6786 expref: 7 pid: 8815 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574213.303392:0:8815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a6d2d339/0x5bf8706fdac8c2cc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6786 expref: 7 pid: 8815 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574213.303405:0:8815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85fa32f200, rc 0) 00000100:00100000:2.0:1788574213.303484:0:8815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8ab2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:659467ff-94af-418e-92fe-11e4323a48aa+7:0:x1875455668948096:12345-192.168.204.51@tcp:101:bash.0 Request processed in 297us (753us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574213.303491:0:8815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 29 00000100:00100000:3.0:1788574213.306371:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574213.312601:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668948224 00000100:00100000:0.0:1788574213.312623:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668948224 00000100:00100000:0.0:1788574213.312752:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 30 00000100:00100000:0.0:1788574213.312766:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3d9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:659467ff-94af-418e-92fe-11e4323a48aa+7:11137:x1875455668948224:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:0.0:1788574213.312819:0:8411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574213.313441:0:8411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2739887/0x5bf8706fdac8c2d3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d678d expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574213.313484:0:8411:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a6d2d339/0x5bf8706fdac8c2cc lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6786 expref: 8 pid: 8815 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574213.313494:0:8411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788574213.313499:0:8411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788574213.313505:0:8411:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2739887/0x5bf8706fdac8c2d3 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d678d expref: 8 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574213.313573:0:8411:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a6d2d339/0x5bf8706fdac8c2cc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6786 expref: 8 pid: 8815 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574213.313589:0:8411:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a6d2d339/0x5bf8706fdac8c2cc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6786 expref: 8 pid: 8815 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574213.313604:0:8411:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85d10dce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8411:1875455681630080:192.168.204.51@tcp:104: 00000100:00100000:0.0:1788574213.313742:0:8411:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c3e48cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788574213.321396:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574213.322688:0:8411:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85d10dce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8411:1875455681630080:192.168.204.51@tcp:104: 00010000:00010000:0.0:1788574213.322731:0:8411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e2739887/0x5bf8706fdac8c2d3 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d678d expref: 8 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574213.322755:0:8411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d20d7c00, rc 0) 00000100:00100000:1.0:1788574213.323016:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3d9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:659467ff-94af-418e-92fe-11e4323a48aa+8:11137:x1875455668948224:12345-192.168.204.51@tcp:101:bash.0 Request processed in 10252us (16659us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574213.323026:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 30 00000100:00100000:2.0:1788574213.329281:0:7433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668948352 00000100:00100000:2.0:1788574213.329310:0:7433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668948352 00010000:00010000:2.0:1788574213.329380:0:7433:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a6d2d339/0x5bf8706fdac8c2cc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6786 expref: 8 pid: 8815 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574213.329434:0:7433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 52 00000100:00100000:2.0:1788574213.329445:0:7433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e0b7b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:659467ff-94af-418e-92fe-11e4323a48aa+8:2393:x1875455668948352:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788574213.329460:0:7433:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788574213.329484:0:7433:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a6d2d339/0x5bf8706fdac8c2cc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6786 expref: 8 pid: 8815 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574213.329518:0:7433:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a6d2d339/0x5bf8706fdac8c2cc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6786 expref: 8 pid: 8815 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574213.329543:0:7433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a6d2d339/0x5bf8706fdac8c2cc lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6786 expref: 8 pid: 8815 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574213.329560:0:7433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574213.329564:0:7433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574213.329573:0:7433:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e2739887/0x5bf8706fdac8c2d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d678d expref: 7 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574213.329583:0:7433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2739887/0x5bf8706fdac8c2d3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d678d expref: 7 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574213.329641:0:7433:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e2739887/0x5bf8706fdac8c2d3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d678d expref: 7 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574213.329655:0:7433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85d10d4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7433:1875455681630208:192.168.204.51@tcp:105: 00000100:00100000:2.0:1788574213.329752:0:7433:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85fafee180 going to sleep for 11 seconds 00000100:00100000:3.0:1788574213.335700:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574213.335773:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668948608 00000100:00100000:1.0:1788574213.335782:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668948608 00000100:00100000:1.0:1788574213.335854:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 6 00000100:00100000:1.0:1788574213.335865:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3d98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:659467ff-94af-418e-92fe-11e4323a48aa+15:11137:x1875455668948608:12345-192.168.204.51@tcp:35:bash.0 00000100:00100000:0.0:1788574213.336240:0:7433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85d10d4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7433:1875455681630208:192.168.204.51@tcp:105: 00010000:00010000:0.0:1788574213.336264:0:7433:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788574213.345739:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3d98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:659467ff-94af-418e-92fe-11e4323a48aa+16:11137:x1875455668948608:12345-192.168.204.51@tcp:35:bash.0 Request processed in 9862us (10035us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1788574213.345757:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 6 00000100:00100000:0.0:1788574213.349961:0:7433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e0b7b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:659467ff-94af-418e-92fe-11e4323a48aa+7:2393:x1875455668948352:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 20502us (28846us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574213.349980:0:7433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 52 00000100:00100000:2.0:1788574213.445708:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574213.446369:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668948864 00000100:00100000:1.0:1788574213.446386:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668948864 00000100:00100000:1.0:1788574213.446475:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 50 00000100:00100000:1.0:1788574213.446488:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85d10d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+16:11147:x1875455668948864:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:1.0:1788574213.446524:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574213.446551:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c2da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6794 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788574213.446704:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1788574213.447153:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c2da lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6794 expref: 18 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574213.447174:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c84c34f0a00) 00010000:00010000:1.0:1788574213.447270:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788574213.447279:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c2da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6794 expref: 18 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574213.447297:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85faea2e00, rc 0) 00000100:00100000:1.0:1788574213.447386:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85d10d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+17:11147:x1875455668948864:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 900us (1693us total) trans 4294967315 rc 301/301 00000100:00100000:1.0:1788574213.447481:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 50 00000100:00100000:0.0:1788574213.450670:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574213.450932:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668949120 00000100:00100000:1.0:1788574213.450945:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668949120 00000100:00100000:1.0:1788574213.451089:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 7 00000100:00100000:1.0:1788574213.451102:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85d10dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:659467ff-94af-418e-92fe-11e4323a48aa+17:11147:x1875455668949120:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:1.0:1788574213.451441:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85d10dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:659467ff-94af-418e-92fe-11e4323a48aa+18:11147:x1875455668949120:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 341us (784us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1788574213.451450:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 7 00000100:00100000:3.0:1788574213.552089:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574213.552312:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668949248 00000100:00100000:1.0:1788574213.552326:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668949248 00000100:00100000:1.0:1788574213.552414:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 51 00000100:00100000:1.0:1788574213.552427:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3d98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+18:11153:x1875455668949248:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:1.0:1788574213.552462:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574213.552491:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c2e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d679b expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574213.552589:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c2ef lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574213.552608:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c2ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574213.552642:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c2ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788574213.552702:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1788574213.552707:0:6493:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788574213.552731:0:6493:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c2ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574213.552766:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c2e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d679b expref: 20 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574213.552789:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c2ef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d679b expref: 19 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574213.552801:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c85ec19ac00) 00010000:00010000:1.0:1788574213.552814:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788574213.552819:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85faea2000, rc 0) 00000100:00100000:1.0:1788574213.552905:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3d98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+19:11153:x1875455668949248:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 481us (833us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574213.552914:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 51 00000100:00100000:3.0:1788574213.558920:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574213.559224:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668949504 00000100:00100000:2.0:1788574213.559239:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668949504 00000100:00100000:2.0:1788574213.559379:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 52 00000100:00100000:2.0:1788574213.559393:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3d99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+19:11153:x1875455668949504:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:2.0:1788574213.559444:0:7439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574213.559472:0:7439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f200/0x5bf8706fdac8c2f6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d67a2 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574213.559626:0:7439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fa00/0x5bf8706fdac8c2fd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574213.559645:0:7439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fa00/0x5bf8706fdac8c2fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574213.559659:0:7439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fa00/0x5bf8706fdac8c2fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788574213.559673:0:7439:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788574213.559838:0:7439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f200/0x5bf8706fdac8c2f6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d67a2 expref: 22 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574213.559862:0:7439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fa00/0x5bf8706fdac8c2fd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d67a2 expref: 21 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574213.559872:0:7439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c85ec19a900) 00010000:00010000:2.0:1788574213.559876:0:7439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788574213.559880:0:7439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85fa32fa00, rc 0) 00000100:00100000:2.0:1788574213.559978:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3d99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+21:11153:x1875455668949504:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 588us (1072us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1788574213.559988:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 52 00000100:00100000:0.0:1788574213.564352:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574213.564516:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668949760 00000100:00100000:1.0:1788574213.564532:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668949760 00000100:00100000:1.0:1788574213.564613:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 53 00000100:00100000:1.0:1788574213.564625:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85d10de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+21:11153:x1875455668949760:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:1.0:1788574213.564664:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574213.564690:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c30b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d67a9 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574213.564868:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8c312 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574213.564888:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8c312 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574213.564903:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8c312 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788574213.564920:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788574213.565082:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c30b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d67a9 expref: 24 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574213.565105:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8c312 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d67a9 expref: 23 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574213.565114:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c85ec19a900) 00010000:00010000:1.0:1788574213.565118:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788574213.565122:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85faea3e00, rc 0) 00000100:00100000:1.0:1788574213.565247:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85d10de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+23:11153:x1875455668949760:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 624us (912us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1788574213.565255:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 53 00000100:00100000:3.0:1788574213.565670:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574213.566418:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668949888 00000100:00100000:1.0:1788574213.566429:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668949888 00000100:00100000:1.0:1788574213.566512:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 3 00000100:00100000:1.0:1788574213.566524:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3d98700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:659467ff-94af-418e-92fe-11e4323a48aa+23:2393:x1875455668949888:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788574213.566541:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574213.566581:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fa00/0x5bf8706fdac8c2fd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d67a2 expref: 23 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574213.566600:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c85ec19a900) 00010000:00010000:1.0:1788574213.566605:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788574213.566831:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3d98700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:659467ff-94af-418e-92fe-11e4323a48aa+22:2393:x1875455668949888:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 308us (1160us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574213.566839:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 3 00000100:00100000:2.0:1788574213.575257:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574213.575397:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668950016 00000100:00100000:3.0:1788574213.575412:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668950016 00000100:00100000:3.0:1788574213.575511:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 31 00000100:00100000:3.0:1788574213.575527:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85d10d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:659467ff-94af-418e-92fe-11e4323a48aa+7:2394:x1875455668950016:12345-192.168.204.51@tcp:1:lfs.0 00010000:00010000:3.0:1788574213.575605:0:8410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008db64c4d/0x5bf8706fdac8c320 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574213.575632:0:8410:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e2739887/0x5bf8706fdac8c2d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d678d expref: 7 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574213.575642:0:8410:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574213.575647:0:8410:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788574213.575653:0:8410:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008db64c4d/0x5bf8706fdac8c320 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574213.575700:0:8410:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e2739887/0x5bf8706fdac8c2d3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d678d expref: 7 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574213.575718:0:8410:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e2739887/0x5bf8706fdac8c2d3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d678d expref: 7 pid: 8411 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574213.575977:0:8410:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3d98e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8410:1875455681630336:192.168.204.51@tcp:104: 00000100:00100000:3.0:1788574213.576114:0:8410:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c267e180 going to sleep for 11 seconds 00000100:00100000:3.0:1788574213.581913:0:8410:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3d98e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8410:1875455681630336:192.168.204.51@tcp:104: 00010000:00010000:3.0:1788574213.581960:0:8410:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008db64c4d/0x5bf8706fdac8c320 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574213.589276:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574213.589737:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668950144 00000100:00100000:3.0:1788574213.589757:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668950144 00002000:00100000:3.0:1788574213.589845:0:8414:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff9c85d10d6d80 x1875455668950144/t0(0) o4->659467ff-94af-418e-92fe-11e4323a48aa@192.168.204.51@tcp:364/0 lens 504/0 e 0 to 0 dl 1788574224 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788574213.589860:0:8414:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c85d10d6d80 with x1875455668950144 ext(0->12) 00010000:00010000:3.0:1788574213.589874:0:8414:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000e2739887/0x5bf8706fdac8c2d3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d678d expref: 8 pid: 8411 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574213.589895:0:8414:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000e2739887/0x5bf8706fdac8c2d3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d678d expref: 8 pid: 8411 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788574213.589906:0:8414:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9c85d10d6d80 00000100:00100000:3.0:1788574213.589955:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 0 00000100:00100000:3.0:1788574213.589967:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85d10d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:659467ff-94af-418e-92fe-11e4323a48aa+8:2394:x1875455668950144:12345-192.168.204.51@tcp:4:lfs.0 00000001:00100000:1.0:1788574213.598974:0:9487:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 659467ff-94af-418e-92fe-11e4323a48aa 00000100:00100000:3.0:1788574213.600909:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85d10d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:659467ff-94af-418e-92fe-11e4323a48aa+9:2394:x1875455668950144:12345-192.168.204.51@tcp:4:lfs.0 Request processed in 10927us (11626us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788574213.600927:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 0 00002000:00100000:3.0:1788574213.600963:0:8414:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff9c85d10d6d80 x1875455668950144/t4294967300(0) o4->659467ff-94af-418e-92fe-11e4323a48aa@192.168.204.51@tcp:364/0 lens 504/448 e 0 to 0 dl 1788574224 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788574213.600974:0:8414:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c85d10d6d80 with x1875455668950144 ext(0->12) 00010000:00010000:3.0:1788574213.600986:0:8414:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000e2739887/0x5bf8706fdac8c2d3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d678d expref: 9 pid: 8411 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574213.601012:0:8414:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000e2739887/0x5bf8706fdac8c2d3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d678d expref: 9 pid: 8411 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788574213.601020:0:8414:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9c85d10d6d80 00000100:00100000:2.0:1788574213.616180:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574213.616547:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668950272 00000100:00100000:0.0:1788574213.616561:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668950272 00010000:00010000:0.0:1788574213.616631:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e2739887/0x5bf8706fdac8c2d3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d678d expref: 9 pid: 8411 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574213.616685:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 53 00000100:00100000:0.0:1788574213.616698:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85d10d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:659467ff-94af-418e-92fe-11e4323a48aa+9:2396:x1875455668950272:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788574213.616718:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788574213.616745:0:6479:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788574213.616749:0:6479:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1788574212 00002000:00010000:0.0:1788574213.616752:0:6479:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb atime from disk: 0 -> 1788574213 00002000:00010000:0.0:1788574213.616754:0:6479:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1788574212 00002000:00010000:0.0:1788574213.616757:0:6479:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1788574213.616764:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e2739887/0x5bf8706fdac8c2d3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d678d expref: 9 pid: 8411 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574213.616783:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e2739887/0x5bf8706fdac8c2d3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d678d expref: 9 pid: 8411 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574213.616829:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2739887/0x5bf8706fdac8c2d3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d678d expref: 9 pid: 8411 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574213.616862:0:6479:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788574213.616867:0:6479:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788574213.616873:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008db64c4d/0x5bf8706fdac8c320 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574213.616886:0:6479:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008db64c4d/0x5bf8706fdac8c320 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574213.616924:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574213.616994:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85d10d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:659467ff-94af-418e-92fe-11e4323a48aa+8:2396:x1875455668950272:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 299us (830us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574213.617004:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 53 00010000:00010000:0.0:1788574213.617052:0:8410:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008db64c4d/0x5bf8706fdac8c320 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574213.617063:0:8410:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008db64c4d/0x5bf8706fdac8c320 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574213.617088:0:8410:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008db64c4d/0x5bf8706fdac8c320 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574213.617098:0:8410:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008db64c4d/0x5bf8706fdac8c320 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574213.617106:0:8410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008db64c4d/0x5bf8706fdac8c320 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574213.617122:0:8410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c84c2617400 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:0.0:1788574213.617127:0:8410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008db64c4d/0x5bf8706fdac8c320 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574213.617138:0:8410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008db64c4d/0x5bf8706fdac8c320 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574213.617151:0:8410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008db64c4d/0x5bf8706fdac8c320 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574213.617159:0:8410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008db64c4d/0x5bf8706fdac8c320 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574213.617258:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85d10d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:659467ff-94af-418e-92fe-11e4323a48aa+7:2394:x1875455668950016:12345-192.168.204.51@tcp:1:lfs.0 Request processed in 41736us (42019us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574213.617268:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 31 00000100:00100000:3.0:1788574213.626307:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574213.630252:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668950528 00000100:00100000:2.0:1788574213.630277:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668950528 00000100:00100000:2.0:1788574213.630381:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 8 00000100:00100000:2.0:1788574213.630393:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3d98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:659467ff-94af-418e-92fe-11e4323a48aa+22:11153:x1875455668950528:12345-192.168.204.51@tcp:35:lfs.0 00000004:00010000:2.0:1788574213.630492:0:6496:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8c312 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d67a9 expref: 22 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788574213.630822:0:6496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:2.0:1788574213.630875:0:6496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1788574213.631294:0:6496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:2.0:1788574213.631339:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ee00/0x5bf8706fdac8c327 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574213.631360:0:6496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ec00/0x5bf8706fdac8c2b7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d677f expref: 26 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574213.631369:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ee00/0x5bf8706fdac8c327 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574213.631412:0:6496:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ec00/0x5bf8706fdac8c2b7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d677f expref: 26 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574213.631429:0:6496:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ec00/0x5bf8706fdac8c2b7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d677f expref: 26 pid: 7439 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574213.631446:0:6496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85d10d5880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6496:1875455681630464:192.168.204.51@tcp:104: 00000100:00100000:2.0:1788574213.631602:0:6496:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85fafeecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788574213.637034:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574213.637517:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668950656 00000100:00100000:0.0:1788574213.637531:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668950656 00010000:00010000:0.0:1788574213.637594:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ec00/0x5bf8706fdac8c2b7 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d677f expref: 27 pid: 7439 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574213.637731:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 54 00000100:00100000:0.0:1788574213.637746:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85d10d7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:659467ff-94af-418e-92fe-11e4323a48aa+27:2393:x1875455668950656:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788574213.637769:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574213.637778:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ec00/0x5bf8706fdac8c2b7 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d677f expref: 27 pid: 7439 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574213.637826:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ec00/0x5bf8706fdac8c2b7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d677f expref: 27 pid: 7439 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574213.637858:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c85ec19a900) 00010000:00010000:0.0:1788574213.637864:0:6478:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ee00/0x5bf8706fdac8c327 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574213.637876:0:6478:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ee00/0x5bf8706fdac8c327 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574213.637885:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ee00/0x5bf8706fdac8c327 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574213.637939:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574213.638031:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85d10d7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:659467ff-94af-418e-92fe-11e4323a48aa+27:2393:x1875455668950656:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 287us (1012us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574213.638040:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 54 00010000:00010000:1.0:1788574213.643719:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ec00/0x5bf8706fdac8c2b7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d677f expref: 26 pid: 7439 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574213.643756:0:6496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85d10d5880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6496:1875455681630464:192.168.204.51@tcp:104: 00010000:00010000:1.0:1788574213.643795:0:6496:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ee00/0x5bf8706fdac8c327 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574213.643952:0:6496:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ee00/0x5bf8706fdac8c327 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574213.643959:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ee00/0x5bf8706fdac8c327 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788574213.644122:0:6496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:1.0:1788574213.644292:0:6496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:1.0:1788574213.644602:0:6496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8ab2d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6496:1875455681630592:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788574213.644696:0:6496:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574213.644751:0:6496:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c3277180 going to sleep for 11 seconds 00000100:00100000:2.0:1788574213.645169:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681630592 00000100:00100000:2.0:1788574213.645212:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681630592 00000100:00100000:2.0:1788574213.645308:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788574213.645321:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8ab3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6496:x1875455681630592:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788574213.645454:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8ab3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6496:x1875455681630592:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 135us (757us total) trans 0 rc 0/0 00000100:00080000:3.0:1788574213.645518:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788574213.645588:0:6496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8ab2d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6496:1875455681630592:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788574213.645625:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000001:00080000:2.0:1788574213.646438:0:6496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:2.0:1788574213.646535:0:6496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85d10d5500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6496:1875455681630720:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788574213.646609:0:6496:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574213.646651:0:6496:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85fafeecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788574213.647070:0:7533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681630720 00000100:00100000:1.0:1788574213.647096:0:7533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681630720 00000100:00100000:1.0:1788574213.647155:0:7533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1788574213.647165:0:7533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85d10d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6496:x1875455681630720:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788574213.649833:0:7533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85d10d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6496:x1875455681630720:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 2659us (3212us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788574213.649852:0:7533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788574213.651993:0:6496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85d10d5500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6496:1875455681630720:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788574213.652117:0:6496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:2.0:1788574213.652228:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ee00/0x5bf8706fdac8c327 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574213.652241:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ee00/0x5bf8706fdac8c327 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574213.652250:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ee00/0x5bf8706fdac8c327 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574213.652257:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32ee00 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:2.0:1788574213.652263:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ee00/0x5bf8706fdac8c327 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574213.652273:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ee00/0x5bf8706fdac8c327 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574213.652293:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c85ec19a900) 00010000:00010000:2.0:1788574213.652308:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788574213.652334:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ee00/0x5bf8706fdac8c327 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574213.652342:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ee00/0x5bf8706fdac8c327 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788574213.652639:0:6496:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788574213.652724:0:6496:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1788574213.652740:0:6496:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 353632549479ns, next at 354632545449ns, rc = 0 00000001:00080000:2.0:1788574213.652747:0:6496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:2.0:1788574213.652777:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c85ec19a900) 00010000:00010000:2.0:1788574213.652781:0:6496:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788574213.652789:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8c312 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d67a9 expref: 30 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574213.652957:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3d98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:659467ff-94af-418e-92fe-11e4323a48aa+29:11153:x1875455668950528:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 22563us (26663us total) trans 4294967327 rc 0/0 00000100:00100000:2.0:1788574213.652969:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 8 00000020:00080000:2.0:1788574213.652976:0:6496:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788574213.656880:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574213.657126:0:11893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668950784 00000100:00100000:3.0:1788574213.657141:0:11893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668950784 00000100:00100000:3.0:1788574213.657731:0:11893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 54 00000100:00100000:3.0:1788574213.657748:0:11893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85d10d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:659467ff-94af-418e-92fe-11e4323a48aa+29:11153:x1875455668950784:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:3.0:1788574213.657786:0:11893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574213.657830:0:11893:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8c32e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d67b0 expref: -99 pid: 11893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574213.657909:0:11893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8c32e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d67b0 expref: 30 pid: 11893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574213.657929:0:11893:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8c32e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d67b0 expref: 30 pid: 11893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574213.657978:0:11893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c85d5185900) 00010000:00010000:3.0:1788574213.657982:0:11893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788574213.657988:0:11893:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c84c2617000, rc 0) 00000100:00100000:3.0:1788574213.658075:0:11893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85d10d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:659467ff-94af-418e-92fe-11e4323a48aa+30:11153:x1875455668950784:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 334us (1211us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574213.658083:0:11893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 54 00000100:00100000:2.0:1788574213.662339:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574213.664442:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668951040 00000100:00100000:1.0:1788574213.665127:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668951040 00000100:00100000:2.0:1788574213.665414:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 9 00000100:00100000:2.0:1788574213.665428:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85d01f5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:659467ff-94af-418e-92fe-11e4323a48aa+30:11153:x1875455668951040:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:2.0:1788574213.665946:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85d01f5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:659467ff-94af-418e-92fe-11e4323a48aa+31:11153:x1875455668951040:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 518us (3620us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1788574213.665956:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 9 00000100:00100000:3.0:1788574213.782416:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788574213.782451:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85d10de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681630848:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788574213.782584:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574213.784540:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681630848 00000100:00100000:1.0:1788574213.784563:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681630848 00000100:00100000:1.0:1788574213.784660:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788574213.784673:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3d9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681630848:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788574213.784726:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446301696 avail 1300062208 00000100:00100000:1.0:1788574213.784870:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3d9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681630848:12345-0@lo:41:osp-pre-0-1.0 Request processed in 200us (2286us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574213.784879:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00010000:00010000:0.0:1788574213.785414:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574213.797145:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85d10de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681630848:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788574213.802541:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574213.802673:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668951296 00000100:00100000:1.0:1788574213.802687:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668951296 00000100:00100000:1.0:1788574213.802890:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 55 00000100:00100000:1.0:1788574213.802904:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85d10d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+31:11164:x1875455668951296:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:1.0:1788574213.802938:0:7439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574213.802968:0:7439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c335 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d67b7 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788574213.803114:0:7439:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1788574213.803325:0:7439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c335 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d67b7 expref: 33 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574213.803369:0:7439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c84c34f0a00) 00010000:00010000:1.0:1788574213.803372:0:7439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788574213.803379:0:7439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c335 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d67b7 expref: 33 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574213.803397:0:7439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85faea2e00, rc 0) 00000100:00100000:1.0:1788574213.803875:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85d10d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+32:11164:x1875455668951296:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 972us (1421us total) trans 4294967329 rc 301/301 00000100:00100000:1.0:1788574213.803886:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 55 00000100:00100000:0.0:1788574213.812837:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574213.812967:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668951424 00000100:00100000:1.0:1788574213.812982:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668951424 00000100:00100000:1.0:1788574213.813068:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 56 00000100:00100000:1.0:1788574213.813082:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85d10de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+32:11164:x1875455668951424:12345-192.168.204.51@tcp:34:lfs.0 00010000:00010000:1.0:1788574213.813254:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c343 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574213.813278:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c343 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574213.813296:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c343 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574213.813311:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2c00/0x5bf8706fdac8c34a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574213.813319:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2c00/0x5bf8706fdac8c34a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574213.813354:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2c00/0x5bf8706fdac8c34a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574213.813619:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8c351 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574213.813629:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8c351 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574213.813637:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8c351 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788574213.813721:0:6492:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8c351 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574213.813739:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c343 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574213.813747:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c343 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574213.814029:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c343 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574213.814035:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85faea2e00 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:1.0:1788574213.814040:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c343 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574213.814049:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c343 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574213.814065:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c85ec19ac00) 00010000:00010000:1.0:1788574213.814077:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788574213.814084:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c343 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574213.814092:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c343 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574213.814112:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2c00/0x5bf8706fdac8c34a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574213.814119:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2c00/0x5bf8706fdac8c34a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574213.814125:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2c00/0x5bf8706fdac8c34a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574213.814131:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85faea2c00 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:1.0:1788574213.814134:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2c00/0x5bf8706fdac8c34a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574213.814140:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2c00/0x5bf8706fdac8c34a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574213.814148:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c85ec19a800) 00010000:00010000:1.0:1788574213.814151:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788574213.814154:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2c00/0x5bf8706fdac8c34a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574213.814160:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2c00/0x5bf8706fdac8c34a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574213.814170:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8c351 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574213.814181:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8c351 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574213.814692:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8c351 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574213.814704:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85faea3800 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:1.0:1788574213.814708:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8c351 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574213.814715:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8c351 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574213.814724:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c85d5185900) 00010000:00010000:1.0:1788574213.814727:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788574213.814730:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8c351 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574213.814736:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8c351 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574213.814888:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85d10de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+32:11164:x1875455668951424:12345-192.168.204.51@tcp:34:lfs.0 Request processed in 1806us (2365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574213.814900:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 56 00000100:00100000:3.0:1788574213.818887:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574213.823006:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668951680 00000100:00100000:1.0:1788574213.823034:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668951680 00000100:00100000:1.0:1788574213.823145:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 10 00000100:00100000:1.0:1788574213.823159:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3d9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:659467ff-94af-418e-92fe-11e4323a48aa+32:11164:x1875455668951680:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:1.0:1788574213.824624:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3d9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:659467ff-94af-418e-92fe-11e4323a48aa+33:11164:x1875455668951680:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 1458us (5742us total) trans 4294967330 rc 0/0 00000100:00100000:1.0:1788574213.824652:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 10 00000100:00100000:3.0:1788574213.909139:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574213.909283:0:11893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668951936 00000100:00100000:1.0:1788574213.909301:0:11893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668951936 00000100:00100000:1.0:1788574213.909391:0:11893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 57 00000100:00100000:1.0:1788574213.909403:0:11893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3d9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:659467ff-94af-418e-92fe-11e4323a48aa+33:11167:x1875455668951936:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:1.0:1788574213.909430:0:11893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574213.909453:0:11893:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8c358 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d67be expref: -99 pid: 11893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574213.909544:0:11893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2c00/0x5bf8706fdac8c35f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574213.909560:0:11893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2c00/0x5bf8706fdac8c35f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574213.909572:0:11893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2c00/0x5bf8706fdac8c35f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574213.909583:0:11893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c366 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574213.909590:0:11893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c366 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574213.909597:0:11893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c366 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574213.909708:0:11893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8c36d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574213.909735:0:11893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8c36d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574213.909743:0:11893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8c36d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788574213.909754:0:11893:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788574213.909849:0:11893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2c00/0x5bf8706fdac8c35f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574213.909857:0:11893:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2c00/0x5bf8706fdac8c35f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574213.909862:0:11893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2c00/0x5bf8706fdac8c35f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574213.909868:0:11893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85faea2c00 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:1.0:1788574213.909872:0:11893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2c00/0x5bf8706fdac8c35f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574213.909880:0:11893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2c00/0x5bf8706fdac8c35f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574213.909891:0:11893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c85ec19ac00) 00010000:00010000:1.0:1788574213.909894:0:11893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788574213.909899:0:11893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2c00/0x5bf8706fdac8c35f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574213.909905:0:11893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2c00/0x5bf8706fdac8c35f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574213.909918:0:11893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c366 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574213.909931:0:11893:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c366 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574213.909937:0:11893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c366 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574213.909942:0:11893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85faea2e00 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:1.0:1788574213.909945:0:11893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c366 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574213.909952:0:11893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c366 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574213.909960:0:11893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c85ec19a800) 00010000:00010000:1.0:1788574213.909962:0:11893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788574213.909965:0:11893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c366 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574213.909971:0:11893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c366 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574213.910008:0:11893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8c358 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d67be expref: 36 pid: 11893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574213.910022:0:11893:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8c36d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d67be expref: 35 pid: 11893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574213.910029:0:11893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c85d5185900) 00010000:00010000:1.0:1788574213.910032:0:11893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788574213.910042:0:11893:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85faea3e00, rc 0) 00000100:00100000:1.0:1788574213.910134:0:11893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3d9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:659467ff-94af-418e-92fe-11e4323a48aa+35:11167:x1875455668951936:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 732us (1012us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1788574213.910142:0:11893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 57 00000100:00100000:0.0:1788574213.921724:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574213.923657:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668952064 00000100:00100000:1.0:1788574213.923682:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668952064 00000100:00100000:1.0:1788574213.923775:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 58 00000100:00100000:1.0:1788574213.923787:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85d10ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+35:11167:x1875455668952064:12345-192.168.204.51@tcp:54:lfs.0 00010000:00010000:1.0:1788574213.924059:0:7439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8c37b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574213.924084:0:7439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8c37b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574213.924099:0:7439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8c37b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574213.924153:0:7439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8c37b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574213.924161:0:7439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8c37b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574213.924169:0:7439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8c37b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574213.924174:0:7439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85faea3800 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:1.0:1788574213.924180:0:7439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8c37b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574213.924275:0:7439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8c37b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574213.924310:0:7439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c85d5185900) 00010000:00010000:1.0:1788574213.924314:0:7439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788574213.924320:0:7439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8c37b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574213.924327:0:7439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8c37b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574213.925654:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85d10ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+35:11167:x1875455668952064:12345-192.168.204.51@tcp:54:lfs.0 Request processed in 1855us (3930us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574213.925674:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 58 00000100:00100000:2.0:1788574213.936276:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574213.936752:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668952320 00000100:00100000:0.0:1788574213.936766:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668952320 00000100:00100000:0.0:1788574213.937002:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 11 00000100:00100000:0.0:1788574213.937025:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85d10d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:659467ff-94af-418e-92fe-11e4323a48aa+35:11167:x1875455668952320:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:0.0:1788574213.938712:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85d10d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:659467ff-94af-418e-92fe-11e4323a48aa+36:11167:x1875455668952320:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 1677us (2440us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1788574213.938730:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 11 00000100:00100000:3.0:1788574214.361432:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574214.361544:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668952576 00000100:00100000:1.0:1788574214.361560:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668952576 00000100:00100000:1.0:1788574214.361647:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 59 00000100:00100000:1.0:1788574214.361661:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3d99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+36:11198:x1875455668952576:12345-192.168.204.51@tcp:101:cat.0 00010000:00010000:1.0:1788574214.361699:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574214.361729:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8c382 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d67c5 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574214.361885:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c389 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574214.361903:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c389 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574214.361920:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c389 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788574214.361932:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788574214.362123:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8c382 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d67c5 expref: 39 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574214.362180:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c389 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d67c5 expref: 38 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574214.362269:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c85d5185900) 00010000:00010000:1.0:1788574214.362273:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788574214.362278:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85faea2e00, rc 0) 00000100:00100000:1.0:1788574214.362363:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3d99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+38:11198:x1875455668952576:12345-192.168.204.51@tcp:101:cat.0 Request processed in 706us (948us total) trans 4294967333 rc 0/0 00000100:00100000:1.0:1788574214.362372:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 59 00000100:00100000:2.0:1788574214.375327:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574214.375515:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574214.376970:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668952832 00000100:00100000:0.0:1788574214.376972:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668952960 00000100:00100000:0.0:1788574214.376990:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668952960 00000100:00100000:1.0:1788574214.376996:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668952832 00000100:00100000:1.0:1788574214.377081:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 12 00000100:00100000:1.0:1788574214.377094:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85d10d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:659467ff-94af-418e-92fe-11e4323a48aa+39:11198:x1875455668952832:12345-192.168.204.51@tcp:35:cat.0 00000100:00100000:0.0:1788574214.377524:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 4 00000100:00100000:0.0:1788574214.377536:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85d10d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:659467ff-94af-418e-92fe-11e4323a48aa+40:2393:x1875455668952960:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788574214.377551:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574214.377583:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c389 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d67c5 expref: 40 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574214.377604:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c85d5185900) 00010000:00010000:0.0:1788574214.377610:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574214.377744:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85d10d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:659467ff-94af-418e-92fe-11e4323a48aa+39:2393:x1875455668952960:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 210us (2229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574214.377753:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 4 00000100:00100000:1.0:1788574214.386812:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85d10d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:659467ff-94af-418e-92fe-11e4323a48aa+38:11198:x1875455668952832:12345-192.168.204.51@tcp:35:cat.0 Request processed in 9689us (11468us total) trans 4294967334 rc 0/0 00000100:00100000:1.0:1788574214.386834:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 12 00000100:00100000:3.0:1788574214.446478:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574214.446628:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668953216 00000100:00100000:1.0:1788574214.446642:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668953216 00000100:00100000:1.0:1788574214.446728:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 60 00000100:00100000:1.0:1788574214.446741:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3d99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+38:11204:x1875455668953216:12345-192.168.204.51@tcp:101:dd.0 00010000:00010000:1.0:1788574214.446779:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574214.446783:0:6493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788574214.446840:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c2ef lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d679b expref: 38 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574214.446892:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c85ec19ac00) 00010000:00010000:1.0:1788574214.446900:0:6493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788574214.446919:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8c397 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d67cc expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574214.447068:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2c00/0x5bf8706fdac8c39e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574214.447085:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8c36d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d67be expref: 38 pid: 11893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574214.447094:0:6493:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2c00/0x5bf8706fdac8c39e lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574214.447140:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8c36d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d67be expref: 38 pid: 11893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574214.447156:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8c36d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d67be expref: 38 pid: 11893 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574214.447173:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8ab0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6493:1875455681630976:192.168.204.51@tcp:104: 00000100:00100000:1.0:1788574214.447388:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c3277a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788574214.451317:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8ab0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6493:1875455681630976:192.168.204.51@tcp:104: 00010000:00010000:1.0:1788574214.451370:0:6493:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2c00/0x5bf8706fdac8c39e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574214.452481:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574214.453505:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668953344 00000100:00100000:1.0:1788574214.453537:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668953344 00010000:00010000:1.0:1788574214.453595:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8c36d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d67be expref: 39 pid: 11893 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574214.453692:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 55 00000100:00100000:1.0:1788574214.453704:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3d9b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:659467ff-94af-418e-92fe-11e4323a48aa+39:2394:x1875455668953344:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788574214.453725:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574214.453734:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8c36d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d67be expref: 39 pid: 11893 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574214.453750:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8c36d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d67be expref: 39 pid: 11893 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574214.453778:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8c36d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d67be expref: 39 pid: 11893 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574214.453808:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c85d5185900) 00010000:00010000:1.0:1788574214.453815:0:6477:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2c00/0x5bf8706fdac8c39e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574214.453826:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2c00/0x5bf8706fdac8c39e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574214.453837:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2c00/0x5bf8706fdac8c39e lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574214.453880:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788574214.453965:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3d9b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:659467ff-94af-418e-92fe-11e4323a48aa+38:2394:x1875455668953344:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 263us (1490us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574214.453984:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 55 00010000:00010000:3.0:1788574214.455747:0:6493:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2c00/0x5bf8706fdac8c39e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574214.455770:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2c00/0x5bf8706fdac8c39e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788574214.455811:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788574214.456064:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8c397 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d67cc expref: 39 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574214.456092:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2c00/0x5bf8706fdac8c39e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d67cc expref: 38 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574214.456124:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c85d5185900) 00010000:00010000:3.0:1788574214.456127:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788574214.456131:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85faea2c00, rc 0) 00000100:00100000:3.0:1788574214.456555:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3d99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+38:11204:x1875455668953216:12345-192.168.204.51@tcp:101:dd.0 Request processed in 9813us (10089us total) trans 4294967335 rc 0/0 00000100:00100000:3.0:1788574214.456566:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 60 00000100:00100000:3.0:1788574214.460175:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574214.460268:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668953472 00000100:00100000:3.0:1788574214.460281:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668953472 00000100:00100000:3.0:1788574214.460359:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 61 00000100:00100000:3.0:1788574214.460481:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3d99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+38:11204:x1875455668953472:12345-192.168.204.51@tcp:101:dd.0 00010000:00010000:3.0:1788574214.460517:0:7439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574214.460543:0:7439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617800/0x5bf8706fdac8c3ac lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d67d3 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574214.460585:0:7439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616800/0x5bf8706fdac8c3b3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574214.460601:0:7439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616800/0x5bf8706fdac8c3b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574214.460614:0:7439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616800/0x5bf8706fdac8c3b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574214.460764:0:7439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617800/0x5bf8706fdac8c3ac lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d67d3 expref: 40 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574214.460811:0:7439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616800/0x5bf8706fdac8c3b3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d67d3 expref: 39 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574214.460822:0:7439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c85d5185900) 00010000:00010000:3.0:1788574214.460825:0:7439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788574214.460830:0:7439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c84c2616800, rc 0) 00000100:00100000:3.0:1788574214.460899:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3d99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+39:11204:x1875455668953472:12345-192.168.204.51@tcp:101:dd.0 Request processed in 525us (737us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574214.460906:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 61 00000100:00100000:3.0:1788574214.464577:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574214.464747:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668953728 00000100:00100000:1.0:1788574214.464761:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668953728 00000100:00100000:1.0:1788574214.464841:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 62 00000100:00100000:1.0:1788574214.464853:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3d99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+39:11204:x1875455668953728:12345-192.168.204.51@tcp:36:dd.0 00010000:00010000:1.0:1788574214.465260:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c3ba lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574214.465281:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c3ba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574214.465294:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c3ba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788574214.465343:0:6492:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:1.0:1788574214.465367:0:6492:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d34e4102 reply state 00000000515fedbd transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c3ba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574214.466521:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c3ba lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574214.466538:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c85d5185900) 00010000:00010000:1.0:1788574214.466541:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788574214.466547:0:6492:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788574214.474001:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3d99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+42:11204:x1875455668953728:12345-192.168.204.51@tcp:36:dd.0 Request processed in 9127us (9415us total) trans 4294967337 rc 0/0 00000100:00100000:2.0:1788574214.474017:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 62 00000020:00080000:2.0:1788574214.474025:0:6492:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788574214.756158:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574214.756643:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668953856 00000100:00100000:2.0:1788574214.756656:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668953856 00000100:00100000:2.0:1788574214.756737:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 63 00000100:00100000:2.0:1788574214.756748:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3d9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+42:11218:x1875455668953856:12345-192.168.204.51@tcp:101:stat.0 00010000:00010000:2.0:1788574214.756790:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574214.756820:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f400/0x5bf8706fdac8c3c1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d67da expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574214.756909:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8c3c8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574214.756927:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8c3c8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574214.756940:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8c3c8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574214.756952:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f200/0x5bf8706fdac8c3cf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574214.756961:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f200/0x5bf8706fdac8c3cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574214.756967:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f200/0x5bf8706fdac8c3cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574214.757603:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8c3d6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574214.757617:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2c00/0x5bf8706fdac8c39e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d67cc expref: 43 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574214.757625:0:6493:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8c3d6 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574214.757676:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2c00/0x5bf8706fdac8c39e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d67cc expref: 43 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574214.757696:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2c00/0x5bf8706fdac8c39e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d67cc expref: 43 pid: 6493 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574214.757715:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85d10d4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6493:1875455681631104:192.168.204.51@tcp:104: 00000100:00100000:2.0:1788574214.757878:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85fafee840 going to sleep for 11 seconds 00000100:00100000:3.0:1788574214.764181:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574214.767441:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668954112 00000100:00100000:0.0:1788574214.767469:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668954112 00000100:00100000:0.0:1788574214.767578:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 13 00000100:00100000:0.0:1788574214.767592:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3d98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:659467ff-94af-418e-92fe-11e4323a48aa+44:6161:x1875455668954112:12345-192.168.204.51@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788574214.768107:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85d10d4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6493:1875455681631104:192.168.204.51@tcp:104: 00010000:00010000:2.0:1788574214.768151:0:6493:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8c3d6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574214.768273:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3d98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:659467ff-94af-418e-92fe-11e4323a48aa+45:6161:x1875455668954112:12345-192.168.204.51@tcp:35:ldlm_bl.0 Request processed in 683us (4109us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1788574214.768284:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 13 00000100:00100000:0.0:1788574214.771908:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574214.772278:0:7433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668954240 00000100:00100000:3.0:1788574214.772293:0:7433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668954240 00010000:00010000:3.0:1788574214.772629:0:7433:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2c00/0x5bf8706fdac8c39e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d67cc expref: 45 pid: 6493 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574214.772693:0:7433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 56 00000100:00100000:3.0:1788574214.772708:0:7433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85d10ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:659467ff-94af-418e-92fe-11e4323a48aa+45:2394:x1875455668954240:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788574214.772729:0:7433:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574214.772737:0:7433:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2c00/0x5bf8706fdac8c39e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d67cc expref: 45 pid: 6493 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574214.772755:0:7433:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2c00/0x5bf8706fdac8c39e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d67cc expref: 45 pid: 6493 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574214.772822:0:7433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2c00/0x5bf8706fdac8c39e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d67cc expref: 45 pid: 6493 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574214.772845:0:7433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c85d5185900) 00010000:00010000:3.0:1788574214.772852:0:7433:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8c3d6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574214.772865:0:7433:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8c3d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574214.772875:0:7433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8c3d6 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574214.772922:0:7433:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788574214.773080:0:7433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85d10ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:659467ff-94af-418e-92fe-11e4323a48aa+44:2394:x1875455668954240:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 375us (1186us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574214.773089:0:7433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 56 00010000:00010000:2.0:1788574214.774706:0:6493:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8c3d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574214.774725:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8c3d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788574214.774820:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788574214.774847:0:6493:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788574214.774909:0:6493:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8c3d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574214.774929:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8c3d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574214.774943:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8c3c8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574214.774951:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8c3c8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574214.774959:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8c3c8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574214.774965:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32e000 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:2.0:1788574214.774970:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8c3c8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574214.775848:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8c3c8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574214.775877:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c85ec19ac00) 00010000:00010000:2.0:1788574214.775881:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788574214.775888:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8c3c8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574214.775895:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8c3c8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574214.775912:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f200/0x5bf8706fdac8c3cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574214.775936:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f200/0x5bf8706fdac8c3cf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574214.775942:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f200/0x5bf8706fdac8c3cf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574214.775947:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32f200 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:2.0:1788574214.775950:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f200/0x5bf8706fdac8c3cf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574214.775956:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f200/0x5bf8706fdac8c3cf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574214.775963:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c85ec19a800) 00010000:00010000:2.0:1788574214.775965:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788574214.775968:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f200/0x5bf8706fdac8c3cf lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574214.775973:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f200/0x5bf8706fdac8c3cf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574214.776034:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f400/0x5bf8706fdac8c3c1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d67da expref: 44 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574214.776050:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8c3d6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d67da expref: 43 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574214.776058:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c85d5185900) 00010000:00010000:2.0:1788574214.776061:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788574214.776068:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85fa32fe00, rc 0) 00000100:00100000:2.0:1788574214.776154:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3d9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+43:11218:x1875455668953856:12345-192.168.204.51@tcp:101:stat.0 Request processed in 19406us (20113us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574214.776165:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 63 00010000:00010000:2.0:1788574214.803777:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574214.828653:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574214.828776:0:11893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668954496 00000100:00100000:3.0:1788574214.828801:0:11893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668954496 00000100:00100000:3.0:1788574214.828913:0:11893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 64 00000100:00100000:3.0:1788574214.828926:0:11893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85d10dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:659467ff-94af-418e-92fe-11e4323a48aa+43:11224:x1875455668954496:12345-192.168.204.51@tcp:36:truncate.0 00010000:00010000:3.0:1788574214.829129:0:11893:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574214.829168:0:11893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8c3d6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d67da expref: 43 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574214.829265:0:11893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c85d5185900) 00010000:00010000:3.0:1788574214.829277:0:11893:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788574214.829682:0:11893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617a00/0x5bf8706fdac8c3dd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574214.829701:0:11893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617a00/0x5bf8706fdac8c3dd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574214.829714:0:11893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617a00/0x5bf8706fdac8c3dd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788574214.829774:0:11893:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:3.0:1788574214.829812:0:11893:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000847ae864 reply state 0000000059cf5ec7 transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617a00/0x5bf8706fdac8c3dd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574214.829826:0:11893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617a00/0x5bf8706fdac8c3dd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574214.829833:0:11893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c85d5185900) 00010000:00010000:3.0:1788574214.829836:0:11893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788574214.829840:0:11893:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788574214.830075:0:11893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85d10dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:659467ff-94af-418e-92fe-11e4323a48aa+45:11224:x1875455668954496:12345-192.168.204.51@tcp:36:truncate.0 Request processed in 1151us (1434us total) trans 4294967340 rc 0/0 00000100:00100000:3.0:1788574214.830084:0:11893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 64 00000020:00080000:3.0:1788574214.830091:0:11893:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788574215.006588:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574215.006785:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668954624 00000100:00100000:2.0:1788574215.006800:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668954624 00000100:00100000:2.0:1788574215.006920:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 65 00000100:00100000:2.0:1788574215.006933:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3d98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+45:11238:x1875455668954624:12345-192.168.204.51@tcp:101:stat.0 00010000:00010000:2.0:1788574215.006967:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574215.007788:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f400/0x5bf8706fdac8c3e4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d67e1 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574215.007894:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f200/0x5bf8706fdac8c3eb lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574215.007912:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f200/0x5bf8706fdac8c3eb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574215.007927:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f200/0x5bf8706fdac8c3eb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574215.007939:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8c3f2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574215.007946:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8c3f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574215.007953:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8c3f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574215.008151:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ee00/0x5bf8706fdac8c3f9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574215.008162:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ee00/0x5bf8706fdac8c3f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574215.008170:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ee00/0x5bf8706fdac8c3f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788574215.008240:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:2.0:1788574215.008245:0:6492:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788574215.008268:0:6492:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ee00/0x5bf8706fdac8c3f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574215.008291:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ee00/0x5bf8706fdac8c3f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574215.008300:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f200/0x5bf8706fdac8c3eb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574215.008307:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f200/0x5bf8706fdac8c3eb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574215.008315:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f200/0x5bf8706fdac8c3eb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574215.008321:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32f200 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:2.0:1788574215.008327:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f200/0x5bf8706fdac8c3eb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574215.008336:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f200/0x5bf8706fdac8c3eb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574215.008358:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c85ec19ac00) 00010000:00010000:2.0:1788574215.008361:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00080000:3.0:1788574215.008581:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788574215.008614:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f200/0x5bf8706fdac8c3eb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574215.008624:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f200/0x5bf8706fdac8c3eb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574215.008639:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8c3f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574215.008646:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8c3f2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574215.008652:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8c3f2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574215.008656:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32e000 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:2.0:1788574215.008659:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8c3f2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574215.008664:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8c3f2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574215.008671:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c85ec19a800) 00010000:00010000:2.0:1788574215.008673:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788574215.008677:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8c3f2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574215.008682:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8c3f2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574215.008727:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f400/0x5bf8706fdac8c3e4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d67e1 expref: 47 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574215.008743:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ee00/0x5bf8706fdac8c3f9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d67e1 expref: 46 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574215.008750:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c85d5185900) 00010000:00010000:2.0:1788574215.008752:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788574215.008755:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85fa32ee00, rc 0) 00000100:00100000:2.0:1788574215.009820:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3d98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+46:11238:x1875455668954624:12345-192.168.204.51@tcp:101:stat.0 Request processed in 2880us (3241us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574215.009833:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 65 00000100:00100000:1.0:1788574215.120245:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574215.129213:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668954880 00000100:00100000:2.0:1788574215.129240:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668954880 00000100:00100000:2.0:1788574215.129356:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 66 00000100:00100000:2.0:1788574215.129530:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8ab0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+46:11248:x1875455668954880:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:2.0:1788574215.129563:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574215.129592:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f400/0x5bf8706fdac8c400 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d67e8 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788574215.129749:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1788574215.129940:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f400/0x5bf8706fdac8c400 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d67e8 expref: 48 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574215.129964:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c84c34f0a00) 00010000:00010000:2.0:1788574215.129968:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788574215.130303:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f400/0x5bf8706fdac8c400 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d67e8 expref: 48 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574215.130321:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85fa32f400, rc 0) 00000100:00100000:2.0:1788574215.130910:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8ab0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+47:11248:x1875455668954880:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 1380us (10717us total) trans 4294967341 rc 301/301 00000100:00100000:2.0:1788574215.130921:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 66 00000100:00100000:1.0:1788574215.141977:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574215.142072:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668955136 00000100:00100000:2.0:1788574215.142086:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668955136 00000100:00100000:2.0:1788574215.142173:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 14 00000100:00100000:2.0:1788574215.142186:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8ab0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:659467ff-94af-418e-92fe-11e4323a48aa+47:11248:x1875455668955136:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:2.0:1788574215.142533:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8ab0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:659467ff-94af-418e-92fe-11e4323a48aa+48:11248:x1875455668955136:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 348us (586us total) trans 4294967342 rc 0/0 00000100:00100000:2.0:1788574215.142543:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 14 00000100:00100000:3.0:1788574215.254589:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574215.261144:0:11893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668955392 00000100:00100000:0.0:1788574215.261171:0:11893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668955392 00000100:00100000:0.0:1788574215.261304:0:11893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 67 00000100:00100000:0.0:1788574215.261317:0:11893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2f45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:659467ff-94af-418e-92fe-11e4323a48aa+48:11254:x1875455668955392:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:0.0:1788574215.261372:0:11893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574215.261404:0:11893:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c40e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d67ef expref: -99 pid: 11893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574215.261563:0:11893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c415 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574215.261583:0:11893:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ee00/0x5bf8706fdac8c3f9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d67e1 expref: 49 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574215.261595:0:11893:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c415 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574215.261640:0:11893:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ee00/0x5bf8706fdac8c3f9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d67e1 expref: 49 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574215.261656:0:11893:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ee00/0x5bf8706fdac8c3f9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d67e1 expref: 49 pid: 6492 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574215.261671:0:11893:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85d10df100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11893:1875455681631232:192.168.204.51@tcp:104: 00000100:00100000:0.0:1788574215.261842:0:11893:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c3e483c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788574215.266103:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574215.266260:0:11893:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85d10df100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11893:1875455681631232:192.168.204.51@tcp:104: 00010000:00010000:0.0:1788574215.266303:0:11893:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c415 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574215.266526:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668955520 00000100:00100000:1.0:1788574215.266536:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668955520 00010000:00010000:1.0:1788574215.266587:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ee00/0x5bf8706fdac8c3f9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d67e1 expref: 50 pid: 6492 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574215.266651:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 57 00000100:00100000:1.0:1788574215.266664:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e0b79850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:659467ff-94af-418e-92fe-11e4323a48aa+50:2393:x1875455668955520:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788574215.266684:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574215.266692:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ee00/0x5bf8706fdac8c3f9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d67e1 expref: 50 pid: 6492 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574215.266706:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ee00/0x5bf8706fdac8c3f9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d67e1 expref: 50 pid: 6492 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574215.266739:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ee00/0x5bf8706fdac8c3f9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d67e1 expref: 50 pid: 6492 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574215.266760:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c85d5185900) 00010000:00010000:1.0:1788574215.266767:0:6478:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c415 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574215.266791:0:6478:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c415 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574215.266801:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c415 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574215.266840:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788574215.267002:0:11893:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c415 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574215.267012:0:11893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c415 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788574215.267036:0:11893:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:0.0:1788574215.267248:0:11893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c40e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d67ef expref: 51 pid: 11893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574215.267267:0:11893:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c415 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d67ef expref: 50 pid: 11893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574215.267275:0:11893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c85d5185900) 00010000:00010000:0.0:1788574215.267278:0:11893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788574215.267281:0:11893:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d20d6600, rc 0) 00000100:00100000:1.0:1788574215.267390:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e0b79850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:659467ff-94af-418e-92fe-11e4323a48aa+50:2393:x1875455668955520:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 726us (1301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574215.267400:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 57 00000100:00100000:0.0:1788574215.275553:0:11893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2f45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:659467ff-94af-418e-92fe-11e4323a48aa+49:11254:x1875455668955392:12345-192.168.204.51@tcp:101:bash.0 Request processed in 14216us (20958us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1788574215.275575:0:11893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 67 00000100:00100000:1.0:1788574215.294167:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574215.295024:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668955776 00000100:00100000:2.0:1788574215.295042:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668955776 00000100:00100000:2.0:1788574215.295141:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 68 00000100:00100000:2.0:1788574215.295154:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8ab3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+49:11254:x1875455668955776:12345-192.168.204.51@tcp:36:bash.0 00010000:00010000:2.0:1788574215.295522:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8c423 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574215.295547:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8c423 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574215.295560:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8c423 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788574215.295614:0:6492:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:2.0:1788574215.295653:0:6492:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a634b9eb reply state 00000000747a3286 transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8c423 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574215.295668:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8c423 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574215.295676:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c85d5185900) 00010000:00010000:2.0:1788574215.295679:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788574215.295684:0:6492:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788574215.295816:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8ab3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+52:11254:x1875455668955776:12345-192.168.204.51@tcp:36:bash.0 Request processed in 664us (1663us total) trans 4294967345 rc 0/0 00000100:00100000:2.0:1788574215.295824:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 68 00000020:00080000:2.0:1788574215.295830:0:6492:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788574215.309601:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574215.309868:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668955904 00000100:00100000:1.0:1788574215.309884:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668955904 00000100:00100000:1.0:1788574215.309976:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 69 00000100:00100000:1.0:1788574215.309989:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85d10d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+52:11254:x1875455668955904:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:1.0:1788574215.310026:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574215.310056:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3600/0x5bf8706fdac8c42a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d67f6 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574215.310264:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8c431 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574215.310284:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c415 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d67ef expref: 53 pid: 11893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574215.310294:0:6493:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8c431 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574215.310337:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c415 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d67ef expref: 53 pid: 11893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574215.310353:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c415 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d67ef expref: 53 pid: 11893 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574215.310382:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8ab2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6493:1875455681631360:192.168.204.51@tcp:104: 00000100:00100000:1.0:1788574215.310709:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c3277240 going to sleep for 11 seconds 00000100:00100000:3.0:1788574215.317872:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788574215.317906:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c2f44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681631616:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788574215.318002:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574215.318124:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574215.318176:0:7433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668956032 00000100:00100000:3.0:1788574215.318186:0:7433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668956032 00010000:00010000:3.0:1788574215.318264:0:7433:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c415 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d67ef expref: 54 pid: 11893 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574215.318307:0:7433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 58 00000100:00100000:3.0:1788574215.318318:0:7433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2f46680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:659467ff-94af-418e-92fe-11e4323a48aa+54:2394:x1875455668956032:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788574215.318336:0:7433:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574215.318345:0:7433:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c415 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d67ef expref: 54 pid: 11893 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574215.318372:0:7433:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c415 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d67ef expref: 54 pid: 11893 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574215.318402:0:7433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c85d5185900) 00010000:00010000:3.0:1788574215.318410:0:7433:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8c431 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574215.318423:0:7433:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8c431 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574215.318443:0:7433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8c431 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574215.318467:0:7433:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788574215.318527:0:7433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2f46680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:659467ff-94af-418e-92fe-11e4323a48aa+54:2394:x1875455668956032:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 210us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574215.318535:0:7433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 58 00010000:00010000:3.0:1788574215.318715:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c415 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d67ef expref: 53 pid: 11893 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574215.318742:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8ab2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6493:1875455681631360:192.168.204.51@tcp:104: 00010000:00010000:3.0:1788574215.318768:0:6493:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8c431 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574215.318790:0:6493:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8c431 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574215.318796:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8c431 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788574215.318870:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788574215.318876:0:6493:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788574215.318908:0:6493:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8c431 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574215.318946:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3600/0x5bf8706fdac8c42a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d67f6 expref: 53 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574215.318964:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8c431 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d67f6 expref: 52 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574215.318972:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c85d5185900) 00010000:00010000:3.0:1788574215.318975:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788574215.318978:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85faea2600, rc 0) 00000100:00100000:3.0:1788574215.319014:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85d10d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+52:11254:x1875455668955904:12345-192.168.204.51@tcp:101:bash.0 Request processed in 9028us (9429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574215.319022:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 69 00000100:00100000:1.0:1788574215.319638:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788574215.319661:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85d10df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681631488:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788574215.319730:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574215.319904:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681631616 00000100:00100000:0.0:1788574215.319915:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681631616 00000100:00100000:0.0:1788574215.319967:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681631488 00000100:00100000:0.0:1788574215.319971:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681631488 00000100:00100000:0.0:1788574215.319994:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788574215.320003:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2f44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681631616:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788574215.320045:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788574215.320112:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2f44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681631616:12345-0@lo:13:osp-pre-0-1.0 Request processed in 109us (2110us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574215.320128:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788574215.320145:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788574215.320152:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8ab2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681631488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788574215.320162:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788574215.320229:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8ab2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681631488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574215.320236:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788574215.320283:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85d10df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681631488:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788574215.321692:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85d10df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681631744:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788574215.321797:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574215.321887:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c2f44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681631616:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788574215.322044:0:7533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681631744 00000100:00100000:0.0:1788574215.322053:0:7533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681631744 00000100:00100000:0.0:1788574215.322126:0:7533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788574215.322136:0:7533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3d98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681631744:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788574215.322181:0:7533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788574215.322274:0:7533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3d98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681631744:12345-0@lo:41:osp-pre-1-0.0 Request processed in 139us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574215.322281:0:7533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788574215.322319:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85d10df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681631744:0@lo:41:osp-pre-1-0.0 00000100:00080000:3.0:1788574215.325083:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788574215.327135:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574215.336158:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668956288 00000100:00100000:2.0:1788574215.336184:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668956288 00000100:00100000:2.0:1788574215.336305:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 15 00000100:00100000:2.0:1788574215.336320:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85d01f5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:659467ff-94af-418e-92fe-11e4323a48aa+52:11254:x1875455668956288:12345-192.168.204.51@tcp:35:bash.0 00000100:00100000:2.0:1788574215.337476:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85d01f5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:659467ff-94af-418e-92fe-11e4323a48aa+53:11254:x1875455668956288:12345-192.168.204.51@tcp:35:bash.0 Request processed in 1151us (10350us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1788574215.337492:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 15 00000100:00100000:2.0:1788574215.460907:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574215.461121:0:11893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668956544 00000100:00100000:1.0:1788574215.461140:0:11893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668956544 00000100:00100000:1.0:1788574215.461290:0:11893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 70 00000100:00100000:1.0:1788574215.461303:0:11893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85d10d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:659467ff-94af-418e-92fe-11e4323a48aa+53:11264:x1875455668956544:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:1.0:1788574215.461340:0:11893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574215.461371:0:11893:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2c00/0x5bf8706fdac8c438 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d67fd expref: -99 pid: 11893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788574215.461513:0:11893:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1788574215.461651:0:11893:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2c00/0x5bf8706fdac8c438 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d67fd expref: 55 pid: 11893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574215.461670:0:11893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c84c34f0a00) 00010000:00010000:1.0:1788574215.461673:0:11893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788574215.461766:0:11893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2c00/0x5bf8706fdac8c438 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d67fd expref: 55 pid: 11893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574215.461797:0:11893:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85faea2c00, rc 0) 00000100:00100000:1.0:1788574215.461969:0:11893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85d10d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:659467ff-94af-418e-92fe-11e4323a48aa+54:11264:x1875455668956544:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 667us (1081us total) trans 4294967347 rc 301/301 00000100:00100000:1.0:1788574215.461977:0:11893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 70 00000100:00100000:3.0:1788574215.470359:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574215.474807:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668956672 00000100:00100000:0.0:1788574215.474831:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668956672 00000100:00100000:0.0:1788574215.474960:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 71 00000100:00100000:0.0:1788574215.474974:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2f46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+54:11264:x1875455668956672:12345-192.168.204.51@tcp:34:lfs.0 00010000:00010000:0.0:1788574215.475091:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c446 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574215.475114:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c446 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574215.475149:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c446 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574215.475163:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7c00/0x5bf8706fdac8c44d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574215.475171:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7c00/0x5bf8706fdac8c44d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574215.475178:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7c00/0x5bf8706fdac8c44d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574215.475322:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8c454 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574215.475333:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8c454 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574215.475340:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8c454 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788574215.475402:0:6494:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8c454 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574215.475418:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c446 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574215.475426:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c446 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574215.475434:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c446 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574215.475453:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d7e00 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:0.0:1788574215.475458:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c446 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574215.475466:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c446 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574215.475481:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c85ec19ac00) 00010000:00010000:0.0:1788574215.475484:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574215.475489:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c446 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574215.475495:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c446 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574215.475512:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7c00/0x5bf8706fdac8c44d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574215.475519:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7c00/0x5bf8706fdac8c44d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574215.475525:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7c00/0x5bf8706fdac8c44d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574215.475529:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d7c00 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:0.0:1788574215.475532:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7c00/0x5bf8706fdac8c44d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574215.475538:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7c00/0x5bf8706fdac8c44d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574215.475555:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c85ec19a800) 00010000:00010000:0.0:1788574215.475557:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574215.475561:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7c00/0x5bf8706fdac8c44d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574215.475566:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7c00/0x5bf8706fdac8c44d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574215.475577:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8c454 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574215.475583:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8c454 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574215.475588:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8c454 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574215.475592:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d6400 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:0.0:1788574215.475595:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8c454 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574215.475600:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8c454 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574215.475607:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c85d5185900) 00010000:00010000:0.0:1788574215.475609:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574215.475612:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8c454 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574215.475617:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8c454 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574215.475745:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2f46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+54:11264:x1875455668956672:12345-192.168.204.51@tcp:34:lfs.0 Request processed in 772us (5402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574215.475754:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 71 00000100:00100000:3.0:1788574215.478862:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574215.479007:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668956928 00000100:00100000:1.0:1788574215.479023:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668956928 00000100:00100000:1.0:1788574215.479134:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 16 00000100:00100000:1.0:1788574215.479146:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2f46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:659467ff-94af-418e-92fe-11e4323a48aa+54:11264:x1875455668956928:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:1.0:1788574215.479550:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2f46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:659467ff-94af-418e-92fe-11e4323a48aa+55:11264:x1875455668956928:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 405us (703us total) trans 4294967348 rc 0/0 00000100:00100000:1.0:1788574215.479559:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 16 00000100:00100000:2.0:1788574215.531152:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574215.531472:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668957184 00000100:00100000:3.0:1788574215.531487:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668957184 00000100:00100000:3.0:1788574215.531688:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 72 00000100:00100000:3.0:1788574215.531703:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85d10d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+55:11267:x1875455668957184:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:3.0:1788574215.531739:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574215.531779:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617800/0x5bf8706fdac8c45b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6804 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574215.531895:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616400/0x5bf8706fdac8c462 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574215.531912:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616400/0x5bf8706fdac8c462 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574215.531925:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616400/0x5bf8706fdac8c462 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574215.531935:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616a00/0x5bf8706fdac8c469 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574215.531942:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616a00/0x5bf8706fdac8c469 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574215.531948:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616a00/0x5bf8706fdac8c469 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574215.532100:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616200/0x5bf8706fdac8c470 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574215.532135:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616200/0x5bf8706fdac8c470 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574215.532143:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616200/0x5bf8706fdac8c470 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788574215.532159:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788574215.532333:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616400/0x5bf8706fdac8c462 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574215.532342:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616400/0x5bf8706fdac8c462 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574215.532349:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616400/0x5bf8706fdac8c462 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574215.532355:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c84c2616400 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:3.0:1788574215.532360:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616400/0x5bf8706fdac8c462 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574215.532368:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616400/0x5bf8706fdac8c462 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574215.532383:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c85ec19ac00) 00010000:00010000:3.0:1788574215.532387:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574215.532393:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616400/0x5bf8706fdac8c462 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574215.532400:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616400/0x5bf8706fdac8c462 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574215.532416:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616a00/0x5bf8706fdac8c469 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574215.532429:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616a00/0x5bf8706fdac8c469 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574215.532435:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616a00/0x5bf8706fdac8c469 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574215.532440:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c84c2616a00 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:3.0:1788574215.532443:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616a00/0x5bf8706fdac8c469 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574215.532450:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616a00/0x5bf8706fdac8c469 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574215.532458:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c85ec19a800) 00010000:00010000:3.0:1788574215.532460:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574215.532463:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616a00/0x5bf8706fdac8c469 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574215.532469:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616a00/0x5bf8706fdac8c469 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574215.532526:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617800/0x5bf8706fdac8c45b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6804 expref: 58 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574215.532541:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616200/0x5bf8706fdac8c470 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6804 expref: 57 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574215.532550:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c85d5185900) 00010000:00010000:3.0:1788574215.532552:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788574215.532559:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c84c2616200, rc 0) 00000100:00100000:3.0:1788574215.532647:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85d10d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+57:11267:x1875455668957184:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 947us (1511us total) trans 4294967349 rc 0/0 00000100:00100000:3.0:1788574215.532656:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 72 00000100:00100000:2.0:1788574215.542374:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574215.547603:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668957312 00000100:00100000:0.0:1788574215.547625:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668957312 00000100:00100000:2.0:1788574215.547659:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574215.547715:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 73 00000100:00100000:0.0:1788574215.547729:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85d10d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+57:11267:x1875455668957312:12345-192.168.204.51@tcp:54:lfs.0 00000100:00100000:1.0:1788574215.547833:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668957440 00000100:00100000:1.0:1788574215.547838:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668957440 00000100:00100000:1.0:1788574215.547899:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 5 00000100:00100000:1.0:1788574215.547908:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85d10d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:659467ff-94af-418e-92fe-11e4323a48aa+58:2393:x1875455668957440:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788574215.547925:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574215.547963:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616200/0x5bf8706fdac8c470 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6804 expref: 58 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574215.547992:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c85d5185900) 00010000:00010000:1.0:1788574215.547999:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788574215.547999:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7c00/0x5bf8706fdac8c47e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574215.548017:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7c00/0x5bf8706fdac8c47e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574215.548031:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7c00/0x5bf8706fdac8c47e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574215.548074:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85d10d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:659467ff-94af-418e-92fe-11e4323a48aa+57:2393:x1875455668957440:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 167us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574215.548081:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 5 00010000:00010000:0.0:1788574215.548085:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7c00/0x5bf8706fdac8c47e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574215.548091:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7c00/0x5bf8706fdac8c47e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574215.548098:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7c00/0x5bf8706fdac8c47e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574215.548105:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d7c00 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:0.0:1788574215.548112:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7c00/0x5bf8706fdac8c47e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574215.548122:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7c00/0x5bf8706fdac8c47e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574215.548157:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c85d5185900) 00010000:00010000:0.0:1788574215.548160:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788574215.548164:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7c00/0x5bf8706fdac8c47e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574215.548171:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7c00/0x5bf8706fdac8c47e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574215.548234:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85d10d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+56:11267:x1875455668957312:12345-192.168.204.51@tcp:54:lfs.0 Request processed in 508us (5881us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574215.549701:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 73 00000100:00100000:0.0:1788574215.559958:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574215.560080:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668957696 00000100:00100000:1.0:1788574215.560095:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668957696 00000100:00100000:1.0:1788574215.560301:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 17 00000100:00100000:1.0:1788574215.560314:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85d10df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:659467ff-94af-418e-92fe-11e4323a48aa+56:11267:x1875455668957696:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:1.0:1788574215.560653:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85d10df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:659467ff-94af-418e-92fe-11e4323a48aa+57:11267:x1875455668957696:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 341us (711us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1788574215.560662:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 17 00000100:00100000:2.0:1788574215.688472:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574215.688634:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668957952 00000100:00100000:1.0:1788574215.688666:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668957952 00000100:00100000:1.0:1788574215.689066:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 74 00000100:00100000:1.0:1788574215.689082:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85d10d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+57:11285:x1875455668957952:12345-192.168.204.51@tcp:101:cat.0 00010000:00010000:1.0:1788574215.689117:0:7439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574215.689146:0:7439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2c00/0x5bf8706fdac8c485 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d680b expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574215.689341:0:7439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8c48c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574215.689361:0:7439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8c48c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574215.689377:0:7439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8c48c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788574215.689391:0:7439:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788574215.689531:0:7439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2c00/0x5bf8706fdac8c485 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d680b expref: 60 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574215.689554:0:7439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8c48c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d680b expref: 59 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574215.689564:0:7439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c85d5185900) 00010000:00010000:1.0:1788574215.689567:0:7439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788574215.689572:0:7439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85faea3e00, rc 0) 00000100:00100000:1.0:1788574215.689668:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85d10d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+59:11285:x1875455668957952:12345-192.168.204.51@tcp:101:cat.0 Request processed in 590us (1209us total) trans 4294967351 rc 0/0 00000100:00100000:1.0:1788574215.689677:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 74 00000100:00100000:3.0:1788574215.724146:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574215.724354:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668958080 00000100:00100000:1.0:1788574215.724369:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668958080 00000100:00100000:1.0:1788574215.724453:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 75 00000100:00100000:1.0:1788574215.724465:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2f45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+59:11286:x1875455668958080:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:1.0:1788574215.724500:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574215.724530:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2c00/0x5bf8706fdac8c49a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6812 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574215.724628:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8c4a1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574215.724647:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8c4a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574215.724663:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8c4a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788574215.724723:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1788574215.724728:0:6493:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788574215.724758:0:6493:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8c4a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574215.724808:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2c00/0x5bf8706fdac8c49a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6812 expref: 61 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574215.724833:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8c4a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6812 expref: 60 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574215.724845:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c85ec19ac00) 00010000:00010000:1.0:1788574215.724849:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788574215.724876:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85faea3800, rc 0) 00000100:00100000:1.0:1788574215.724969:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2f45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+60:11286:x1875455668958080:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 506us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574215.724978:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 75 00000100:00100000:0.0:1788574215.735286:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574215.735775:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668958464 00000100:00100000:2.0:1788574215.735791:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668958464 00000100:00100000:2.0:1788574215.738151:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 18 00000100:00100000:2.0:1788574215.738223:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85d10dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:659467ff-94af-418e-92fe-11e4323a48aa+60:11286:x1875455668958464:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:2.0:1788574215.738657:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85d10dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:659467ff-94af-418e-92fe-11e4323a48aa+61:11286:x1875455668958464:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 449us (3384us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1788574215.738667:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 18 00000100:00100000:3.0:1788574215.743518:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574215.743913:0:7433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668958592 00000100:00100000:0.0:1788574215.743928:0:7433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668958592 00000100:00100000:0.0:1788574215.744022:0:7433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 6 00000100:00100000:0.0:1788574215.744771:0:7433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2f45880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:659467ff-94af-418e-92fe-11e4323a48aa+61:11286:x1875455668958592:12345-192.168.204.51@tcp:103:lfs.0 00010000:00010000:0.0:1788574215.744801:0:7433:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788574215.744836:0:7433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8c431 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d67f6 expref: 61 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574215.744868:0:7433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8c48c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d680b expref: 60 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574215.744881:0:7433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8c32e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d67b0 expref: 59 pid: 11893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574215.744923:0:7433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c85d5185900) 00010000:00010000:0.0:1788574215.744935:0:7433:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574215.745021:0:7433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2f45880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:659467ff-94af-418e-92fe-11e4323a48aa+58:11286:x1875455668958592:12345-192.168.204.51@tcp:103:lfs.0 Request processed in 987us (1520us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574215.745031:0:7433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 6 00000100:00100000:3.0:1788574215.748522:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574215.748739:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668958720 00000100:00100000:0.0:1788574215.748755:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668958720 00000100:00100000:0.0:1788574215.748839:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 76 00000100:00100000:0.0:1788574215.748851:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2f47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+58:11286:x1875455668958720:12345-192.168.204.51@tcp:58:lfs.0 00010000:00010000:0.0:1788574215.749033:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c4a8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574215.749058:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c4a8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574215.749074:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c4a8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788574215.749564:0:6492:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788574215.749740:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:0.0:1788574215.749858:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:0.0:1788574215.749991:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2f47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+58:11286:x1875455668958720:12345-192.168.204.51@tcp:58:lfs.0 Request processed in 1139us (1484us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574215.750002:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 76 00000100:00100000:3.0:1788574215.753715:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574215.753855:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574215.753895:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574215.753931:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668958848 00000100:00100000:3.0:1788574215.753945:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668958848 00000100:00100000:3.0:1788574215.754018:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 386 00000100:00100000:3.0:1788574215.754030:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c860022b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+13:2395:x1875455668958848:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1788574215.754129:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c860022b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+13:2395:x1875455668958848:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 100us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574215.754138:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 386 00000100:00100000:3.0:1788574215.754274:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574215.754327:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574215.754348:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668958976 00000100:00100000:3.0:1788574215.754353:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668958976 00000100:00100000:3.0:1788574215.754396:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668959232 00000100:00100000:3.0:1788574215.754400:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668959232 00000100:00100000:3.0:1788574215.754424:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668959360 00000100:00100000:3.0:1788574215.754427:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668959360 00000100:00100000:3.0:1788574215.754445:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 306 00000100:00100000:3.0:1788574215.754452:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2f45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+5:2395:x1875455668958976:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1788574215.754487:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2f45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+5:2395:x1875455668958976:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 36us (789us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574215.754530:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 306 00000100:00100000:3.0:1788574215.754545:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 307 00000100:00100000:3.0:1788574215.754552:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2f45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2395:x1875455668959232:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1788574215.754578:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2f45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2395:x1875455668959232:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 27us (724us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574215.754584:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 307 00000100:00100000:3.0:1788574215.754597:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 308 00000100:00100000:3.0:1788574215.754603:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2f46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2395:x1875455668959360:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1788574215.754628:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2f46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2395:x1875455668959360:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 25us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574215.754634:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 308 00000100:00080000:3.0:1788574215.754653:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788574215.754659:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788574215.755330:0:8815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668959104 00000100:00100000:2.0:1788574215.755340:0:8815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668959104 00000100:00100000:2.0:1788574215.755397:0:8815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 112 00000100:00100000:2.0:1788574215.755405:0:8815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2f47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:659467ff-94af-418e-92fe-11e4323a48aa+7:2395:x1875455668959104:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1788574215.755453:0:8815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2f47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:659467ff-94af-418e-92fe-11e4323a48aa+7:2395:x1875455668959104:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 49us (1179us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574215.755460:0:8815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 112 00000100:00080000:3.0:1788574215.758522:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788574215.777730:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574215.784084:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668959488 00000100:00100000:0.0:1788574215.784110:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668959488 00000100:00100000:0.0:1788574215.784540:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 77 00000100:00100000:0.0:1788574215.784556:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2f47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+58:11288:x1875455668959488:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:0.0:1788574215.784603:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574215.784633:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6a00/0x5bf8706fdac8c4af lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6819 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574215.784730:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8c4b6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574215.784751:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8c4b6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574215.784776:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8c4b6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574215.784790:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8c4bd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574215.784798:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8c4bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574215.784805:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8c4bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574215.784925:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7c00/0x5bf8706fdac8c4c4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574215.784935:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7c00/0x5bf8706fdac8c4c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574215.784942:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7c00/0x5bf8706fdac8c4c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788574215.785148:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788574215.785160:0:6494:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788574215.785235:0:6494:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7c00/0x5bf8706fdac8c4c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574215.785320:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7c00/0x5bf8706fdac8c4c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574215.785330:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8c4b6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574215.785338:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8c4b6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574215.785345:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8c4b6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574215.785351:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d6800 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:0.0:1788574215.785357:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8c4b6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574215.785366:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8c4b6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574215.785382:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c85ec19ac00) 00010000:00010000:0.0:1788574215.785385:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574215.785391:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8c4b6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574215.785399:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8c4b6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574215.785418:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8c4bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574215.785435:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8c4bd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574215.785441:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8c4bd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574215.785445:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d7200 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:0.0:1788574215.785449:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8c4bd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574215.785455:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8c4bd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574215.785463:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c85ec19a800) 00010000:00010000:0.0:1788574215.785466:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574215.785469:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8c4bd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574215.785474:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8c4bd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574215.785511:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6a00/0x5bf8706fdac8c4af lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6819 expref: 60 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574215.785527:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7c00/0x5bf8706fdac8c4c4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6819 expref: 59 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574215.785536:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c85d5185900) 00010000:00010000:0.0:1788574215.785538:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788574215.785547:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d20d7c00, rc 0) 00000100:00100000:0.0:1788574215.785642:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2f47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+59:11288:x1875455668959488:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 1090us (7940us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574215.785651:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 77 00010000:00010000:0.0:1788574215.827652:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788574216.275830:0:13764:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788574216.275843:0:13764:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788574216.275899:0:13764:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788574216.275909:0:13764:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788574216.276120:0:13764:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c2f44380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13764:1875455681631872:192.168.204.51@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788574216.276283:0:13764:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c267e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788574216.279400:0:13764:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c2f44380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13764:1875455681631872:192.168.204.51@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788574216.285160:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574216.291095:0:11893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668959616 00000100:00100000:1.0:1788574216.291116:0:11893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668959616 00000100:00100000:1.0:1788574216.291426:0:11893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 78 00000100:00100000:1.0:1788574216.291451:0:11893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85d10d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:659467ff-94af-418e-92fe-11e4323a48aa+59:11299:x1875455668959616:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788574216.291605:0:11893:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788574216.292081:0:11893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85d10d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:659467ff-94af-418e-92fe-11e4323a48aa+59:11299:x1875455668959616:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 Request processed in 633us (6935us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574216.292089:0:11893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 78 00000100:00100000:2.0:1788574216.302912:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574216.305784:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668959744 00000100:00100000:0.0:1788574216.305806:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668959744 00000100:00100000:0.0:1788574216.305906:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 79 00000100:00100000:0.0:1788574216.305926:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85d10d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+59:11299:x1875455668959744:12345-192.168.204.51@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788574216.306038:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6a00/0x5bf8706fdac8c4cb lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574216.306062:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6a00/0x5bf8706fdac8c4cb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574216.306080:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6a00/0x5bf8706fdac8c4cb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788574216.307951:0:6471:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967352 is committed 00000004:00080000:3.0:1788574216.308035:0:6471:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:3.0:1788574216.308063:0:6471:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c85fafeee40 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1788574216.308069:0:6471:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c860030a600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c85fafee6c0 00000020:00080000:3.0:1788574216.308087:0:6471:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c860030ac00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c85f6ff0a00 00010000:00010000:2.0:1788574216.308293:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e400/0x5bf8706fdac8c26a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.308319:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e400/0x5bf8706fdac8c26a lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.308329:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e400/0x5bf8706fdac8c26a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.308336:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32e400 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:2.0:1788574216.308341:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e400/0x5bf8706fdac8c26a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.308351:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e400/0x5bf8706fdac8c26a lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.308388:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9c85ec19ad00) 00010000:00010000:2.0:1788574216.308392:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788574216.308400:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e400/0x5bf8706fdac8c26a lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.308408:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e400/0x5bf8706fdac8c26a lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.308436:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f000/0x5bf8706fdac8c271 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.308443:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f000/0x5bf8706fdac8c271 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.308449:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f000/0x5bf8706fdac8c271 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.308454:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32f000 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:2.0:1788574216.308457:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f000/0x5bf8706fdac8c271 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.308463:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f000/0x5bf8706fdac8c271 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.308471:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c85ec19ac00) 00010000:00010000:2.0:1788574216.308473:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788574216.308476:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f000/0x5bf8706fdac8c271 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.308481:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f000/0x5bf8706fdac8c271 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.308512:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ea00/0x5bf8706fdac8c2b0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.308519:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ea00/0x5bf8706fdac8c2b0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.308525:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ea00/0x5bf8706fdac8c2b0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.308532:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32ea00 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:2.0:1788574216.308535:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ea00/0x5bf8706fdac8c2b0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.308541:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ea00/0x5bf8706fdac8c2b0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.308550:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c85ec19a800) 00010000:00010000:2.0:1788574216.308552:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788574216.308555:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ea00/0x5bf8706fdac8c2b0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.308562:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ea00/0x5bf8706fdac8c2b0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.308578:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c3ba lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.308585:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c3ba lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.308591:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c3ba lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.308603:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85faea2000 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:2.0:1788574216.308606:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c3ba lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.308612:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c3ba lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.308622:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c85d5185900) 00010000:00010000:2.0:1788574216.308624:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788574216.308628:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c3ba lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.308634:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c3ba lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.308647:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617a00/0x5bf8706fdac8c3dd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.308654:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617a00/0x5bf8706fdac8c3dd lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.308661:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617a00/0x5bf8706fdac8c3dd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.308666:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c84c2617a00 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:2.0:1788574216.308670:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617a00/0x5bf8706fdac8c3dd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.308689:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617a00/0x5bf8706fdac8c3dd lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.308708:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c85d5185900) 00010000:00010000:2.0:1788574216.308711:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788574216.308714:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617a00/0x5bf8706fdac8c3dd lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.308721:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617a00/0x5bf8706fdac8c3dd lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.308733:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8c423 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.308740:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8c423 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.308746:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8c423 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.308762:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32e000 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:2.0:1788574216.308765:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8c423 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.308772:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8c423 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.308781:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c85d5185900) 00010000:00010000:2.0:1788574216.308785:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788574216.308787:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8c423 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.308794:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8c423 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574216.308852:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8c4d2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574216.308878:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8c4d2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574216.308894:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8c4d2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574216.308942:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8c4d9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788574216.308974:0:6524:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00010000:00010000:0.0:1788574216.308975:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8c4d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574216.308992:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8c4d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788574216.309053:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000100:00100000:3.0:1788574216.309057:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000004:00200000:0.0:1788574216.309058:0:6492:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788574216.309080:0:6492:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8c4d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574216.309090:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3d9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681632000:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1788574216.309094:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6a00/0x5bf8706fdac8c4cb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574216.309104:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6a00/0x5bf8706fdac8c4cb lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574216.309111:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6a00/0x5bf8706fdac8c4cb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574216.309119:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d6a00 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:0.0:1788574216.309124:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6a00/0x5bf8706fdac8c4cb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574216.309133:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6a00/0x5bf8706fdac8c4cb lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574216.309149:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c85c90c8800) 00010000:00010000:0.0:1788574216.309153:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574216.309158:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6a00/0x5bf8706fdac8c4cb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574216.309176:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6a00/0x5bf8706fdac8c4cb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574216.309235:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8c4d2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574216.309244:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8c4d2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574216.309260:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788574216.309271:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8c4d2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574216.309280:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d7200 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:0.0:1788574216.309285:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8c4d2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574216.309294:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8c4d2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788574216.309312:0:6524:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:1.0:1788574216.309339:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681632000 00000100:00100000:1.0:1788574216.309351:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681632000 00010000:00010000:0.0:1788574216.309415:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff9c85c6b83000) 00010000:00010000:0.0:1788574216.309419:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788574216.309453:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788574216.309467:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2f47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3618:x1875455681632000:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788574216.309504:0:8411:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:1.0:1788574216.309546:0:8411:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 13, mtime: 0x6a9b7a04, atime: 0x6a9b7a05, ctime: 0x6a9b7a04, blocks: 0x8 00010000:00010000:1.0:1788574216.309554:0:8411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000017e2eda1/0x5bf8706fdac8c4e0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574216.309563:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8c4d2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574216.309572:0:8411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=356s v=(0 0) 00010000:00010000:0.0:1788574216.309575:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8c4d2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574216.309581:0:8411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574216.309593:0:8411:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000017e2eda1/0x5bf8706fdac8c4e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574216.309600:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8c4d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574216.309614:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8c4d9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574216.309630:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8c4d9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574216.309636:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d6800 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:0.0:1788574216.309639:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8c4d9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574216.309644:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8c4d9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574216.309878:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c85d5185900) 00010000:00010000:0.0:1788574216.309882:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574216.309886:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8c4d9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574216.309892:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8c4d9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574216.310003:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85d10d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+12:11299:x1875455668959744:12345-192.168.204.51@tcp:34:lhsmtool_posix.0 Request processed in 4076us (7102us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574216.310015:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 79 00010000:00010000:1.0:1788574216.312061:0:8411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000017e2eda1/0x5bf8706fdac8c4e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574216.312094:0:8411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000017e2eda1/0x5bf8706fdac8c4e0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574216.312104:0:8411:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000017e2eda1/0x5bf8706fdac8c4e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574216.312177:0:8411:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788574216.313935:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2f47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3618:x1875455681632000:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4459us (4676us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788574216.313951:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:1.0:1788574216.314009:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1788574216.314073:0:3618:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c84c3d9b100/2, rc 0, transno 4294967302 00000100:00100000:1.0:1788574216.314081:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3d9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681632000:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1788574216.314606:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788574216.314619:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000017e2eda1/0x5bf8706fdac8c4e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.314634:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85faea2e00 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:2.0:1788574216.314641:0:6480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000017e2eda1/0x5bf8706fdac8c4e0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.314655:0:6480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000017e2eda1/0x5bf8706fdac8c4e0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.314692:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000017e2eda1/0x5bf8706fdac8c4e0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.314701:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000017e2eda1/0x5bf8706fdac8c4e0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.314730:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574216.314732:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574216.314734:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574216.317391:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574216.317730:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668960000 00000100:00100000:3.0:1788574216.317745:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668960000 00000100:00100000:3.0:1788574216.317848:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 80 00000100:00100000:3.0:1788574216.317865:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3d9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+12:11299:x1875455668960000:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788574216.317899:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574216.317932:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616a00/0x5bf8706fdac8c4e7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6820 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574216.318107:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617800/0x5bf8706fdac8c4ee lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574216.318128:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617800/0x5bf8706fdac8c4ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574216.318143:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617800/0x5bf8706fdac8c4ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788574216.318157:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788574216.318327:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617800/0x5bf8706fdac8c4ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574216.318335:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617800/0x5bf8706fdac8c4ee lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574216.318342:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617800/0x5bf8706fdac8c4ee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574216.318366:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c84c2617800 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:3.0:1788574216.318371:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617800/0x5bf8706fdac8c4ee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574216.318380:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617800/0x5bf8706fdac8c4ee lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574216.318395:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c85d5185900) 00010000:00010000:3.0:1788574216.318398:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788574216.318404:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617800/0x5bf8706fdac8c4ee lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574216.318411:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617800/0x5bf8706fdac8c4ee lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574216.318466:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616a00/0x5bf8706fdac8c4e7 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6820 expref: 14 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574216.318478:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c85c90c8800) 00010000:00010000:3.0:1788574216.318480:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788574216.318484:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616a00/0x5bf8706fdac8c4e7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6820 expref: 14 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574216.318495:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c84c2616a00, rc 0) 00000100:00100000:3.0:1788574216.318590:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3d9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+13:11299:x1875455668960000:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 719us (1202us total) trans 4294967353 rc 301/301 00000100:00100000:3.0:1788574216.318599:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 80 00000100:00100000:0.0:1788574216.338714:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574216.338813:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668960128 00000100:00100000:3.0:1788574216.338835:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668960128 00000100:00100000:3.0:1788574216.338910:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 81 00000100:00100000:3.0:1788574216.338921:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85d10dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+13:11299:x1875455668960128:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788574216.338971:0:6493:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788574216.339157:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85d10dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+13:11299:x1875455668960128:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 Request processed in 236us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574216.339166:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 81 00000100:00100000:0.0:1788574216.340723:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85d10dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681632128:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788574216.340808:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574216.340912:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681632128 00000100:00100000:0.0:1788574216.340921:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681632128 00000100:00100000:0.0:1788574216.340977:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788574216.340987:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85d10dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3618:x1875455681632128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788574216.341033:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:0.0:1788574216.341158:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85d10dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3618:x1875455681632128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 172us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574216.341166:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788574216.341681:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85d10dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681632128:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788574216.343847:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c2f44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69505170-06bc-41d1-9626-ab1a3c7f32a0:3619:1875455681632256:0@lo:400:kworker.0 00000100:00100000:0.0:1788574216.343943:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574216.344003:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3769880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681632768:0@lo:400:kworker.0 00000100:00100000:0.0:1788574216.344030:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574216.344061:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788574216.344066:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c2f44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875455681632384:0@lo:400:kworker.0 00000100:00100000:0.0:1788574216.344091:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574216.344131:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681632256 00000100:00100000:0.0:1788574216.344140:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681632256 00000100:00100000:0.0:1788574216.344226:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:0.0:1788574216.345076:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5676450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:3619:x1875455681632256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574216.345159:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5676450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:3619:x1875455681632256:12345-0@lo:400:kworker.0 Request processed in 92us (1216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574216.345167:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:0.0:1788574216.345330:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681632768 00000100:00100000:0.0:1788574216.345337:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681632768 00000100:00100000:0.0:1788574216.345517:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788574216.345525:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85d10dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681632768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574216.345567:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85d10dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681632768:12345-0@lo:400:kworker.0 Request processed in 44us (1536us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574216.345592:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788574216.345613:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681632384 00000100:00100000:0.0:1788574216.345617:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681632384 00000100:00100000:0.0:1788574216.345646:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:0.0:1788574216.345652:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85d10df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875455681632384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574216.345685:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85d10df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875455681632384:12345-0@lo:400:kworker.0 Request processed in 33us (1593us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574216.345691:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:0.0:1788574216.345721:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c2f44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681632512:0@lo:400:kworker.0 00000100:00100000:0.0:1788574216.345771:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574216.345800:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3769500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1875455681633024:0@lo:400:kworker.0 00000100:00100000:0.0:1788574216.345824:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574216.345843:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c376b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1875455681633536:0@lo:400:kworker.0 00000100:00100000:0.0:1788574216.345864:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574216.345885:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788574216.345891:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c2f44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875455681632640:0@lo:400:kworker.0 00000100:00100000:0.0:1788574216.345911:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574216.345929:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681633152:0@lo:400:kworker.0 00000100:00100000:0.0:1788574216.345950:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574216.345965:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3768380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681633664:0@lo:400:kworker.0 00000100:00100000:0.0:1788574216.345984:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574216.346011:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681632512 00000100:00100000:0.0:1788574216.346014:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681632512 00000100:00100000:0.0:1788574216.346039:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788574216.346045:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85d10dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681632512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574216.346084:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85d10dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681632512:12345-0@lo:400:kworker.0 Request processed in 39us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574216.346090:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788574216.346109:0:11893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681633024 00000100:00100000:0.0:1788574216.346112:0:11893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681633024 00000100:00100000:0.0:1788574216.346145:0:11893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681633536 00000100:00100000:0.0:1788574216.346147:0:11893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681633536 00000100:00100000:0.0:1788574216.346170:0:11893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681632640 00000100:00100000:0.0:1788574216.346173:0:11893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681632640 00000100:00100000:0.0:1788574216.346185:0:11893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1788574216.346207:0:11893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85d10df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875455681633024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574216.346872:0:11893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85d10df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875455681633024:12345-0@lo:400:kworker.0 Request processed in 663us (1045us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574216.346882:0:11893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1788574216.346903:0:11893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1788574216.346911:0:11893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85d10dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875455681633536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574216.346950:0:11893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85d10dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875455681633536:12345-0@lo:400:kworker.0 Request processed in 41us (1085us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574216.346955:0:11893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:0.0:1788574216.346967:0:11893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1788574216.346973:0:11893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85d10dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875455681632640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574216.346998:0:11893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85d10dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875455681632640:12345-0@lo:400:kworker.0 Request processed in 26us (1086us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574216.347003:0:11893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1788574216.347025:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681633152 00000100:00100000:0.0:1788574216.347032:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681633152 00000100:00100000:0.0:1788574216.347105:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681633664 00000100:00100000:0.0:1788574216.347116:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681633664 00000100:00100000:3.0:1788574216.347740:0:13791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788574216.347766:0:13791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85d10ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681633152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574216.347820:0:13791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85d10ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681633152:12345-0@lo:400:kworker.0 Request processed in 70us (1869us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574216.347827:0:13791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788574216.347842:0:13791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788574216.347848:0:13791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85d10dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681633664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574216.347876:0:13791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85d10dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681633664:12345-0@lo:400:kworker.0 Request processed in 28us (1891us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574216.347882:0:13791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788574216.348458:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00080000:0.0:1788574216.349564:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788574216.349574:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788574216.349593:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668960384 00000100:00100000:0.0:1788574216.349603:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668960384 00000100:00100000:0.0:1788574216.349651:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 82 00000100:00100000:0.0:1788574216.349659:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c376b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+13:11299:x1875455668960384:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788574216.349681:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574216.349685:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788574216.349720:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8c4a1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6812 expref: 13 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574216.349739:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c85ec19ac00) 00010000:00010000:0.0:1788574216.349745:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788574216.349774:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8c4fc lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6827 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788574216.350791:0:6492:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:0.0:1788574216.350998:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6a00/0x5bf8706fdac8c503 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574216.351020:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6a00/0x5bf8706fdac8c503 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574216.351034:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6a00/0x5bf8706fdac8c503 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574216.351105:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8c4fc lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6827 expref: 15 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574216.351135:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6a00/0x5bf8706fdac8c503 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6827 expref: 14 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574216.351144:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9c85c6b83000) 00010000:00010000:0.0:1788574216.351147:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788574216.351151:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d20d6a00, rc 0) 00000100:00100000:0.0:1788574216.351510:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c376b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+14:11299:x1875455668960384:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 1850us (3055us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1788574216.351521:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 82 00000100:00100000:0.0:1788574216.351590:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c376b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3620:1875455681632896:0@lo:400:kworker.0 00000100:00100000:0.0:1788574216.351670:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574216.351720:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c376aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3620:1875455681633408:0@lo:400:kworker.0 00000100:00100000:0.0:1788574216.351743:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574216.351780:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788574216.351787:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c376bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681633280:0@lo:400:kworker.0 00000100:00100000:0.0:1788574216.351815:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574216.351832:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3d98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681633792:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788574216.351855:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574216.351885:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681632896 00000100:00100000:0.0:1788574216.351893:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681632896 00000100:00100000:0.0:1788574216.351936:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681633408 00000100:00100000:0.0:1788574216.351939:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681633408 00000100:00100000:0.0:1788574216.351956:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:0.0:1788574216.351964:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85d10ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875455681632896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574216.352014:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85d10ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875455681632896:12345-0@lo:400:kworker.0 Request processed in 51us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574216.352029:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:0.0:1788574216.352042:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1788574216.352048:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85d10dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875455681633408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574216.352072:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85d10dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875455681633408:12345-0@lo:400:kworker.0 Request processed in 25us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574216.352079:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00080000:0.0:1788574216.352092:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788574216.352134:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c2f44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875455681632640:0@lo:400:kworker.0 00000100:00100000:0.0:1788574216.352148:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681633152:0@lo:400:kworker.0 00000100:00100000:0.0:1788574216.352160:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3768380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681633664:0@lo:400:kworker.0 00000100:00100000:0.0:1788574216.352172:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c2f44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681632512:0@lo:400:kworker.0 00010000:00080000:0.0:1788574216.352209:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3769500 x1875455681633024/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574232 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574216.352221:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3769500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1875455681633024:0@lo:400:kworker.0 00010000:00080000:0.0:1788574216.352564:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c376b480 x1875455681633536/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574232 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574216.352575:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c376b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1875455681633536:0@lo:400:kworker.0 00000100:00100000:0.0:1788574216.352622:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681633792 00000100:00100000:0.0:1788574216.352625:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681633792 00000100:00100000:0.0:1788574216.352655:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788574216.352661:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3597480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681633792:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788574216.352680:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:0.0:1788574216.352725:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3597480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681633792:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (869us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574216.352738:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788574216.352803:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c2f44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875455681632384:0@lo:400:kworker.0 00000100:00100000:0.0:1788574216.352816:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c2f44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69505170-06bc-41d1-9626-ab1a3c7f32a0:3619:1875455681632256:0@lo:400:kworker.0 00000100:00100000:0.0:1788574216.352829:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3769880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681632768:0@lo:400:kworker.0 00000100:00100000:0.0:1788574216.352862:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3d98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681633792:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788574216.352871:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c376b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3620:1875455681632896:0@lo:400:kworker.0 00000100:00100000:0.0:1788574216.352881:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c376aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3620:1875455681633408:0@lo:400:kworker.0 00000100:00100000:2.0:1788574216.356015:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681633280 00000100:00100000:2.0:1788574216.356033:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681633280 00000100:00100000:2.0:1788574216.356132:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788574216.356145:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa328380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681633280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574216.356300:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa328380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681633280:12345-0@lo:400:kworker.0 Request processed in 157us (4482us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574216.356324:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788574216.356391:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c376bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681633280:0@lo:400:kworker.0 00000100:00100000:2.0:1788574216.357774:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574216.357821:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668960640 00000100:00100000:2.0:1788574216.357828:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668960640 00000100:00100000:2.0:1788574216.357877:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 83 00000100:00100000:2.0:1788574216.357886:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85d10d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+14:11299:x1875455668960640:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788574216.357960:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788574216.357993:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6a00/0x5bf8706fdac8c503 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6827 expref: 14 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.358013:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9c85c6b83000) 00010000:00010000:2.0:1788574216.358027:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788574216.358069:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8c511 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.358088:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8c511 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.358099:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8c511 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.358116:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ea00/0x5bf8706fdac8c518 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xe1e0fcbe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.358122:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ea00/0x5bf8706fdac8c518 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xe1e0fcbe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.358128:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ea00/0x5bf8706fdac8c518 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xe1e0fcbe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.358208:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8c511 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.358217:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8c511 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.358224:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8c511 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.358230:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32e000 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:2.0:1788574216.358236:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8c511 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.358246:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8c511 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.358255:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c85ec19ac00) 00010000:00010000:2.0:1788574216.358259:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788574216.358265:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8c511 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.358271:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8c511 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.358280:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ea00/0x5bf8706fdac8c518 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xe1e0fcbe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.358286:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ea00/0x5bf8706fdac8c518 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xe1e0fcbe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.358292:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ea00/0x5bf8706fdac8c518 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xe1e0fcbe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.358303:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32ea00 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:2.0:1788574216.358306:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ea00/0x5bf8706fdac8c518 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xe1e0fcbe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.358312:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ea00/0x5bf8706fdac8c518 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xe1e0fcbe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.358320:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xe1e0fcbe (ffff9c85ec19a800) 00010000:00010000:2.0:1788574216.358323:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788574216.358325:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ea00/0x5bf8706fdac8c518 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xe1e0fcbe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.358331:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ea00/0x5bf8706fdac8c518 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xe1e0fcbe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574216.358421:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85d10d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+13:11299:x1875455668960640:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 Request processed in 535us (653us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788574216.358430:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 83 00000100:00100000:3.0:1788574216.360381:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574216.360815:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668960768 00000100:00100000:2.0:1788574216.360828:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668960768 00000100:00100000:2.0:1788574216.360907:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 84 00000100:00100000:2.0:1788574216.360918:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3768a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+13:11299:x1875455668960768:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788574216.360946:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574216.360978:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e400/0x5bf8706fdac8c51f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d682e expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.361027:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e600/0x5bf8706fdac8c526 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.361065:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e600/0x5bf8706fdac8c526 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.361079:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e600/0x5bf8706fdac8c526 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.361234:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e400/0x5bf8706fdac8c51f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d682e expref: 15 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.361255:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e600/0x5bf8706fdac8c526 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d682e expref: 14 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.361265:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9c85ec19ad00) 00010000:00010000:2.0:1788574216.361268:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788574216.361272:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85fa32e600, rc 0) 00000100:00100000:3.0:1788574216.361504:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3768a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+14:11299:x1875455668960768:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 587us (1134us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574216.361513:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 84 00000100:00100000:0.0:1788574216.368967:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574216.369126:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668961024 00000100:00100000:1.0:1788574216.369139:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668961024 00000100:00100000:0.0:1788574216.369451:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 85 00000100:00100000:0.0:1788574216.369467:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2f44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+14:11299:x1875455668961024:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788574216.369579:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8c52d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574216.369600:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8c52d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574216.369614:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8c52d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788574216.369845:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:0.0:1788574216.369855:0:6492:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 356349664883ns, next at 357349661903ns, rc = 0 00000004:00010000:0.0:1788574216.369915:0:6492:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003db26af5 reply state 000000004fabb081 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8c52d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574216.369950:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8c52d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574216.369957:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9c85ec19ad00) 00010000:00010000:0.0:1788574216.369960:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788574216.369964:0:6492:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788574216.370551:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2f44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+16:11299:x1875455668961024:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 Request processed in 765us (1269us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1788574216.370564:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 85 00000100:00100000:0.0:1788574216.376335:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574216.376474:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668961152 00000100:00100000:3.0:1788574216.376489:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668961152 00000100:00100000:3.0:1788574216.376561:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 86 00000100:00100000:3.0:1788574216.376572:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2f44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+16:11299:x1875455668961152:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788574216.376615:0:7439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574216.376641:0:7439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616a00/0x5bf8706fdac8c534 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6835 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574216.376726:0:7439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616a00/0x5bf8706fdac8c534 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6835 expref: 17 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574216.376745:0:7439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616a00/0x5bf8706fdac8c534 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6835 expref: 17 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574216.376779:0:7439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9c85ec19ad00) 00010000:00010000:3.0:1788574216.376783:0:7439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788574216.376787:0:7439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c84c2616a00, rc 0) 00000100:00100000:3.0:1788574216.376850:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2f44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+17:11299:x1875455668961152:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 280us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574216.376858:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 86 00000100:00100000:0.0:1788574216.388222:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574216.388272:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668961280 00000100:00100000:0.0:1788574216.388287:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668961280 00000100:00100000:0.0:1788574216.388338:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 33 00000100:00100000:0.0:1788574216.388347:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2f44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2392:x1875455668961280:12345-192.168.204.51@tcp:8:lhsmtool_posix.0 00010000:00080000:0.0:1788574216.388398:0:8409:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 659467ff-94af-418e-92fe-11e4323a48aa@192.168.204.51@tcp t0 exp 0000000000000000 cur 356 last 0 00000020:00000080:0.0:1788574216.388438:0:8409:0:(genops.c:1385:class_connect()) connect: client 659467ff-94af-418e-92fe-11e4323a48aa, cookie 0x5bf8706fdac8c53b 00002000:00100000:0.0:1788574216.388462:0:8409:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 659467ff-94af-418e-92fe-11e4323a48aa/ffff9c85ffb5e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788574216.388477:0:8409:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788574216.388779:0:8409:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788574216.388818:0:8409:0:(import.c:65:import_set_state_nolock()) ffff9c85ffb5b800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788574216.388906:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2f44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:659467ff-94af-418e-92fe-11e4323a48aa+6:2392:x1875455668961280:12345-192.168.204.51@tcp:8:lhsmtool_posix.0 Request processed in 558us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574216.388915:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 33 00000100:00100000:3.0:1788574216.401642:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574216.401778:0:8815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668961408 00000100:00100000:2.0:1788574216.401791:0:8815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668961408 00000100:00100000:2.0:1788574216.401884:0:8815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 34 00000100:00100000:2.0:1788574216.401896:0:8815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3768000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:659467ff-94af-418e-92fe-11e4323a48aa+6:0:x1875455668961408:12345-192.168.204.51@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1788574216.402816:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1788574216.403844:0:8404:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00100000:2.0:1788574216.403857:0:8404:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 659467ff-94af-418e-92fe-11e4323a48aa 00000100:00100000:1.0:1788574216.404067:0:8815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3768000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:659467ff-94af-418e-92fe-11e4323a48aa+5:0:x1875455668961408:12345-192.168.204.51@tcp:2:lhsmtool_posix.0 Request processed in 2167us (2435us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788574216.404081:0:8815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 34 00000100:00100000:0.0:1788574216.427065:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574216.427184:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668961664 00000100:00100000:1.0:1788574216.427214:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668961664 00000100:00100000:1.0:1788574216.427295:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 19 00000100:00100000:1.0:1788574216.427315:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2f44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:659467ff-94af-418e-92fe-11e4323a48aa+17:11299:x1875455668961664:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788574216.427632:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2f44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:659467ff-94af-418e-92fe-11e4323a48aa+18:11299:x1875455668961664:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 Request processed in 318us (593us total) trans 4294967356 rc 0/0 00000100:00100000:1.0:1788574216.427641:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 19 00000100:00100000:0.0:1788574216.429902:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574216.429985:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668961920 00000100:00100000:3.0:1788574216.429998:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668961920 00000100:00100000:3.0:1788574216.430129:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 87 00000100:00100000:3.0:1788574216.430142:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c335ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+18:11299:x1875455668961920:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788574216.430780:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c335ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+18:11299:x1875455668961920:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 Request processed in 638us (889us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574216.430789:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 87 00000100:00100000:0.0:1788574216.439810:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574216.439866:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668962048 00000100:00100000:0.0:1788574216.439879:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668962048 00000100:00100000:0.0:1788574216.439958:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 88 00000100:00100000:0.0:1788574216.439970:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c335d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+18:11299:x1875455668962048:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788574216.440000:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574216.440029:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8c542 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d683c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574216.440127:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8c549 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574216.440146:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8c549 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574216.440160:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8c549 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788574216.440238:0:6494:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788574216.440264:0:6494:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8c549 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574216.440298:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8c542 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d683c expref: 20 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574216.440317:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8c549 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d683c expref: 19 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574216.440328:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9c85ec19ad00) 00010000:00010000:0.0:1788574216.440338:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788574216.440343:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d20d6400, rc 0) 00000100:00100000:0.0:1788574216.440432:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c335d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+19:11299:x1875455668962048:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 465us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574216.440440:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 88 00000100:00100000:0.0:1788574216.452884:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574216.453394:0:13791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668962176 00000100:00100000:1.0:1788574216.453409:0:13791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668962176 00000100:00100000:0.0:1788574216.453611:0:13791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 35 00000100:00100000:0.0:1788574216.453626:0:13791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c335ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:659467ff-94af-418e-92fe-11e4323a48aa+5:2393:x1875455668962176:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788574216.453651:0:13791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574216.454406:0:13791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b783daef/0x5bf8706fdac8c550 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6843 expref: -99 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788574216.454445:0:13791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9b7a07, blocks: 0x0 00010000:00010000:0.0:1788574216.454474:0:13791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=356s v=(0 0) 00010000:00010000:0.0:1788574216.454480:0:13791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788574216.454494:0:13791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b783daef/0x5bf8706fdac8c550 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6843 expref: 6 pid: 13791 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574216.454527:0:13791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b783daef/0x5bf8706fdac8c550 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6843 expref: 6 pid: 13791 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574216.454545:0:13791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d20d6a00, rc 0) 00000100:00100000:0.0:1788574216.454630:0:13791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c335ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:659467ff-94af-418e-92fe-11e4323a48aa+6:2393:x1875455668962176:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 1008us (1759us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574216.454638:0:13791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 35 00000100:00100000:0.0:1788574216.457851:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574216.460524:0:11893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668962432 00000100:00100000:1.0:1788574216.460543:0:11893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668962432 00000100:00100000:1.0:1788574216.461507:0:11893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 89 00000100:00100000:1.0:1788574216.461524:0:11893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c335c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:659467ff-94af-418e-92fe-11e4323a48aa+19:11299:x1875455668962432:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788574216.461710:0:11893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c335c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:659467ff-94af-418e-92fe-11e4323a48aa+19:11299:x1875455668962432:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 Request processed in 189us (3871us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574216.461718:0:11893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 89 00000100:00100000:3.0:1788574216.465038:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574216.465254:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668962560 00000100:00100000:2.0:1788574216.465268:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668962560 00000100:00100000:2.0:1788574216.465336:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 36 00000100:00100000:2.0:1788574216.465346:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3769c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:659467ff-94af-418e-92fe-11e4323a48aa+6:11299:x1875455668962560:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788574216.465368:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574216.465413:0:8410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003fa0120b/0x5bf8706fdac8c557 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d684a expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.465458:0:8410:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b783daef/0x5bf8706fdac8c550 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6843 expref: 7 pid: 13791 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.465468:0:8410:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574216.465474:0:8410:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574216.465480:0:8410:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003fa0120b/0x5bf8706fdac8c557 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d684a expref: 7 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.465524:0:8410:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b783daef/0x5bf8706fdac8c550 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6843 expref: 7 pid: 13791 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.465540:0:8410:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b783daef/0x5bf8706fdac8c550 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6843 expref: 7 pid: 13791 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574216.465557:0:8410:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85d10d5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8410:1875455681633920:192.168.204.51@tcp:104: 00000100:00100000:2.0:1788574216.465679:0:8410:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c3629480 going to sleep for 11 seconds 00000100:00100000:0.0:1788574216.470452:0:8410:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85d10d5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8410:1875455681633920:192.168.204.51@tcp:104: 00010000:00010000:0.0:1788574216.470509:0:8410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003fa0120b/0x5bf8706fdac8c557 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d684a expref: 7 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574216.470536:0:8410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85fa32e000, rc 0) 00000100:00100000:2.0:1788574216.470611:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574216.470668:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668962688 00000100:00100000:1.0:1788574216.470687:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668962688 00010000:00010000:1.0:1788574216.470740:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b783daef/0x5bf8706fdac8c550 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6843 expref: 8 pid: 13791 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574216.470793:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 59 00000100:00100000:1.0:1788574216.470803:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85d10d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:659467ff-94af-418e-92fe-11e4323a48aa+8:2394:x1875455668962688:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788574216.470821:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574216.470847:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b783daef/0x5bf8706fdac8c550 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6843 expref: 8 pid: 13791 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574216.470863:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b783daef/0x5bf8706fdac8c550 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6843 expref: 8 pid: 13791 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574216.470908:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b783daef/0x5bf8706fdac8c550 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6843 expref: 8 pid: 13791 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574216.470922:0:6478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574216.470927:0:6478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574216.470936:0:6478:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003fa0120b/0x5bf8706fdac8c557 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d684a expref: 7 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574216.470947:0:6478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003fa0120b/0x5bf8706fdac8c557 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d684a expref: 7 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574216.470989:0:6478:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000003fa0120b/0x5bf8706fdac8c557 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d684a expref: 7 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574216.471005:0:6478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3d98a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6478:1875455681634048:192.168.204.51@tcp:105: 00000100:00100000:0.0:1788574216.471263:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3769c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:659467ff-94af-418e-92fe-11e4323a48aa+7:11299:x1875455668962560:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 5916us (6237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574216.471274:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 36 00000100:00100000:1.0:1788574216.481427:0:6478:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85fafee0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788574216.490240:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574216.490325:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668962816 00000100:00100000:3.0:1788574216.490360:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668962816 00002000:00100000:3.0:1788574216.490427:0:8416:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9c85d10d5880 x1875455668962816/t0(0) o4->659467ff-94af-418e-92fe-11e4323a48aa@192.168.204.51@tcp:367/0 lens 504/0 e 0 to 0 dl 1788574227 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788574216.490440:0:8416:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c85d10d5880 with x1875455668962816 ext(0->8) 00002000:00010000:3.0:1788574216.490446:0:8416:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c85d10d5880 00000100:00100000:3.0:1788574216.490486:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 0 00000100:00100000:3.0:1788574216.490497:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85d10d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:659467ff-94af-418e-92fe-11e4323a48aa+7:2394:x1875455668962816:12345-192.168.204.51@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788574216.491937:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85d10d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:659467ff-94af-418e-92fe-11e4323a48aa+9:2394:x1875455668962816:12345-192.168.204.51@tcp:4:lhsmtool_posix.0 Request processed in 1428us (1738us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1788574216.491952:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 0 00002000:00100000:3.0:1788574216.491964:0:8416:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9c85d10d5880 x1875455668962816/t4294967303(0) o4->659467ff-94af-418e-92fe-11e4323a48aa@192.168.204.51@tcp:367/0 lens 504/448 e 0 to 0 dl 1788574227 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788574216.491975:0:8416:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c85d10d5880 with x1875455668962816 ext(0->8) 00002000:00010000:3.0:1788574216.491980:0:8416:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c85d10d5880 00000100:00100000:1.0:1788574216.492125:0:6478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3d98a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6478:1875455681634048:192.168.204.51@tcp:105: 00010000:00010000:1.0:1788574216.492155:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788574216.492178:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85d10d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:659467ff-94af-418e-92fe-11e4323a48aa+8:2394:x1875455668962688:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 21376us (21569us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574216.492212:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 59 00000100:00100000:0.0:1788574216.498396:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574216.498490:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668962944 00000100:00100000:3.0:1788574216.498502:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668962944 00000100:00100000:3.0:1788574216.498576:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 90 00000100:00100000:3.0:1788574216.498587:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c37a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+19:11299:x1875455668962944:12345-192.168.204.51@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788574216.502140:0:6471:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:0.0:1788574216.502167:0:6471:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:0.0:1788574216.502266:0:6471:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:1.0:1788574216.503778:0:6524:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:1.0:1788574216.503804:0:6524:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1788574216.504471:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c37a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+15:11299:x1875455668962944:12345-192.168.204.51@tcp:44:lhsmtool_posix.0 Request processed in 5876us (6274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574216.504487:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 90 00000100:00100000:1.0:1788574216.504678:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788574216.504719:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3768700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681634176:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788574216.504810:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574216.504974:0:8815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681634176 00000100:00100000:3.0:1788574216.504985:0:8815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681634176 00000100:00100000:3.0:1788574216.505041:0:8815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788574216.505051:0:8815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3d98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681634176:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1788574216.505456:0:8815:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788574216.505460:0:8815:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788574215 00002000:00010000:3.0:1788574216.505463:0:8815:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788574216.505465:0:8815:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1788574215 -> 1788574215 00002000:00010000:3.0:1788574216.505468:0:8815:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1788574216.505568:0:8815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3d98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3619:x1875455681634176:12345-0@lo:2:osp-syn-0-0.0 Request processed in 519us (758us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788574216.505577:0:8815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00010000:2.0:1788574216.509258:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8c52d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.509287:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8c52d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.509478:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8c52d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.509513:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d7200 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:2.0:1788574216.509519:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8c52d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.509529:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8c52d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.509555:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9c85ec19ad00) 00010000:00010000:2.0:1788574216.509558:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788574216.509565:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8c52d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.509572:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8c52d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788574216.510562:0:3619:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c84c3768700/2, rc 0, transno 4294967304 00000100:00100000:0.0:1788574216.510580:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3768700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681634176:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788574216.511700:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574216.511846:0:13791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668963072 00000100:00100000:0.0:1788574216.511857:0:13791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668963072 00000100:00100000:0.0:1788574216.511932:0:13791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 38 00000100:00100000:0.0:1788574216.511944:0:13791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8ab0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:659467ff-94af-418e-92fe-11e4323a48aa+8:2393:x1875455668963072:12345-192.168.204.51@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1788574216.514478:0:8404:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:2.0:1788574216.514494:0:8404:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:0.0:1788574216.514866:0:13791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8ab0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:659467ff-94af-418e-92fe-11e4323a48aa+6:2393:x1875455668963072:12345-192.168.204.51@tcp:16:lhsmtool_posix.0 Request processed in 2917us (3171us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574216.514882:0:13791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 38 00000100:00100000:0.0:1788574216.545706:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574216.545828:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668963328 00000100:00100000:1.0:1788574216.545846:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668963328 00000100:00100000:1.0:1788574216.545942:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 91 00000100:00100000:1.0:1788574216.545956:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c37a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+14:11299:x1875455668963328:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788574216.546048:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574216.546090:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8c549 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d683c expref: 14 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574216.546118:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9c85ec19ad00) 00010000:00010000:1.0:1788574216.546124:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788574216.546166:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2c00/0x5bf8706fdac8c55e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574216.546185:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2c00/0x5bf8706fdac8c55e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574216.546240:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2c00/0x5bf8706fdac8c55e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788574216.546439:0:6494:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f4c32d0a reply state 00000000db374e85 transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2c00/0x5bf8706fdac8c55e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574216.546454:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2c00/0x5bf8706fdac8c55e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574216.546461:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9c85ec19ad00) 00010000:00010000:1.0:1788574216.546465:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788574216.546468:0:6494:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788574216.546632:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c37a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+15:11299:x1875455668963328:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 Request processed in 679us (935us total) trans 4294967357 rc 0/0 00000100:00100000:1.0:1788574216.546643:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 91 00000100:00100000:0.0:1788574216.557778:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574216.557890:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668963456 00000100:00100000:2.0:1788574216.557901:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668963456 00000100:00100000:2.0:1788574216.557966:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 39 00000100:00100000:2.0:1788574216.557978:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c37a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:659467ff-94af-418e-92fe-11e4323a48aa+6:2394:x1875455668963456:12345-192.168.204.51@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788574216.558171:0:8410:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1788574216.558175:0:8410:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1788574215 -> 1788574214 00002000:00010000:2.0:1788574216.558177:0:8410:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1788574213 00002000:00010000:2.0:1788574216.558179:0:8410:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1788574215 -> 1788574214 00002000:00010000:2.0:1788574216.558181:0:8410:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1788574216.558298:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c37a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:659467ff-94af-418e-92fe-11e4323a48aa+7:2394:x1875455668963456:12345-192.168.204.51@tcp:2:lhsmtool_posix.0 Request processed in 322us (533us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788574216.558320:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 39 00000100:00100000:2.0:1788574216.570986:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574216.572856:0:11893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668963712 00000100:00100000:1.0:1788574216.572943:0:11893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668963712 00000100:00100000:1.0:1788574216.573055:0:11893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 92 00000100:00100000:1.0:1788574216.573074:0:11893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:659467ff-94af-418e-92fe-11e4323a48aa+15:11299:x1875455668963712:12345-192.168.204.51@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788574216.573148:0:11893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8c565 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574216.573168:0:11893:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e600/0x5bf8706fdac8c526 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d682e expref: 15 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574216.573181:0:11893:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8c565 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574216.573246:0:11893:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e600/0x5bf8706fdac8c526 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d682e expref: 15 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574216.573261:0:11893:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e600/0x5bf8706fdac8c526 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d682e expref: 15 pid: 6493 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574216.573277:0:11893:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf5e680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11893:1875455681634304:192.168.204.51@tcp:104: 00000100:00100000:1.0:1788574216.575724:0:11893:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85fafee540 going to sleep for 11 seconds 00000100:00100000:1.0:1788574216.581671:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574216.581712:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668963840 00000100:00100000:1.0:1788574216.581721:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668963840 00010000:00010000:1.0:1788574216.581781:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e600/0x5bf8706fdac8c526 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d682e expref: 16 pid: 6493 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574216.581845:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 60 00000100:00100000:1.0:1788574216.581855:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:659467ff-94af-418e-92fe-11e4323a48aa+16:2394:x1875455668963840:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788574216.581898:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574216.581906:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e600/0x5bf8706fdac8c526 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d682e expref: 16 pid: 6493 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574216.581918:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e600/0x5bf8706fdac8c526 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d682e expref: 16 pid: 6493 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574216.581943:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9c85ec19ad00) 00010000:00010000:1.0:1788574216.581947:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8c565 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574216.581957:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8c565 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574216.581965:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8c565 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574216.581988:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788574216.582040:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:659467ff-94af-418e-92fe-11e4323a48aa+16:2394:x1875455668963840:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 186us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574216.582048:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 60 00010000:00010000:2.0:1788574216.582242:0:11893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e600/0x5bf8706fdac8c526 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d682e expref: 15 pid: 6493 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574216.582272:0:11893:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf5e680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11893:1875455681634304:192.168.204.51@tcp:104: 00010000:00010000:2.0:1788574216.582296:0:11893:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8c565 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.582306:0:11893:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8c565 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.582311:0:11893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8c565 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.582360:0:11893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8c565 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.582370:0:11893:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8c565 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.582377:0:11893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8c565 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.582384:0:11893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85faea3e00 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:2.0:1788574216.582388:0:11893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8c565 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.582395:0:11893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8c565 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.582419:0:11893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9c85ec19ad00) 00010000:00010000:2.0:1788574216.582422:0:11893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788574216.582426:0:11893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8c565 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.582432:0:11893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8c565 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574216.582490:0:11893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:659467ff-94af-418e-92fe-11e4323a48aa+14:11299:x1875455668963712:12345-192.168.204.51@tcp:55:lhsmtool_posix.0 Request processed in 9426us (11514us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788574216.582499:0:11893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 92 00000100:00100000:1.0:1788574216.586828:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574216.587082:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668963968 00000100:00100000:2.0:1788574216.587094:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668963968 00000100:00100000:2.0:1788574216.587165:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 40 00000100:00100000:2.0:1788574216.587176:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:659467ff-94af-418e-92fe-11e4323a48aa+7:2396:x1875455668963968:12345-192.168.204.51@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788574216.587257:0:8409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000caa9a49e/0x5bf8706fdac8c56c lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.587280:0:8409:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003fa0120b/0x5bf8706fdac8c557 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d684a expref: 7 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.587288:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574216.587293:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788574216.587297:0:8409:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000caa9a49e/0x5bf8706fdac8c56c lrc: 4/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.587357:0:8409:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003fa0120b/0x5bf8706fdac8c557 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d684a expref: 7 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.587379:0:8409:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003fa0120b/0x5bf8706fdac8c557 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d684a expref: 7 pid: 8410 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574216.587397:0:8409:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3da7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8409:1875455681634432:192.168.204.51@tcp:104: 00000100:00100000:2.0:1788574216.587796:0:8409:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c3629b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788574216.594657:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574216.594709:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668964096 00000100:00100000:1.0:1788574216.594718:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668964096 00010000:00010000:1.0:1788574216.594786:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003fa0120b/0x5bf8706fdac8c557 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d684a expref: 8 pid: 8410 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574216.595909:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 61 00000100:00100000:1.0:1788574216.595925:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf3d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:659467ff-94af-418e-92fe-11e4323a48aa+8:2393:x1875455668964096:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788574216.595942:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574216.595965:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003fa0120b/0x5bf8706fdac8c557 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d684a expref: 8 pid: 8410 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574216.595981:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003fa0120b/0x5bf8706fdac8c557 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d684a expref: 8 pid: 8410 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574216.596008:0:6477:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788574216.596013:0:6477:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788574216.596020:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000caa9a49e/0x5bf8706fdac8c56c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574216.596030:0:6477:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000caa9a49e/0x5bf8706fdac8c56c lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574216.596051:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788574216.596100:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf3d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:659467ff-94af-418e-92fe-11e4323a48aa+8:2393:x1875455668964096:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 183us (1457us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574216.596107:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 61 00010000:00010000:2.0:1788574216.600451:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003fa0120b/0x5bf8706fdac8c557 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d684a expref: 7 pid: 8410 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574216.600493:0:8409:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3da7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8409:1875455681634432:192.168.204.51@tcp:104: 00010000:00010000:2.0:1788574216.600538:0:8409:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000caa9a49e/0x5bf8706fdac8c56c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.600554:0:8409:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000caa9a49e/0x5bf8706fdac8c56c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.600562:0:8409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000caa9a49e/0x5bf8706fdac8c56c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.600605:0:8409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000caa9a49e/0x5bf8706fdac8c56c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.600614:0:8409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000caa9a49e/0x5bf8706fdac8c56c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.600654:0:8409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000caa9a49e/0x5bf8706fdac8c56c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.600662:0:8409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32f000 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:2.0:1788574216.600667:0:8409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000caa9a49e/0x5bf8706fdac8c56c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.600678:0:8409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000caa9a49e/0x5bf8706fdac8c56c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.600705:0:8409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000caa9a49e/0x5bf8706fdac8c56c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574216.600713:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000caa9a49e/0x5bf8706fdac8c56c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574216.600848:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:659467ff-94af-418e-92fe-11e4323a48aa+6:2396:x1875455668963968:12345-192.168.204.51@tcp:1:lhsmtool_posix.0 Request processed in 13670us (14030us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574216.600861:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 40 00000100:00100000:1.0:1788574216.607920:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574216.608243:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668964352 00000100:00100000:3.0:1788574216.608256:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668964352 00000100:00100000:3.0:1788574216.608325:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 93 00000100:00100000:3.0:1788574216.608337:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+14:11299:x1875455668964352:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788574216.608425:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617800/0x5bf8706fdac8c573 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574216.608443:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616800/0x5bf8706fdac8c3b3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d67d3 expref: 14 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574216.608452:0:6493:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617800/0x5bf8706fdac8c573 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574216.608490:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616800/0x5bf8706fdac8c3b3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d67d3 expref: 14 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574216.608504:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616800/0x5bf8706fdac8c3b3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d67d3 expref: 14 pid: 7439 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574216.608523:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3768e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6493:1875455681634560:192.168.204.51@tcp:104: 00000100:00100000:3.0:1788574216.608627:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c267e900 going to sleep for 11 seconds 00000100:00100000:3.0:1788574216.611262:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3768e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6493:1875455681634560:192.168.204.51@tcp:104: 00010000:00010000:3.0:1788574216.611301:0:6493:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617800/0x5bf8706fdac8c573 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574216.611556:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574216.611624:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668964480 00000100:00100000:3.0:1788574216.611633:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668964480 00010000:00010000:3.0:1788574216.611673:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616800/0x5bf8706fdac8c3b3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d67d3 expref: 15 pid: 7439 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574216.611718:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 62 00000100:00100000:3.0:1788574216.611727:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e0bde050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:659467ff-94af-418e-92fe-11e4323a48aa+15:2393:x1875455668964480:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788574216.611744:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574216.611761:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616800/0x5bf8706fdac8c3b3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d67d3 expref: 15 pid: 7439 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574216.611773:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616800/0x5bf8706fdac8c3b3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d67d3 expref: 15 pid: 7439 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574216.611968:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616800/0x5bf8706fdac8c3b3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d67d3 expref: 15 pid: 7439 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574216.611988:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c85d5185900) 00010000:00010000:3.0:1788574216.611992:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617800/0x5bf8706fdac8c573 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574216.612004:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617800/0x5bf8706fdac8c573 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574216.612032:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617800/0x5bf8706fdac8c573 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574216.612102:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788574216.612160:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e0bde050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:659467ff-94af-418e-92fe-11e4323a48aa+14:2393:x1875455668964480:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 432us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574216.612168:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 62 00010000:00010000:1.0:1788574216.615178:0:6493:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617800/0x5bf8706fdac8c573 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574216.615389:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617800/0x5bf8706fdac8c573 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574216.615670:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c57a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574216.615688:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616a00/0x5bf8706fdac8c534 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6835 expref: 14 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574216.615697:0:6493:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c57a lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574216.615737:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616a00/0x5bf8706fdac8c534 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6835 expref: 14 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574216.615764:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616a00/0x5bf8706fdac8c534 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6835 expref: 14 pid: 7439 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574216.615779:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf3f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6493:1875455681634688:192.168.204.51@tcp:104: 00000100:00100000:1.0:1788574216.616050:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85fafee540 going to sleep for 11 seconds 00000100:00100000:3.0:1788574216.625081:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf3f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6493:1875455681634688:192.168.204.51@tcp:104: 00010000:00010000:3.0:1788574216.625115:0:6493:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c57a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574216.632537:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574216.632637:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668964608 00000100:00100000:3.0:1788574216.632656:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668964608 00010000:00010000:3.0:1788574216.632779:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616a00/0x5bf8706fdac8c534 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6835 expref: 15 pid: 7439 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574216.633509:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 63 00000100:00100000:3.0:1788574216.633524:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf3e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:659467ff-94af-418e-92fe-11e4323a48aa+15:2395:x1875455668964608:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788574216.633544:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574216.633552:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616a00/0x5bf8706fdac8c534 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6835 expref: 15 pid: 7439 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574216.633569:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616a00/0x5bf8706fdac8c534 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6835 expref: 15 pid: 7439 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574216.633596:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616a00/0x5bf8706fdac8c534 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6835 expref: 15 pid: 7439 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574216.633637:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9c85ec19ad00) 00010000:00010000:3.0:1788574216.633644:0:6477:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c57a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574216.633657:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c57a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574216.633666:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c57a lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574216.633760:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788574216.633856:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf3e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:659467ff-94af-418e-92fe-11e4323a48aa+14:2395:x1875455668964608:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 336us (1338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574216.633865:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 63 00010000:00010000:0.0:1788574216.639628:0:6493:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c57a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574216.639647:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c57a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788574216.639967:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:0.0:1788574216.640122:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:0.0:1788574216.640655:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:0.0:1788574216.640936:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c37a8700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6493:1875455681634816:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788574216.641017:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574216.641102:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c86002740c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788574216.643137:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681634816 00000100:00100000:3.0:1788574216.643158:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681634816 00000100:00100000:3.0:1788574216.643270:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788574216.643284:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c37a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6493:x1875455681634816:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788574216.643534:0:6493:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:0.0:1788574216.643542:0:6493:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c84c3768700, transno 4294967304 00000100:00100000:0.0:1788574216.643562:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c37a8700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6493:1875455681634816:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788574216.643591:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c37a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6493:x1875455681634816:12345-0@lo:1000:mdt00_001.0 Request processed in 306us (2573us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574216.643603:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000001:00080000:0.0:1788574216.643773:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:0.0:1788574216.643857:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c37a8700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6493:1875455681634944:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788574216.643910:0:6493:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574216.643947:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8600274540 going to sleep for 11 seconds 00000100:00100000:3.0:1788574216.643965:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681634944 00000100:00100000:3.0:1788574216.643971:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681634944 00000100:00100000:3.0:1788574216.644016:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788574216.644025:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c37aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6493:x1875455681634944:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788574216.644164:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c37aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6493:x1875455681634944:12345-0@lo:1000:mdt00_001.0 Request processed in 140us (254us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1788574216.644222:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788574216.644325:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c37a8700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6493:1875455681634944:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1788574216.644365:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c57a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574216.644376:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c57a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574216.644383:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c57a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574216.644391:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85faea2e00 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:0.0:1788574216.644398:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c57a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574216.644407:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c57a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574216.644436:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9c85ec19ad00) 00010000:00010000:0.0:1788574216.644439:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788574216.644445:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c57a lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574216.644451:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c57a lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574216.644562:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c4a8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574216.644571:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c4a8 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574216.644576:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c4a8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574216.644581:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d7e00 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:0.0:1788574216.644584:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c4a8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574216.644590:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c4a8 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574216.644602:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c85d5185900) 00010000:00010000:0.0:1788574216.644605:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788574216.644608:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c4a8 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574216.644614:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c4a8 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574216.644804:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8c581 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574216.644824:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7c00/0x5bf8706fdac8c4c4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6819 expref: 17 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574216.644834:0:6493:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8c581 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574216.644871:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7c00/0x5bf8706fdac8c4c4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6819 expref: 17 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574216.645011:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7c00/0x5bf8706fdac8c4c4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6819 expref: 17 pid: 6494 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574216.645025:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c37aa300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6493:1875455681635072:192.168.204.51@tcp:104: 00000100:00100000:0.0:1788574216.645172:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8600274540 going to sleep for 11 seconds 00000100:00100000:3.0:1788574216.652668:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c37aa300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6493:1875455681635072:192.168.204.51@tcp:104: 00010000:00010000:3.0:1788574216.652706:0:6493:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8c581 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574216.661252:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574216.661365:0:7433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668964736 00000100:00100000:3.0:1788574216.661376:0:7433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668964736 00010000:00010000:3.0:1788574216.661430:0:7433:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7c00/0x5bf8706fdac8c4c4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6819 expref: 18 pid: 6494 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574216.661910:0:7433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 64 00000100:00100000:3.0:1788574216.661924:0:7433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3768e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:659467ff-94af-418e-92fe-11e4323a48aa+18:2393:x1875455668964736:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788574216.661944:0:7433:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574216.661954:0:7433:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7c00/0x5bf8706fdac8c4c4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6819 expref: 18 pid: 6494 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574216.661972:0:7433:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7c00/0x5bf8706fdac8c4c4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6819 expref: 18 pid: 6494 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574216.661999:0:7433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7c00/0x5bf8706fdac8c4c4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6819 expref: 18 pid: 6494 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574216.662019:0:7433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c85d5185900) 00010000:00010000:3.0:1788574216.662025:0:7433:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8c581 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574216.662058:0:7433:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8c581 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574216.662068:0:7433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8c581 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574216.662102:0:7433:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788574216.662271:0:7433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3768e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:659467ff-94af-418e-92fe-11e4323a48aa+17:2393:x1875455668964736:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 351us (1030us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574216.662279:0:7433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 64 00010000:00010000:3.0:1788574216.663052:0:6493:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8c581 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574216.663067:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8c581 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574216.663082:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8c581 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574216.663089:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8c581 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574216.663096:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8c581 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574216.663102:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d7200 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:3.0:1788574216.663106:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8c581 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574216.663114:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8c581 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574216.663140:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c85d5185900) 00010000:00010000:3.0:1788574216.663143:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574216.663147:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8c581 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574216.663154:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8c581 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574216.663168:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617800/0x5bf8706fdac8c573 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574216.663173:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617800/0x5bf8706fdac8c573 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574216.663179:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617800/0x5bf8706fdac8c573 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574216.663184:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c84c2617800 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:3.0:1788574216.663187:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617800/0x5bf8706fdac8c573 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574216.663218:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617800/0x5bf8706fdac8c573 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574216.663227:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c85d5185900) 00010000:00010000:3.0:1788574216.663230:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788574216.663232:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617800/0x5bf8706fdac8c573 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574216.663238:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617800/0x5bf8706fdac8c573 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574216.664072:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+16:11299:x1875455668964352:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 Request processed in 55729us (56156us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1788574216.664090:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 93 00000020:00080000:3.0:1788574216.664098:0:6493:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788574216.665341:0:13764:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788574216.665351:0:13764:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788574216.665372:0:13764:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788574216.665382:0:13764:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788574216.667984:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574216.668756:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668964992 00000100:00100000:0.0:1788574216.668770:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668964992 00000100:00100000:0.0:1788574216.668835:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 20 00000100:00100000:0.0:1788574216.668846:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c376a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:659467ff-94af-418e-92fe-11e4323a48aa+16:11299:x1875455668964992:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788574216.669480:0:6496:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788574216.669519:0:6496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:0.0:1788574216.669627:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6a00/0x5bf8706fdac8c588 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574216.669647:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6a00/0x5bf8706fdac8c588 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574216.669659:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6a00/0x5bf8706fdac8c588 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574216.669668:0:6496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6a00/0x5bf8706fdac8c588 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574216.669675:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6a00/0x5bf8706fdac8c588 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574216.669681:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6a00/0x5bf8706fdac8c588 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574216.669752:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788574216.669856:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c376a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:659467ff-94af-418e-92fe-11e4323a48aa+18:11299:x1875455668964992:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 Request processed in 1009us (1880us total) trans 4294967364 rc 0/0 00000100:00100000:0.0:1788574216.669866:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 20 00000020:00080000:0.0:1788574216.669872:0:6496:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788574216.672210:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788574216.672226:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6a00/0x5bf8706fdac8c588 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574216.672362:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d6a00 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:3.0:1788574216.672367:0:6481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6a00/0x5bf8706fdac8c588 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574216.672376:0:6481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6a00/0x5bf8706fdac8c588 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574216.672395:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9c85ec19ad00) 00010000:00010000:3.0:1788574216.672398:0:6481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788574216.672402:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6a00/0x5bf8706fdac8c588 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574216.672408:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6a00/0x5bf8706fdac8c588 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574216.672426:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574216.672428:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574216.672430:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788574216.841565:0:14185:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788574216.841578:0:14185:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788574216.841621:0:14185:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788574216.841628:0:14185:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788574216.851363:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574217.052444:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574217.057747:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668965248 00000100:00100000:1.0:1788574217.057771:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668965248 00000100:00100000:3.0:1788574217.058085:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 94 00000100:00100000:3.0:1788574217.058101:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c37aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+18:11308:x1875455668965248:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:3.0:1788574217.058149:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574217.058177:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617800/0x5bf8706fdac8c58f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6851 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.058607:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616800/0x5bf8706fdac8c596 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.058628:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616800/0x5bf8706fdac8c596 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.058645:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616800/0x5bf8706fdac8c596 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788574217.058660:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1788574217.058815:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617800/0x5bf8706fdac8c58f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6851 expref: 21 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.058837:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616800/0x5bf8706fdac8c596 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6851 expref: 20 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.058846:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c85ec19ac00) 00010000:00010000:3.0:1788574217.058850:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788574217.058855:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c84c2616800, rc 0) 00000100:00080000:1.0:1788574217.059032:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788574217.062239:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c37aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+20:11308:x1875455668965248:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 4091us (9762us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1788574217.062257:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 94 00000100:00100000:0.0:1788574217.071253:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574217.071539:0:11893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668965376 00000100:00100000:2.0:1788574217.071555:0:11893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668965376 00000100:00100000:2.0:1788574217.071667:0:11893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 95 00000100:00100000:2.0:1788574217.071681:0:11893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c37a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:659467ff-94af-418e-92fe-11e4323a48aa+20:11308:x1875455668965376:12345-192.168.204.51@tcp:34:lfs.0 00010000:00010000:2.0:1788574217.071836:0:11893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f000/0x5bf8706fdac8c5a4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574217.071868:0:11893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f000/0x5bf8706fdac8c5a4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574217.071885:0:11893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f000/0x5bf8706fdac8c5a4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574217.071906:0:11893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8c5ab lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574217.071915:0:11893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8c5ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574217.071922:0:11893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8c5ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574217.072049:0:11893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f200/0x5bf8706fdac8c5b2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574217.072056:0:11893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f200/0x5bf8706fdac8c5b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574217.072064:0:11893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f200/0x5bf8706fdac8c5b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788574217.072134:0:11893:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f200/0x5bf8706fdac8c5b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574217.072151:0:11893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f000/0x5bf8706fdac8c5a4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574217.072165:0:11893:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f000/0x5bf8706fdac8c5a4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574217.072173:0:11893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f000/0x5bf8706fdac8c5a4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574217.072180:0:11893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32f000 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:2.0:1788574217.072185:0:11893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f000/0x5bf8706fdac8c5a4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574217.072227:0:11893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f000/0x5bf8706fdac8c5a4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574217.072243:0:11893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c85ec19ac00) 00010000:00010000:2.0:1788574217.072246:0:11893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788574217.072252:0:11893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f000/0x5bf8706fdac8c5a4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574217.072259:0:11893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f000/0x5bf8706fdac8c5a4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574217.072275:0:11893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8c5ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574217.072281:0:11893:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8c5ab lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574217.072296:0:11893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8c5ab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574217.072301:0:11893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32e000 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:2.0:1788574217.072312:0:11893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8c5ab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574217.072318:0:11893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8c5ab lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574217.072326:0:11893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c85ec19a700) 00010000:00010000:2.0:1788574217.072328:0:11893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788574217.072332:0:11893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8c5ab lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574217.072338:0:11893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8c5ab lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574217.072356:0:11893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f200/0x5bf8706fdac8c5b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574217.072362:0:11893:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f200/0x5bf8706fdac8c5b2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574217.072368:0:11893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f200/0x5bf8706fdac8c5b2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574217.072373:0:11893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32f200 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:2.0:1788574217.072375:0:11893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f200/0x5bf8706fdac8c5b2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574217.072381:0:11893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f200/0x5bf8706fdac8c5b2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574217.072388:0:11893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c85ec19aa00) 00010000:00010000:2.0:1788574217.072390:0:11893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788574217.072399:0:11893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f200/0x5bf8706fdac8c5b2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574217.072404:0:11893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f200/0x5bf8706fdac8c5b2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574217.072515:0:11893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c37a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:659467ff-94af-418e-92fe-11e4323a48aa+20:11308:x1875455668965376:12345-192.168.204.51@tcp:34:lfs.0 Request processed in 836us (1276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574217.072525:0:11893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 95 00000100:00100000:3.0:1788574217.143874:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574217.143914:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668965632 00000100:00100000:3.0:1788574217.143928:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668965632 00000100:00100000:3.0:1788574217.144015:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 96 00000100:00100000:3.0:1788574217.144027:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c376a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+20:11312:x1875455668965632:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:3.0:1788574217.144059:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574217.144089:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617800/0x5bf8706fdac8c5b9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6858 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.144212:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616a00/0x5bf8706fdac8c5c0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.144231:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616a00/0x5bf8706fdac8c5c0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.144245:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616a00/0x5bf8706fdac8c5c0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.144263:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616400/0x5bf8706fdac8c5c7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.144272:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616400/0x5bf8706fdac8c5c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.144278:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616400/0x5bf8706fdac8c5c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.144448:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616000/0x5bf8706fdac8c5ce lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.144457:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616000/0x5bf8706fdac8c5ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.144465:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616000/0x5bf8706fdac8c5ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788574217.144489:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:3.0:1788574217.144592:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616a00/0x5bf8706fdac8c5c0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.144600:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616a00/0x5bf8706fdac8c5c0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.144607:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616a00/0x5bf8706fdac8c5c0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.144613:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c84c2616a00 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:3.0:1788574217.144618:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616a00/0x5bf8706fdac8c5c0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.144627:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616a00/0x5bf8706fdac8c5c0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.144641:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c85ec19ac00) 00010000:00010000:3.0:1788574217.144645:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574217.144651:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616a00/0x5bf8706fdac8c5c0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.144658:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616a00/0x5bf8706fdac8c5c0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.144671:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616400/0x5bf8706fdac8c5c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.144678:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616400/0x5bf8706fdac8c5c7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.144695:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616400/0x5bf8706fdac8c5c7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.144700:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c84c2616400 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:3.0:1788574217.144703:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616400/0x5bf8706fdac8c5c7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.144709:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616400/0x5bf8706fdac8c5c7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.144717:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c85c3ba6c00) 00010000:00010000:3.0:1788574217.144719:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574217.144722:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616400/0x5bf8706fdac8c5c7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.144728:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616400/0x5bf8706fdac8c5c7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.144791:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617800/0x5bf8706fdac8c5b9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6858 expref: 23 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.144806:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616000/0x5bf8706fdac8c5ce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6858 expref: 22 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.144814:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c85c3ba6200) 00010000:00010000:3.0:1788574217.144817:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788574217.144819:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c84c2616000, rc 0) 00000100:00100000:3.0:1788574217.144907:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c376a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+22:11312:x1875455668965632:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 882us (1048us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1788574217.144926:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 96 00000100:00100000:2.0:1788574217.157748:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574217.157843:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668965760 00000100:00100000:3.0:1788574217.157858:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668965760 00000100:00100000:3.0:1788574217.157935:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 97 00000100:00100000:3.0:1788574217.157947:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3da7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+22:11312:x1875455668965760:12345-192.168.204.51@tcp:54:lfs.0 00010000:00010000:3.0:1788574217.158045:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617800/0x5bf8706fdac8c5dc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.158069:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617800/0x5bf8706fdac8c5dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.158085:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617800/0x5bf8706fdac8c5dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.158138:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617800/0x5bf8706fdac8c5dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.158146:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617800/0x5bf8706fdac8c5dc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.158154:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617800/0x5bf8706fdac8c5dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.158161:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c84c2617800 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:3.0:1788574217.158167:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617800/0x5bf8706fdac8c5dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.158176:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617800/0x5bf8706fdac8c5dc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.158219:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c85c3ba6200) 00010000:00010000:3.0:1788574217.158237:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788574217.158243:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617800/0x5bf8706fdac8c5dc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.158251:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617800/0x5bf8706fdac8c5dc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574217.158463:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3da7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+22:11312:x1875455668965760:12345-192.168.204.51@tcp:54:lfs.0 Request processed in 517us (740us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574217.158473:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 97 00000100:00100000:1.0:1788574217.162626:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574217.162666:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668966016 00000100:00100000:1.0:1788574217.162678:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668966016 00000100:00100000:1.0:1788574217.162758:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 21 00000100:00100000:1.0:1788574217.162788:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85d01f6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:659467ff-94af-418e-92fe-11e4323a48aa+22:11312:x1875455668966016:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:1.0:1788574217.163088:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85d01f6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:659467ff-94af-418e-92fe-11e4323a48aa+23:11312:x1875455668966016:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 302us (476us total) trans 4294967367 rc 0/0 00000100:00100000:1.0:1788574217.163097:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 21 00000100:00100000:3.0:1788574217.240380:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574217.240586:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668966272 00000100:00100000:2.0:1788574217.240600:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668966272 00000100:00100000:2.0:1788574217.240717:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 98 00000100:00100000:2.0:1788574217.240731:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c376ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+23:10838:x1875455668966272:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:2.0:1788574217.240783:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574217.240813:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8c5e3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d685f expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574217.240962:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f000/0x5bf8706fdac8c5ea lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574217.240982:0:6492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616000/0x5bf8706fdac8c5ce lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6858 expref: 24 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574217.240993:0:6492:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f000/0x5bf8706fdac8c5ea lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574217.241038:0:6492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616000/0x5bf8706fdac8c5ce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6858 expref: 24 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574217.241092:0:6492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616000/0x5bf8706fdac8c5ce lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6858 expref: 24 pid: 6493 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574217.241110:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3da4380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6492:1875455681635200:192.168.204.51@tcp:104: 00000100:00100000:2.0:1788574217.241369:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c36293c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788574217.249861:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574217.250168:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668966400 00000100:00100000:1.0:1788574217.250231:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668966400 00010000:00010000:1.0:1788574217.250284:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616000/0x5bf8706fdac8c5ce lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6858 expref: 25 pid: 6493 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574217.250325:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 65 00000100:00100000:1.0:1788574217.250336:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3769f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:659467ff-94af-418e-92fe-11e4323a48aa+25:2393:x1875455668966400:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788574217.250352:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574217.250359:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616000/0x5bf8706fdac8c5ce lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6858 expref: 25 pid: 6493 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574217.250373:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616000/0x5bf8706fdac8c5ce lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6858 expref: 25 pid: 6493 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574217.250396:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c85c3ba6200) 00010000:00010000:1.0:1788574217.250401:0:6478:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f000/0x5bf8706fdac8c5ea lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574217.250410:0:6478:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f000/0x5bf8706fdac8c5ea lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574217.250419:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f000/0x5bf8706fdac8c5ea lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574217.250519:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788574217.250651:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3769f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:659467ff-94af-418e-92fe-11e4323a48aa+25:2393:x1875455668966400:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 315us (804us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574217.250659:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 65 00010000:00010000:2.0:1788574217.252482:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616000/0x5bf8706fdac8c5ce lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6858 expref: 24 pid: 6493 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574217.252507:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3da4380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6492:1875455681635200:192.168.204.51@tcp:104: 00010000:00010000:2.0:1788574217.252532:0:6492:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f000/0x5bf8706fdac8c5ea lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574217.252706:0:6492:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f000/0x5bf8706fdac8c5ea lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574217.252714:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f000/0x5bf8706fdac8c5ea lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788574217.252744:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:2.0:1788574217.254637:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8c5e3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d685f expref: 25 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574217.254664:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f000/0x5bf8706fdac8c5ea lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d685f expref: 24 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574217.254675:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c85c3ba6200) 00010000:00010000:2.0:1788574217.254694:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788574217.254698:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85fa32f000, rc 0) 00000100:00100000:2.0:1788574217.254787:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c376ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+24:10838:x1875455668966272:12345-192.168.204.51@tcp:101:bash.0 Request processed in 14058us (14421us total) trans 4294967368 rc 0/0 00000100:00100000:2.0:1788574217.254796:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 98 00000100:00100000:3.0:1788574217.286496:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574217.286655:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668966528 00000100:00100000:0.0:1788574217.286671:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668966528 00000100:00100000:0.0:1788574217.286757:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 99 00000100:00100000:0.0:1788574217.286769:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c376a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+24:10838:x1875455668966528:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:0.0:1788574217.286797:0:7439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574217.286821:0:7439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8c5f8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6866 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574217.286877:0:7439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c5ff lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574217.286893:0:7439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c5ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574217.286904:0:7439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c5ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574217.287031:0:7439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8c5f8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6866 expref: 26 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574217.287052:0:7439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c5ff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6866 expref: 25 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574217.287061:0:7439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c85c3ba6200) 00010000:00010000:0.0:1788574217.287065:0:7439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788574217.287068:0:7439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d20d6600, rc 0) 00000100:00100000:0.0:1788574217.287139:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c376a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+25:10838:x1875455668966528:12345-192.168.204.51@tcp:101:bash.0 Request processed in 372us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574217.287147:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 99 00000100:00100000:1.0:1788574217.294417:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574217.301894:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668966784 00000100:00100000:3.0:1788574217.301911:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668966784 00000100:00100000:3.0:1788574217.301999:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 100 00000100:00100000:3.0:1788574217.302011:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+25:10838:x1875455668966784:12345-192.168.204.51@tcp:36:bash.0 00010000:00010000:3.0:1788574217.302636:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617800/0x5bf8706fdac8c606 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.302660:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617800/0x5bf8706fdac8c606 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.302674:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617800/0x5bf8706fdac8c606 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788574217.302718:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:3.0:1788574217.302757:0:6494:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000796758f1 reply state 00000000daee35bc transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617800/0x5bf8706fdac8c606 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.302770:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617800/0x5bf8706fdac8c606 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.302794:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c85c3ba6200) 00010000:00010000:3.0:1788574217.302797:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788574217.302801:0:6494:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1788574217.302878:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:3.0:1788574217.303012:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+29:10838:x1875455668966784:12345-192.168.204.51@tcp:36:bash.0 Request processed in 1001us (8601us total) trans 4294967371 rc 0/0 00000100:00100000:3.0:1788574217.303020:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 100 00000020:00080000:3.0:1788574217.303025:0:6494:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1788574217.307552:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574217.315655:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668966912 00000100:00100000:2.0:1788574217.315675:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668966912 00000100:00100000:2.0:1788574217.315763:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 101 00000100:00100000:2.0:1788574217.315776:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+29:10838:x1875455668966912:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:2.0:1788574217.315803:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574217.315827:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8c60d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d686d expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574217.315891:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8c60d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d686d expref: 30 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574217.315908:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8c60d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d686d expref: 30 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574217.315928:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c85c3ba6200) 00010000:00010000:2.0:1788574217.315932:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788574217.315937:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85fa32e000, rc 0) 00000100:00100000:2.0:1788574217.316019:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+30:10838:x1875455668966912:12345-192.168.204.51@tcp:101:bash.0 Request processed in 246us (8480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574217.316026:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 101 00000100:00100000:1.0:1788574217.330856:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574217.333936:0:13791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668967040 00000100:00100000:0.0:1788574217.333953:0:13791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668967040 00000100:00100000:0.0:1788574217.334163:0:13791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 41 00000100:00100000:0.0:1788574217.334178:0:13791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85d10df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:659467ff-94af-418e-92fe-11e4323a48aa+6:10838:x1875455668967040:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:0.0:1788574217.334236:0:13791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574217.334260:0:13791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3810157/0x5bf8706fdac8c614 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6874 expref: -99 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788574217.334317:0:13791:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a9b7a06, atime: 0x6a9b7a05, ctime: 0x6a9b7a06, blocks: 0x8 00010000:00010000:0.0:1788574217.334345:0:13791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=357s v=(0 0) 00010000:00010000:0.0:1788574217.334350:0:13791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788574217.334360:0:13791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3810157/0x5bf8706fdac8c614 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6874 expref: 7 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574217.334381:0:13791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f3810157/0x5bf8706fdac8c614 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6874 expref: 7 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574217.334397:0:13791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d20d6400, rc 0) 00000100:00100000:0.0:1788574217.334483:0:13791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85d10df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:659467ff-94af-418e-92fe-11e4323a48aa+7:10838:x1875455668967040:12345-192.168.204.51@tcp:101:bash.0 Request processed in 309us (3640us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574217.340108:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574217.340317:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668967168 00000100:00100000:3.0:1788574217.340328:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668967168 00002000:00010000:3.0:1788574217.340375:0:8414:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:3.0:1788574217.340380:0:8414:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c85d10dd500 with x1875455668967168 ext(0->18446744073709551615) 00002000:00010000:3.0:1788574217.340392:0:8414:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c85d10dd500. 00000100:00100000:3.0:1788574217.340434:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 1 00000100:00100000:3.0:1788574217.340445:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85d10dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:659467ff-94af-418e-92fe-11e4323a48aa+8:2396:x1875455668967168:12345-192.168.204.51@tcp:10:bash.0 00002000:00010000:3.0:1788574217.340760:0:8414:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1788574217.340765:0:8414:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1788574214 -> 1788574216 00002000:00010000:3.0:1788574217.340768:0:8414:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 1788574213 -> 1788574213 00002000:00010000:3.0:1788574217.340770:0:8414:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1788574214 -> 1788574216 00002000:00010000:3.0:1788574217.340773:0:8414:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:3.0:1788574217.340836:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85d10dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:659467ff-94af-418e-92fe-11e4323a48aa+9:2396:x1875455668967168:12345-192.168.204.51@tcp:10:bash.0 Request processed in 392us (737us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788574217.340844:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 1 00002000:00010000:3.0:1788574217.340848:0:8414:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:3.0:1788574217.340851:0:8414:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c85d10dd500 with x1875455668967168 ext(0->18446744073709551615) 00002000:00010000:3.0:1788574217.340856:0:8414:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c85d10dd500. 00000100:00100000:0.0:1788574217.342347:0:13791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 41 00000100:00100000:2.0:1788574217.509867:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574217.509989:0:11893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668967296 00000100:00100000:1.0:1788574217.510001:0:11893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668967296 00000100:00100000:1.0:1788574217.510071:0:11893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 102 00000100:00100000:1.0:1788574217.510082:0:11893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3da4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:659467ff-94af-418e-92fe-11e4323a48aa+30:11326:x1875455668967296:12345-192.168.204.51@tcp:34:lfs.0 00010000:00010000:1.0:1788574217.510162:0:11893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c61b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574217.510182:0:11893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c61b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574217.510239:0:11893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c61b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574217.510256:0:11893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8c622 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574217.510264:0:11893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8c622 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574217.510270:0:11893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8c622 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574217.510364:0:11893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8c629 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574217.510373:0:11893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8c629 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574217.510380:0:11893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8c629 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788574217.510441:0:11893:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8c629 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574217.510453:0:11893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c61b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574217.510459:0:11893:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c61b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574217.510465:0:11893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c61b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574217.510471:0:11893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85faea2000 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:1.0:1788574217.510475:0:11893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c61b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574217.510482:0:11893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c61b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574217.510493:0:11893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c85ec19ac00) 00010000:00010000:1.0:1788574217.510496:0:11893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788574217.510500:0:11893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c61b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574217.510512:0:11893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c61b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574217.510525:0:11893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8c622 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574217.510531:0:11893:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8c622 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574217.510535:0:11893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8c622 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574217.510540:0:11893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85faea3e00 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:1.0:1788574217.510543:0:11893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8c622 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574217.510548:0:11893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8c622 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574217.510554:0:11893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c84c34f0e00) 00010000:00010000:1.0:1788574217.510557:0:11893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788574217.510560:0:11893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8c622 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574217.510566:0:11893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8c622 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574217.510580:0:11893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8c629 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574217.510774:0:11893:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8c629 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574217.510792:0:11893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8c629 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574217.510798:0:11893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85faea3800 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:1.0:1788574217.510801:0:11893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8c629 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574217.510808:0:11893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8c629 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574217.510816:0:11893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c85c3ba6200) 00010000:00010000:1.0:1788574217.510819:0:11893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788574217.510821:0:11893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8c629 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574217.510827:0:11893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8c629 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574217.510913:0:11893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3da4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:659467ff-94af-418e-92fe-11e4323a48aa+30:11326:x1875455668967296:12345-192.168.204.51@tcp:34:lfs.0 Request processed in 831us (1055us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574217.510922:0:11893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 102 00000100:00100000:1.0:1788574217.580964:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574217.581390:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668967552 00000100:00100000:3.0:1788574217.581406:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668967552 00000100:00100000:3.0:1788574217.581488:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 103 00000100:00100000:3.0:1788574217.581502:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+30:11329:x1875455668967552:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:3.0:1788574217.581530:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574217.581558:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616400/0x5bf8706fdac8c630 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d687b expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.581810:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616a00/0x5bf8706fdac8c637 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.581830:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616a00/0x5bf8706fdac8c637 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.581844:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616a00/0x5bf8706fdac8c637 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.581862:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617a00/0x5bf8706fdac8c63e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.581869:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617a00/0x5bf8706fdac8c63e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.581877:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617a00/0x5bf8706fdac8c63e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.582567:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8c645 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.582584:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8c645 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.582621:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8c645 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788574217.582634:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788574217.582970:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616a00/0x5bf8706fdac8c637 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.582978:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616a00/0x5bf8706fdac8c637 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.582987:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616a00/0x5bf8706fdac8c637 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.582994:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c84c2616a00 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:3.0:1788574217.583000:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616a00/0x5bf8706fdac8c637 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.583008:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616a00/0x5bf8706fdac8c637 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.583163:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c85ec19ac00) 00010000:00010000:3.0:1788574217.583167:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574217.583174:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616a00/0x5bf8706fdac8c637 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.583181:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616a00/0x5bf8706fdac8c637 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.583358:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617a00/0x5bf8706fdac8c63e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.583367:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617a00/0x5bf8706fdac8c63e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.583384:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617a00/0x5bf8706fdac8c63e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.583390:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c84c2617a00 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:3.0:1788574217.583393:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617a00/0x5bf8706fdac8c63e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.583400:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617a00/0x5bf8706fdac8c63e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.583410:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c85c3ba6c00) 00010000:00010000:3.0:1788574217.583413:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574217.583416:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617a00/0x5bf8706fdac8c63e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.583421:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617a00/0x5bf8706fdac8c63e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.583485:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616400/0x5bf8706fdac8c630 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d687b expref: 33 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.583503:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8c645 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d687b expref: 32 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.583512:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c85c3ba6200) 00010000:00010000:3.0:1788574217.583514:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788574217.583517:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c84c2617000, rc 0) 00000100:00100000:3.0:1788574217.583798:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+32:11329:x1875455668967552:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 2296us (2916us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1788574217.583818:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 103 00000100:00100000:3.0:1788574217.589668:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574217.589899:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668967680 00000100:00100000:0.0:1788574217.589914:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668967680 00000100:00100000:0.0:1788574217.589994:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 104 00000100:00100000:0.0:1788574217.590007:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3768700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+32:11329:x1875455668967680:12345-192.168.204.51@tcp:54:lfs.0 00010000:00010000:0.0:1788574217.590374:0:7439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c653 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574217.590397:0:7439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f000/0x5bf8706fdac8c5ea lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d685f expref: 32 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574217.590410:0:7439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c653 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574217.590481:0:7439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f000/0x5bf8706fdac8c5ea lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d685f expref: 32 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574217.590498:0:7439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f000/0x5bf8706fdac8c5ea lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d685f expref: 32 pid: 6492 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574217.590517:0:7439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c37a9880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7439:1875455681635328:192.168.204.51@tcp:104: 00000100:00100000:0.0:1788574217.590723:0:7439:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8600274a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788574217.597311:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574217.597511:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668967936 00000100:00100000:2.0:1788574217.597550:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668967936 00000100:00100000:2.0:1788574217.597633:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 22 00000100:00100000:2.0:1788574217.597662:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:659467ff-94af-418e-92fe-11e4323a48aa+33:6161:x1875455668967936:12345-192.168.204.51@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788574217.598312:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:659467ff-94af-418e-92fe-11e4323a48aa+34:6161:x1875455668967936:12345-192.168.204.51@tcp:35:ldlm_bl.0 Request processed in 650us (3294us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1788574217.598324:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 22 00000100:00100000:0.0:1788574217.598388:0:7439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c37a9880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7439:1875455681635328:192.168.204.51@tcp:104: 00010000:00010000:0.0:1788574217.598428:0:7439:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c653 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574217.603999:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574217.604150:0:7433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668968064 00000100:00100000:3.0:1788574217.604163:0:7433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668968064 00010000:00010000:3.0:1788574217.604605:0:7433:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f000/0x5bf8706fdac8c5ea lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d685f expref: 34 pid: 6492 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574217.604657:0:7433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 66 00000100:00100000:3.0:1788574217.604671:0:7433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36ed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:659467ff-94af-418e-92fe-11e4323a48aa+34:2393:x1875455668968064:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788574217.604691:0:7433:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574217.604700:0:7433:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f000/0x5bf8706fdac8c5ea lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d685f expref: 34 pid: 6492 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.604716:0:7433:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f000/0x5bf8706fdac8c5ea lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d685f expref: 34 pid: 6492 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.604756:0:7433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f000/0x5bf8706fdac8c5ea lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d685f expref: 34 pid: 6492 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.604853:0:7433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c85c3ba6200) 00010000:00010000:3.0:1788574217.604860:0:7433:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c653 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.604872:0:7433:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c653 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.604881:0:7433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c653 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.604950:0:7433:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788574217.606616:0:7439:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c653 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574217.606636:0:7439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c653 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574217.606722:0:7439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c653 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574217.606741:0:7439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c653 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574217.606750:0:7439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c653 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574217.606756:0:7439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d7e00 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:1.0:1788574217.606762:0:7439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c653 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574217.606914:0:7433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36ed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:659467ff-94af-418e-92fe-11e4323a48aa+33:2393:x1875455668968064:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 2241us (2925us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574217.606929:0:7433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 66 00010000:00010000:1.0:1788574217.608906:0:7439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c653 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574217.608931:0:7439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c85c3ba6200) 00010000:00010000:1.0:1788574217.608935:0:7439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788574217.608944:0:7439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c653 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574217.608953:0:7439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c653 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574217.612706:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3768700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+32:11329:x1875455668967680:12345-192.168.204.51@tcp:54:lfs.0 Request processed in 22681us (23033us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574217.612736:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 104 00000100:00100000:1.0:1788574217.624496:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574217.625091:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668968320 00000100:00100000:2.0:1788574217.625107:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668968320 00000100:00100000:2.0:1788574217.625934:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 23 00000100:00100000:2.0:1788574217.625954:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:659467ff-94af-418e-92fe-11e4323a48aa+32:11329:x1875455668968320:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:2.0:1788574217.626885:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:659467ff-94af-418e-92fe-11e4323a48aa+33:11329:x1875455668968320:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 933us (2402us total) trans 4294967374 rc 0/0 00000100:00100000:2.0:1788574217.626897:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 23 00000100:00100000:3.0:1788574217.790397:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574217.791097:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668968576 00000100:00100000:0.0:1788574217.791116:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668968576 00000100:00100000:2.0:1788574217.793049:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 105 00000100:00100000:2.0:1788574217.793091:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c376bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+33:11340:x1875455668968576:12345-192.168.204.51@tcp:101:cat.0 00010000:00010000:2.0:1788574217.793132:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574217.793164:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8c65a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6882 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574217.793331:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f000/0x5bf8706fdac8c661 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574217.793351:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f000/0x5bf8706fdac8c661 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574217.793366:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f000/0x5bf8706fdac8c661 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574217.793410:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ee00/0x5bf8706fdac8c668 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574217.793419:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ee00/0x5bf8706fdac8c668 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574217.793426:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ee00/0x5bf8706fdac8c668 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574217.793584:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f400/0x5bf8706fdac8c66f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574217.793596:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f400/0x5bf8706fdac8c66f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574217.793604:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f400/0x5bf8706fdac8c66f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788574217.793616:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:2.0:1788574217.793736:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f000/0x5bf8706fdac8c661 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574217.793745:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f000/0x5bf8706fdac8c661 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574217.793752:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f000/0x5bf8706fdac8c661 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574217.793760:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32f000 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:2.0:1788574217.793766:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f000/0x5bf8706fdac8c661 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574217.793790:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f000/0x5bf8706fdac8c661 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574217.793804:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c85ec19ac00) 00010000:00010000:2.0:1788574217.793807:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788574217.793812:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f000/0x5bf8706fdac8c661 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574217.793818:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f000/0x5bf8706fdac8c661 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574217.793834:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ee00/0x5bf8706fdac8c668 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574217.793853:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ee00/0x5bf8706fdac8c668 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574217.793860:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ee00/0x5bf8706fdac8c668 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574217.793865:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32ee00 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:2.0:1788574217.793868:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ee00/0x5bf8706fdac8c668 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574217.793874:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ee00/0x5bf8706fdac8c668 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574217.793882:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c85ec19aa00) 00010000:00010000:2.0:1788574217.793885:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788574217.793888:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ee00/0x5bf8706fdac8c668 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574217.793905:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ee00/0x5bf8706fdac8c668 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574217.793962:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8c65a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6882 expref: 36 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574217.793977:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f400/0x5bf8706fdac8c66f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6882 expref: 35 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574217.793985:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c85c3ba6200) 00010000:00010000:2.0:1788574217.793987:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788574217.793991:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85fa32f400, rc 0) 00000100:00100000:2.0:1788574217.794096:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c376bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+35:11340:x1875455668968576:12345-192.168.204.51@tcp:101:cat.0 Request processed in 1028us (3718us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1788574217.794105:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 105 00000100:00100000:1.0:1788574217.804230:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574217.804357:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668968832 00000100:00100000:0.0:1788574217.804371:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668968832 00000100:00100000:0.0:1788574217.804660:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 24 00000100:00100000:0.0:1788574217.804676:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:659467ff-94af-418e-92fe-11e4323a48aa+35:11340:x1875455668968832:12345-192.168.204.51@tcp:35:cat.0 00000100:00100000:0.0:1788574217.805118:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:659467ff-94af-418e-92fe-11e4323a48aa+36:11340:x1875455668968832:12345-192.168.204.51@tcp:35:cat.0 Request processed in 445us (898us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1788574217.805127:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 24 00000100:00100000:1.0:1788574217.834824:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574217.835783:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668969088 00000100:00100000:3.0:1788574217.835802:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668969088 00000100:00100000:3.0:1788574217.835896:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 106 00000100:00100000:3.0:1788574217.835908:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+36:11341:x1875455668969088:12345-192.168.204.51@tcp:36:rm.0 00010000:00010000:3.0:1788574217.835993:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1788574217.836030:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8c60d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d686d expref: 36 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.836059:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f400/0x5bf8706fdac8c66f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6882 expref: 35 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.836073:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8c645 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d687b expref: 34 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.836086:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c5ff lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6866 expref: 33 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.836100:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c85c3ba6200) 00010000:00010000:3.0:1788574217.836107:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788574217.836142:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616400/0x5bf8706fdac8c67d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.836178:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616400/0x5bf8706fdac8c67d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.836233:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616400/0x5bf8706fdac8c67d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.836254:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617a00/0x5bf8706fdac8c684 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.836262:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617a00/0x5bf8706fdac8c684 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.836279:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617a00/0x5bf8706fdac8c684 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.837248:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616a00/0x5bf8706fdac8c68b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.837400:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616a00/0x5bf8706fdac8c68b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.837418:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616a00/0x5bf8706fdac8c68b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788574217.840168:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:3.0:1788574217.840220:0:6494:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 357820028970ns, next at 358820020590ns, rc = 0 00010000:00010000:3.0:1788574217.840333:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616200/0x5bf8706fdac8c692 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.840354:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616200/0x5bf8706fdac8c692 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.840389:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616200/0x5bf8706fdac8c692 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.840410:0:6494:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616200/0x5bf8706fdac8c692 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.840419:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616200/0x5bf8706fdac8c692 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.840425:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616200/0x5bf8706fdac8c692 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.840453:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788574217.840485:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616a00/0x5bf8706fdac8c68b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.840491:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616a00/0x5bf8706fdac8c68b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.840498:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616a00/0x5bf8706fdac8c68b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.840505:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c84c2616a00 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:3.0:1788574217.840510:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616a00/0x5bf8706fdac8c68b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.840518:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616a00/0x5bf8706fdac8c68b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.840533:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c85c3ba6200) 00010000:00010000:3.0:1788574217.840537:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788574217.840549:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616a00/0x5bf8706fdac8c68b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574217.840683:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788574217.840693:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616200/0x5bf8706fdac8c692 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574217.840701:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c84c2616200 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:2.0:1788574217.840705:0:6480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616200/0x5bf8706fdac8c692 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574217.840713:0:6480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616200/0x5bf8706fdac8c692 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40018480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574217.840735:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c85c3ba6200) 00010000:00010000:2.0:1788574217.840739:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788574217.840749:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616200/0x5bf8706fdac8c692 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x44819480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574217.840757:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616200/0x5bf8706fdac8c692 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x44819480000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574217.840774:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574217.840776:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574217.840778:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574217.842893:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616a00/0x5bf8706fdac8c68b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.842937:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616400/0x5bf8706fdac8c67d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.842945:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616400/0x5bf8706fdac8c67d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.842955:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616400/0x5bf8706fdac8c67d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.842961:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c84c2616400 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:3.0:1788574217.842967:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616400/0x5bf8706fdac8c67d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.842975:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616400/0x5bf8706fdac8c67d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.842995:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c85ec19ac00) 00010000:00010000:3.0:1788574217.842998:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574217.843003:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616400/0x5bf8706fdac8c67d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.843010:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616400/0x5bf8706fdac8c67d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788574217.843021:0:6494:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000008a7623a reply state 000000005e8ad7f8 transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617a00/0x5bf8706fdac8c684 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.843062:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617a00/0x5bf8706fdac8c684 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574217.843070:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c85c3ba6c00) 00010000:00010000:3.0:1788574217.843073:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788574217.843077:0:6494:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788574217.843237:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+34:11341:x1875455668969088:12345-192.168.204.51@tcp:36:rm.0 Request processed in 7325us (8426us total) trans 4294967377 rc 0/0 00000100:00100000:3.0:1788574217.843249:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 106 00010000:00010000:0.0:1788574217.875682:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574217.926501:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574217.926985:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668969344 00000100:00100000:1.0:1788574217.926998:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668969344 00000100:00100000:1.0:1788574217.927071:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 107 00000100:00100000:1.0:1788574217.927081:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c376aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+34:11347:x1875455668969344:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:1.0:1788574217.927107:0:7439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574217.927128:0:7439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3600/0x5bf8706fdac8c699 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6889 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574217.927466:0:7439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8c6a0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574217.927483:0:7439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8c6a0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574217.927495:0:7439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8c6a0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574217.927508:0:7439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c6a7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574217.927515:0:7439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c6a7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574217.927522:0:7439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c6a7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788574217.929650:0:7439:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:1.0:1788574217.931655:0:7439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c6ae lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574217.931677:0:7439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c6ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574217.931701:0:7439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c6ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574217.931751:0:7439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8c6a0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574217.931757:0:7439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8c6a0 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574217.931763:0:7439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8c6a0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574217.931768:0:7439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85faea2600 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:1.0:1788574217.931772:0:7439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8c6a0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574217.931778:0:7439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8c6a0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574217.931800:0:7439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c85ec19ac00) 00010000:00010000:1.0:1788574217.931803:0:7439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788574217.931807:0:7439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8c6a0 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574217.931813:0:7439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8c6a0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788574217.931826:0:7439:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a6732c56 reply state 00000000d5cd576c transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c6a7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574217.931836:0:7439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c6a7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574217.931848:0:7439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c85c3ba6c00) 00010000:00010000:1.0:1788574217.931851:0:7439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788574217.931853:0:7439:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788574217.931893:0:7439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3600/0x5bf8706fdac8c699 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6889 expref: 37 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574217.931909:0:7439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c6ae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6889 expref: 36 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574217.931916:0:7439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c84c34f0e00) 00010000:00010000:1.0:1788574217.931918:0:7439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788574217.931920:0:7439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85faea2000, rc 0) 00000100:00100000:1.0:1788574217.932011:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c376aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+37:11347:x1875455668969344:12345-192.168.204.51@tcp:101:bash.0 Request processed in 4931us (5519us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1788574217.932028:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 107 00000100:00100000:1.0:1788574217.940821:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574217.941508:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668969472 00000100:00100000:2.0:1788574217.941522:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668969472 00000100:00100000:2.0:1788574217.941595:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 42 00000100:00100000:2.0:1788574217.941606:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3ea4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:659467ff-94af-418e-92fe-11e4323a48aa+7:2395:x1875455668969472:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:2.0:1788574217.941624:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574217.941645:0:8410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1cb0df0/0x5bf8706fdac8c6bc lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6890 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788574217.941673:0:8410:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788574217.941694:0:8410:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=357s v=(0 0) 00010000:00010000:2.0:1788574217.941699:0:8410:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574217.941708:0:8410:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1cb0df0/0x5bf8706fdac8c6bc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6890 expref: 8 pid: 8410 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574217.941739:0:8410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c1cb0df0/0x5bf8706fdac8c6bc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6890 expref: 8 pid: 8410 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574217.941753:0:8410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85fa32fe00, rc 0) 00000100:00100000:2.0:1788574217.941838:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3ea4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:659467ff-94af-418e-92fe-11e4323a48aa+8:2395:x1875455668969472:12345-192.168.204.51@tcp:101:bash.0 Request processed in 234us (1027us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574217.941865:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 42 00000100:00080000:1.0:1788574217.941991:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788574217.946635:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574217.947400:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668969600 00000100:00100000:2.0:1788574217.947414:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668969600 00000100:00100000:2.0:1788574217.947479:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 43 00000100:00100000:2.0:1788574217.947495:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c376b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:659467ff-94af-418e-92fe-11e4323a48aa+8:11347:x1875455668969600:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:2.0:1788574217.947515:0:8409:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574217.947558:0:8409:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003bd3353c/0x5bf8706fdac8c6c3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6897 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574217.947595:0:8409:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c1cb0df0/0x5bf8706fdac8c6bc lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6890 expref: 9 pid: 8410 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574217.947606:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574217.947610:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574217.947617:0:8409:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003bd3353c/0x5bf8706fdac8c6c3 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6897 expref: 9 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574217.947654:0:8409:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c1cb0df0/0x5bf8706fdac8c6bc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6890 expref: 9 pid: 8410 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574217.947668:0:8409:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c1cb0df0/0x5bf8706fdac8c6bc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6890 expref: 9 pid: 8410 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574217.947684:0:8409:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3da7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8409:1875455681635456:192.168.204.51@tcp:104: 00000100:00100000:2.0:1788574217.949046:0:8409:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c3629c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788574217.953181:0:8409:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3da7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8409:1875455681635456:192.168.204.51@tcp:104: 00010000:00010000:2.0:1788574217.953269:0:8409:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003bd3353c/0x5bf8706fdac8c6c3 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6897 expref: 9 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574217.953438:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574217.953550:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668969728 00000100:00100000:1.0:1788574217.953559:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668969728 00010000:00010000:1.0:1788574217.953600:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c1cb0df0/0x5bf8706fdac8c6bc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6890 expref: 10 pid: 8410 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574217.953646:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 67 00000100:00100000:1.0:1788574217.953656:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3769880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:659467ff-94af-418e-92fe-11e4323a48aa+10:2394:x1875455668969728:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788574217.953671:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574217.953694:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c1cb0df0/0x5bf8706fdac8c6bc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6890 expref: 10 pid: 8410 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574217.953735:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c1cb0df0/0x5bf8706fdac8c6bc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6890 expref: 10 pid: 8410 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574217.953762:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1cb0df0/0x5bf8706fdac8c6bc lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6890 expref: 10 pid: 8410 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574217.953788:0:6478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574217.953793:0:6478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574217.953802:0:6478:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003bd3353c/0x5bf8706fdac8c6c3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6897 expref: 9 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574217.953813:0:6478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003bd3353c/0x5bf8706fdac8c6c3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6897 expref: 9 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574217.953863:0:6478:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003bd3353c/0x5bf8706fdac8c6c3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6897 expref: 9 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574217.953877:0:6478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3ea4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6478:1875455681635584:192.168.204.51@tcp:105: 00000100:00100000:1.0:1788574217.953973:0:6478:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85d0e7f300 going to sleep for 11 seconds 00010000:00010000:2.0:1788574217.954538:0:8409:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85fa32ee00, rc 0) 00000100:00100000:2.0:1788574217.954578:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c376b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:659467ff-94af-418e-92fe-11e4323a48aa+9:11347:x1875455668969600:12345-192.168.204.51@tcp:101:bash.0 Request processed in 7084us (7953us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574217.954587:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 43 00000100:00100000:1.0:1788574217.958924:0:6478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3ea4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6478:1875455681635584:192.168.204.51@tcp:105: 00010000:00010000:1.0:1788574217.958960:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788574217.959021:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3769880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:659467ff-94af-418e-92fe-11e4323a48aa+8:2394:x1875455668969728:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 5365us (5590us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574217.959033:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 67 00000100:00100000:0.0:1788574217.960057:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574217.960131:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668969984 00000100:00100000:2.0:1788574217.960139:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668969984 00000100:00100000:2.0:1788574217.960229:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 25 00000100:00100000:2.0:1788574217.960240:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c37a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:659467ff-94af-418e-92fe-11e4323a48aa+37:11347:x1875455668969984:12345-192.168.204.51@tcp:35:bash.0 00000100:00100000:2.0:1788574217.960807:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c37a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:659467ff-94af-418e-92fe-11e4323a48aa+38:11347:x1875455668969984:12345-192.168.204.51@tcp:35:bash.0 Request processed in 566us (753us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1788574217.960816:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 25 00000100:00100000:0.0:1788574218.129485:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574218.132665:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668970112 00000100:00100000:1.0:1788574218.132682:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668970112 00000100:00100000:1.0:1788574218.132774:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 108 00000100:00100000:1.0:1788574218.133377:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c37ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+38:11363:x1875455668970112:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:1.0:1788574218.133406:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574218.133428:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3600/0x5bf8706fdac8c6ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d689e expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.133502:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8c6d1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.133517:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8c6d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.133532:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8c6d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788574218.133589:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1788574218.133594:0:6493:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788574218.133615:0:6493:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8c6d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.133640:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3600/0x5bf8706fdac8c6ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d689e expref: 40 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.133660:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8c6d1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d689e expref: 39 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.133668:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c85ec19ac00) 00010000:00010000:1.0:1788574218.133671:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788574218.133691:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85faea2600, rc 0) 00000100:00100000:1.0:1788574218.135072:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c37ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+39:11363:x1875455668970112:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 1692us (5589us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574218.135085:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 108 00000100:00100000:2.0:1788574218.152873:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574218.153406:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668970368 00000100:00100000:3.0:1788574218.153420:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668970368 00000100:00100000:3.0:1788574218.153497:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 109 00000100:00100000:3.0:1788574218.153508:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3da7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+39:11363:x1875455668970368:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:3.0:1788574218.153536:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574218.153564:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616400/0x5bf8706fdac8c6d8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d68a5 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.153890:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616a00/0x5bf8706fdac8c6df lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.153909:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616a00/0x5bf8706fdac8c6df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.153922:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616a00/0x5bf8706fdac8c6df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788574218.153959:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788574218.154118:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616400/0x5bf8706fdac8c6d8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d68a5 expref: 42 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.154141:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616a00/0x5bf8706fdac8c6df lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d68a5 expref: 41 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.154151:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c84c34f0e00) 00010000:00010000:3.0:1788574218.154154:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788574218.154158:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c84c2616a00, rc 0) 00000100:00100000:3.0:1788574218.154563:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3da7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+41:11363:x1875455668970368:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 1054us (1704us total) trans 4294967380 rc 0/0 00000100:00100000:3.0:1788574218.154574:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 109 00000100:00100000:0.0:1788574218.160989:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574218.161378:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668970624 00000100:00100000:1.0:1788574218.161389:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668970624 00000100:00100000:1.0:1788574218.161451:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 110 00000100:00100000:1.0:1788574218.161461:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c37a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+41:11363:x1875455668970624:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:1.0:1788574218.161487:0:7439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574218.161509:0:7439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3600/0x5bf8706fdac8c6ed lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d68ac expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.161952:0:7439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8c6f4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.161969:0:7439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8c6f4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.161981:0:7439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8c6f4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788574218.161994:0:7439:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788574218.162102:0:7439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3600/0x5bf8706fdac8c6ed lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d68ac expref: 44 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.162123:0:7439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8c6f4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d68ac expref: 43 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.162133:0:7439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c84c34f0e00) 00010000:00010000:1.0:1788574218.162142:0:7439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788574218.162146:0:7439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85faea3e00, rc 0) 00000100:00100000:0.0:1788574218.163464:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574218.164544:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668970752 00000100:00100000:3.0:1788574218.164558:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668970752 00000100:00100000:3.0:1788574218.164644:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 7 00000100:00100000:3.0:1788574218.164655:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c37a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:659467ff-94af-418e-92fe-11e4323a48aa+44:2393:x1875455668970752:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788574218.164670:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574218.164694:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616a00/0x5bf8706fdac8c6df lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d68a5 expref: 44 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.164713:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c84c34f0e00) 00010000:00010000:3.0:1788574218.164727:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788574218.165059:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c37a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+43:11363:x1875455668970624:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 809us (1292us total) trans 4294967381 rc 0/0 00000100:00100000:1.0:1788574218.165069:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 110 00000100:00100000:3.0:1788574218.165152:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c37a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:659467ff-94af-418e-92fe-11e4323a48aa+42:2393:x1875455668970752:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 498us (1696us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574218.165159:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 7 00000100:00100000:0.0:1788574218.172260:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574218.173035:0:13791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668970880 00000100:00100000:3.0:1788574218.173049:0:13791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668970880 00000100:00100000:3.0:1788574218.173122:0:13791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 44 00000100:00100000:3.0:1788574218.173134:0:13791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c37abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:659467ff-94af-418e-92fe-11e4323a48aa+8:2396:x1875455668970880:12345-192.168.204.51@tcp:1:lfs.0 00010000:00010000:3.0:1788574218.173180:0:13791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e370686/0x5bf8706fdac8c702 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.173230:0:13791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003bd3353c/0x5bf8706fdac8c6c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6897 expref: 8 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.173239:0:13791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788574218.173244:0:13791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788574218.173249:0:13791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e370686/0x5bf8706fdac8c702 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.173299:0:13791:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003bd3353c/0x5bf8706fdac8c6c3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6897 expref: 8 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.173315:0:13791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003bd3353c/0x5bf8706fdac8c6c3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6897 expref: 8 pid: 8409 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574218.173330:0:13791:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c376b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13791:1875455681635712:192.168.204.51@tcp:104: 00000100:00100000:3.0:1788574218.173448:0:13791:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c267e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788574218.181357:0:13791:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c376b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13791:1875455681635712:192.168.204.51@tcp:104: 00010000:00010000:3.0:1788574218.181396:0:13791:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002e370686/0x5bf8706fdac8c702 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574218.186381:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574218.186500:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668971008 00000100:00100000:3.0:1788574218.186518:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668971008 00002000:00100000:3.0:1788574218.186602:0:8416:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9c84c37aaa00 x1875455668971008/t0(0) o4->659467ff-94af-418e-92fe-11e4323a48aa@192.168.204.51@tcp:369/0 lens 504/0 e 0 to 0 dl 1788574229 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788574218.186615:0:8416:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c84c37aaa00 with x1875455668971008 ext(0->8) 00010000:00010000:3.0:1788574218.186628:0:8416:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003bd3353c/0x5bf8706fdac8c6c3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6897 expref: 9 pid: 8409 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.186651:0:8416:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003bd3353c/0x5bf8706fdac8c6c3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6897 expref: 9 pid: 8409 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788574218.186659:0:8416:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9c84c37aaa00 00000100:00100000:3.0:1788574218.186711:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 1 00000100:00100000:3.0:1788574218.186738:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c37aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:659467ff-94af-418e-92fe-11e4323a48aa+9:2393:x1875455668971008:12345-192.168.204.51@tcp:4:lfs.0 00000100:00100000:2.0:1788574218.191537:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c37aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:659467ff-94af-418e-92fe-11e4323a48aa+11:2393:x1875455668971008:12345-192.168.204.51@tcp:4:lfs.0 Request processed in 4790us (5151us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1788574218.191558:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 1 00002000:00100000:2.0:1788574218.191585:0:8416:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9c84c37aaa00 x1875455668971008/t4294967303(0) o4->659467ff-94af-418e-92fe-11e4323a48aa@192.168.204.51@tcp:369/0 lens 504/448 e 0 to 0 dl 1788574229 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788574218.191596:0:8416:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c84c37aaa00 with x1875455668971008 ext(0->8) 00010000:00010000:2.0:1788574218.191607:0:8416:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003bd3353c/0x5bf8706fdac8c6c3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6897 expref: 11 pid: 8409 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.191648:0:8416:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003bd3353c/0x5bf8706fdac8c6c3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6897 expref: 11 pid: 8409 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788574218.191656:0:8416:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9c84c37aaa00 00000100:00100000:2.0:1788574218.200052:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574218.200159:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668971136 00000100:00100000:3.0:1788574218.200170:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668971136 00010000:00010000:3.0:1788574218.200251:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003bd3353c/0x5bf8706fdac8c6c3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6897 expref: 11 pid: 8409 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574218.200293:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 68 00000100:00100000:3.0:1788574218.200303:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e0bdf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:659467ff-94af-418e-92fe-11e4323a48aa+11:2396:x1875455668971136:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788574218.200321:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788574218.200342:0:6477:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788574218.200344:0:6477:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788574217 00002000:00010000:3.0:1788574218.200360:0:6477:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1788574217 00002000:00010000:3.0:1788574218.200362:0:6477:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1788574217 00002000:00010000:3.0:1788574218.200364:0:6477:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1788574218.200371:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003bd3353c/0x5bf8706fdac8c6c3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6897 expref: 11 pid: 8409 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.200386:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003bd3353c/0x5bf8706fdac8c6c3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6897 expref: 11 pid: 8409 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.200419:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003bd3353c/0x5bf8706fdac8c6c3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6897 expref: 11 pid: 8409 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.200437:0:6477:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788574218.200441:0:6477:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788574218.200447:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002e370686/0x5bf8706fdac8c702 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.200457:0:6477:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002e370686/0x5bf8706fdac8c702 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.200498:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788574218.200551:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e0bdf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:659467ff-94af-418e-92fe-11e4323a48aa+10:2396:x1875455668971136:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 249us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574218.200559:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 68 00010000:00010000:2.0:1788574218.200925:0:13791:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002e370686/0x5bf8706fdac8c702 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.200936:0:13791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002e370686/0x5bf8706fdac8c702 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.200956:0:13791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002e370686/0x5bf8706fdac8c702 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.200964:0:13791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002e370686/0x5bf8706fdac8c702 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.200973:0:13791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002e370686/0x5bf8706fdac8c702 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.200980:0:13791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c84c2616a00 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:2.0:1788574218.200984:0:13791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002e370686/0x5bf8706fdac8c702 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.200993:0:13791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002e370686/0x5bf8706fdac8c702 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.201013:0:13791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002e370686/0x5bf8706fdac8c702 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.201022:0:13791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002e370686/0x5bf8706fdac8c702 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574218.201072:0:13791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c37abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:659467ff-94af-418e-92fe-11e4323a48aa+9:2396:x1875455668970880:12345-192.168.204.51@tcp:1:lfs.0 Request processed in 27941us (28823us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574218.201080:0:13791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 44 00000100:00100000:0.0:1788574218.211639:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574218.212146:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668971392 00000100:00100000:2.0:1788574218.212157:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668971392 00000100:00100000:2.0:1788574218.212252:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 26 00000100:00100000:2.0:1788574218.212272:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85d01f7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:659467ff-94af-418e-92fe-11e4323a48aa+42:11363:x1875455668971392:12345-192.168.204.51@tcp:35:lfs.0 00000004:00010000:2.0:1788574218.212337:0:6495:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8c6f4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d68ac expref: 42 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788574218.212593:0:6495:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:2.0:1788574218.212627:0:6495:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:2.0:1788574218.212991:0:6495:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:2.0:1788574218.213031:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f200/0x5bf8706fdac8c709 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.213049:0:6495:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c6ae lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6889 expref: 46 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.213060:0:6495:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f200/0x5bf8706fdac8c709 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.213111:0:6495:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c6ae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6889 expref: 46 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.213130:0:6495:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c6ae lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6889 expref: 46 pid: 7439 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574218.213148:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3da4a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6495:1875455681635840:192.168.204.51@tcp:104: 00000100:00100000:2.0:1788574218.213301:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c3629c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788574218.215091:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3da4a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6495:1875455681635840:192.168.204.51@tcp:104: 00010000:00010000:2.0:1788574218.215118:0:6495:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f200/0x5bf8706fdac8c709 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574218.215837:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574218.215947:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668971520 00000100:00100000:3.0:1788574218.215955:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668971520 00010000:00010000:3.0:1788574218.215990:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c6ae lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6889 expref: 47 pid: 7439 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574218.216049:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 69 00000100:00100000:3.0:1788574218.216059:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c37ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:659467ff-94af-418e-92fe-11e4323a48aa+47:2394:x1875455668971520:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788574218.216074:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574218.216081:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c6ae lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6889 expref: 47 pid: 7439 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.216093:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c6ae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6889 expref: 47 pid: 7439 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.216115:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c6ae lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6889 expref: 47 pid: 7439 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.216129:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c84c34f0e00) 00010000:00010000:3.0:1788574218.216135:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f200/0x5bf8706fdac8c709 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.216146:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f200/0x5bf8706fdac8c709 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.216153:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f200/0x5bf8706fdac8c709 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.216182:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788574218.216264:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c37ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:659467ff-94af-418e-92fe-11e4323a48aa+46:2394:x1875455668971520:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 206us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574218.216271:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 69 00010000:00010000:2.0:1788574218.216336:0:6495:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f200/0x5bf8706fdac8c709 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.216344:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f200/0x5bf8706fdac8c709 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788574218.216443:0:6495:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:2.0:1788574218.216550:0:6495:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:2.0:1788574218.216706:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3da4a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6495:1875455681635968:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788574218.216765:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574218.216804:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c5a40780 going to sleep for 11 seconds 00000100:00100000:3.0:1788574218.219006:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681635968 00000100:00100000:3.0:1788574218.219033:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681635968 00000100:00100000:3.0:1788574218.219105:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1788574218.219114:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3da4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6495:x1875455681635968:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788574218.219253:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3da4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6495:x1875455681635968:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 140us (2487us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574218.219261:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00080000:1.0:1788574218.219325:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788574218.219459:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3da4a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6495:1875455681635968:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788574218.219637:0:6495:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:2.0:1788574218.219710:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3da4a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6495:1875455681636096:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788574218.219769:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574218.219796:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c4e2e840 going to sleep for 11 seconds 00000100:00100000:3.0:1788574218.219911:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681636096 00000100:00100000:3.0:1788574218.219917:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681636096 00000100:00100000:3.0:1788574218.219949:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788574218.219957:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3da5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6495:x1875455681636096:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788574218.220071:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3da5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:6495:x1875455681636096:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 114us (301us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788574218.220078:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788574218.220669:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3da4a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6495:1875455681636096:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788574218.220735:0:6495:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:2.0:1788574218.220771:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f200/0x5bf8706fdac8c709 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.220782:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f200/0x5bf8706fdac8c709 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.220789:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f200/0x5bf8706fdac8c709 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.220796:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32f200 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:2.0:1788574218.220800:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f200/0x5bf8706fdac8c709 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.220808:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f200/0x5bf8706fdac8c709 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.220824:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c84c34f0e00) 00010000:00010000:2.0:1788574218.220827:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788574218.220832:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f200/0x5bf8706fdac8c709 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.220838:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f200/0x5bf8706fdac8c709 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788574218.220932:0:6495:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788574218.220997:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:2.0:1788574218.221009:0:6495:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 358200818986ns, next at 359200816669ns, rc = 0 00000001:00080000:2.0:1788574218.221025:0:6495:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:2.0:1788574218.221048:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c84c34f0e00) 00010000:00010000:2.0:1788574218.221052:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788574218.221058:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8c6f4 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d68ac expref: 50 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574218.224757:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85d01f7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:659467ff-94af-418e-92fe-11e4323a48aa+49:11363:x1875455668971392:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 12481us (13111us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1788574218.224773:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 26 00000020:00080000:2.0:1788574218.224783:0:6495:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788574218.233943:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574218.234032:0:11893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668971648 00000100:00100000:3.0:1788574218.234042:0:11893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668971648 00000100:00100000:3.0:1788574218.234105:0:11893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 111 00000100:00100000:3.0:1788574218.234115:0:11893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c37a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:659467ff-94af-418e-92fe-11e4323a48aa+49:11363:x1875455668971648:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:3.0:1788574218.234143:0:11893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574218.234169:0:11893:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616400/0x5bf8706fdac8c710 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d68b3 expref: -99 pid: 11893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.234256:0:11893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616400/0x5bf8706fdac8c710 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d68b3 expref: 50 pid: 11893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.234271:0:11893:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616400/0x5bf8706fdac8c710 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d68b3 expref: 50 pid: 11893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.234309:0:11893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c85fa28c700) 00010000:00010000:3.0:1788574218.234312:0:11893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788574218.234315:0:11893:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c84c2616400, rc 0) 00000100:00100000:3.0:1788574218.234375:0:11893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c37a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:659467ff-94af-418e-92fe-11e4323a48aa+50:11363:x1875455668971648:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 262us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574218.234382:0:11893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 111 00000100:00100000:2.0:1788574218.241818:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574218.242300:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668971904 00000100:00100000:0.0:1788574218.242311:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668971904 00000100:00100000:0.0:1788574218.242373:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 27 00000100:00100000:0.0:1788574218.242384:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3da4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:659467ff-94af-418e-92fe-11e4323a48aa+50:11363:x1875455668971904:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:0.0:1788574218.242753:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3da4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:659467ff-94af-418e-92fe-11e4323a48aa+51:11363:x1875455668971904:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 368us (944us total) trans 4294967391 rc 0/0 00000100:00100000:0.0:1788574218.242761:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 27 00000100:00100000:3.0:1788574218.382330:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574218.382529:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668972032 00000100:00100000:0.0:1788574218.382558:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668972032 00000100:00100000:0.0:1788574218.382652:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 112 00000100:00100000:0.0:1788574218.382667:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3768e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+51:11373:x1875455668972032:12345-192.168.204.51@tcp:34:lfs.0 00010000:00010000:0.0:1788574218.382763:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c717 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.382781:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c717 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.382794:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c717 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.382809:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c71e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.382815:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c71e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.382839:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c71e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.382920:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8c725 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.382928:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8c725 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.382935:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8c725 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788574218.382980:0:6494:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8c725 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.382993:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c717 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.383000:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c717 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.383007:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c717 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.383012:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d7e00 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:0.0:1788574218.383017:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c717 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.383025:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c717 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.383037:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c85ec19ac00) 00010000:00010000:0.0:1788574218.383060:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574218.383066:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c717 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.383073:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c717 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.383087:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c71e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.383093:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c71e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.383098:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c71e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.383103:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d6600 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:0.0:1788574218.383105:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c71e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.383111:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c71e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.383118:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c85c3ba6c00) 00010000:00010000:0.0:1788574218.383121:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574218.383123:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c71e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.383129:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c71e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.383139:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8c725 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.383152:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8c725 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.383157:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8c725 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.383163:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d6800 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:0.0:1788574218.383166:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8c725 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.383173:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8c725 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.383180:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c85fa28c700) 00010000:00010000:0.0:1788574218.383182:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574218.383185:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8c725 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.383241:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8c725 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574218.383328:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3768e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+51:11373:x1875455668972032:12345-192.168.204.51@tcp:34:lfs.0 Request processed in 666us (1013us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574218.383336:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 112 00000100:00100000:1.0:1788574218.439169:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574218.439982:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668972288 00000100:00100000:0.0:1788574218.440000:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668972288 00000100:00100000:1.0:1788574218.440899:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 113 00000100:00100000:1.0:1788574218.440919:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3ea4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+51:11376:x1875455668972288:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:1.0:1788574218.440951:0:7439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574218.440983:0:7439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3600/0x5bf8706fdac8c72c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d68ba expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.441107:0:7439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8c733 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.441128:0:7439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8c733 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.441145:0:7439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8c733 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.441158:0:7439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c73a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.441165:0:7439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c73a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.441171:0:7439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c73a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.441620:0:7439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8c741 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.441630:0:7439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8c741 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.441638:0:7439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8c741 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788574218.441649:0:7439:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788574218.441771:0:7439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8c733 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.441780:0:7439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8c733 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.441788:0:7439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8c733 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.441794:0:7439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85faea3e00 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:1.0:1788574218.441799:0:7439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8c733 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.441807:0:7439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8c733 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.441823:0:7439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c85ec19ac00) 00010000:00010000:1.0:1788574218.441826:0:7439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788574218.441832:0:7439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8c733 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.441849:0:7439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8c733 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.441868:0:7439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c73a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.441874:0:7439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c73a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.441880:0:7439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c73a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.441886:0:7439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85faea2000 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:1.0:1788574218.441889:0:7439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c73a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.441896:0:7439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c73a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.441905:0:7439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c85c3ba6c00) 00010000:00010000:1.0:1788574218.441908:0:7439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788574218.441911:0:7439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c73a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.441917:0:7439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c73a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.441964:0:7439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3600/0x5bf8706fdac8c72c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d68ba expref: 54 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.441980:0:7439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8c741 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d68ba expref: 53 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.441994:0:7439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c85fa28c700) 00010000:00010000:1.0:1788574218.441997:0:7439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788574218.442000:0:7439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85faea3800, rc 0) 00000100:00100000:1.0:1788574218.442441:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3ea4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+53:11376:x1875455668972288:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 1526us (3287us total) trans 4294967392 rc 0/0 00000100:00100000:1.0:1788574218.442451:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 113 00000100:00100000:2.0:1788574218.447988:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574218.448156:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668972416 00000100:00100000:0.0:1788574218.448168:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668972416 00000100:00100000:0.0:1788574218.448385:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 114 00000100:00100000:0.0:1788574218.448400:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3da4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+53:11376:x1875455668972416:12345-192.168.204.51@tcp:54:lfs.0 00010000:00010000:0.0:1788574218.448524:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c74f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.448546:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c74f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.448560:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c74f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.448607:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c74f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.448615:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c74f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.448623:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c74f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.448630:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d6600 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:0.0:1788574218.448635:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c74f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.448644:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c74f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.448657:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c85fa28c700) 00010000:00010000:0.0:1788574218.448661:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788574218.448666:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c74f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.448673:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c74f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574218.448796:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3da4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+53:11376:x1875455668972416:12345-192.168.204.51@tcp:54:lfs.0 Request processed in 398us (824us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574218.448805:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 114 00000100:00100000:0.0:1788574218.456311:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574218.456438:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668972672 00000100:00100000:1.0:1788574218.456451:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668972672 00000100:00100000:1.0:1788574218.456523:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 28 00000100:00100000:1.0:1788574218.456535:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c37ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:659467ff-94af-418e-92fe-11e4323a48aa+53:11376:x1875455668972672:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:1.0:1788574218.456874:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c37ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:659467ff-94af-418e-92fe-11e4323a48aa+54:11376:x1875455668972672:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 340us (577us total) trans 4294967393 rc 0/0 00000100:00100000:1.0:1788574218.456882:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 28 00000100:00100000:1.0:1788574218.550620:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574218.550778:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668972928 00000100:00100000:3.0:1788574218.550791:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668972928 00000100:00100000:3.0:1788574218.550879:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 115 00000100:00100000:3.0:1788574218.550893:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3ea5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+54:11386:x1875455668972928:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:3.0:1788574218.550926:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574218.550930:0:6493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788574218.550968:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8c6d1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d689e expref: 54 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.550992:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c85ec19ac00) 00010000:00010000:3.0:1788574218.550998:0:6493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788574218.551016:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8c756 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d68c1 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.551525:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8c75d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.551542:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8c741 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d68ba expref: 54 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.551565:0:6493:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8c75d lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.552074:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8c741 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d68ba expref: 54 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.552096:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8c741 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d68ba expref: 54 pid: 7439 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574218.552115:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3769f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6493:1875455681636224:192.168.204.51@tcp:104: 00000100:00100000:3.0:1788574218.552310:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c267ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1788574218.555332:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574218.555486:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3769f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6493:1875455681636224:192.168.204.51@tcp:104: 00010000:00010000:1.0:1788574218.555525:0:6493:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8c75d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574218.555625:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668973056 00000100:00100000:0.0:1788574218.555634:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668973056 00010000:00010000:0.0:1788574218.555684:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8c741 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d68ba expref: 55 pid: 7439 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574218.555739:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 70 00000100:00100000:0.0:1788574218.555750:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3769880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:659467ff-94af-418e-92fe-11e4323a48aa+55:2394:x1875455668973056:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788574218.555769:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574218.555777:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8c741 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d68ba expref: 55 pid: 7439 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.555791:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8c741 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d68ba expref: 55 pid: 7439 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.555820:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8c741 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d68ba expref: 55 pid: 7439 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.555839:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c85fa28c700) 00010000:00010000:0.0:1788574218.555844:0:6477:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8c75d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.555855:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8c75d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.555885:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8c75d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.555920:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574218.556003:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3769880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:659467ff-94af-418e-92fe-11e4323a48aa+54:2394:x1875455668973056:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 253us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574218.556011:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 70 00010000:00010000:3.0:1788574218.556742:0:6493:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8c75d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.556753:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8c75d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788574218.556778:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788574218.556965:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8c756 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d68c1 expref: 55 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.556986:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8c75d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d68c1 expref: 54 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.556995:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c85fa28c700) 00010000:00010000:3.0:1788574218.556998:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788574218.557014:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c84c2617400, rc 0) 00000100:00100000:3.0:1788574218.557091:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3ea5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+54:11386:x1875455668972928:12345-192.168.204.51@tcp:101:bash.0 Request processed in 6201us (6484us total) trans 4294967394 rc 0/0 00000100:00100000:3.0:1788574218.557099:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 115 00000100:00100000:3.0:1788574218.560556:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574218.561241:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668973184 00000100:00100000:1.0:1788574218.561255:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668973184 00000100:00100000:1.0:1788574218.561351:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 116 00000100:00100000:1.0:1788574218.561363:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c376b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+54:11386:x1875455668973184:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:1.0:1788574218.561396:0:7439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574218.561425:0:7439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e800/0x5bf8706fdac8c76b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d68c8 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.561506:0:7439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e200/0x5bf8706fdac8c772 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.561524:0:7439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e200/0x5bf8706fdac8c772 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.561539:0:7439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e200/0x5bf8706fdac8c772 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.561687:0:7439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e800/0x5bf8706fdac8c76b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d68c8 expref: 56 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.561722:0:7439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e200/0x5bf8706fdac8c772 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d68c8 expref: 55 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.561733:0:7439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c85fa28c700) 00010000:00010000:1.0:1788574218.561736:0:7439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788574218.561741:0:7439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c860217e200, rc 0) 00000100:00100000:1.0:1788574218.561819:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c376b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+55:11386:x1875455668973184:12345-192.168.204.51@tcp:101:bash.0 Request processed in 459us (1279us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574218.561827:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 116 00000100:00100000:0.0:1788574218.568395:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574218.568582:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668973440 00000100:00100000:2.0:1788574218.568596:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668973440 00000100:00100000:2.0:1788574218.568720:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 117 00000100:00100000:2.0:1788574218.568734:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c37a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+55:11386:x1875455668973440:12345-192.168.204.51@tcp:36:bash.0 00010000:00010000:2.0:1788574218.569055:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fa00/0x5bf8706fdac8c779 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.569080:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fa00/0x5bf8706fdac8c779 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.569094:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fa00/0x5bf8706fdac8c779 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788574218.569149:0:6492:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:2.0:1788574218.569178:0:6492:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000066e4d752 reply state 000000001cd59d7a transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fa00/0x5bf8706fdac8c779 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.569233:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fa00/0x5bf8706fdac8c779 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.569371:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c85fa28c700) 00010000:00010000:2.0:1788574218.569375:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788574218.569380:0:6492:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788574218.569758:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c37a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+58:11386:x1875455668973440:12345-192.168.204.51@tcp:36:bash.0 Request processed in 1023us (1580us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1788574218.569768:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 117 00000020:00080000:2.0:1788574218.569775:0:6492:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788574218.572768:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574218.572845:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668973568 00000100:00100000:1.0:1788574218.572857:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668973568 00000100:00100000:1.0:1788574218.572923:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 118 00000100:00100000:1.0:1788574218.572934:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3769500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+58:11386:x1875455668973568:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:1.0:1788574218.572963:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574218.572987:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e800/0x5bf8706fdac8c780 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d68cf expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.573118:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217fa00/0x5bf8706fdac8c787 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.573136:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8c75d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d68c1 expref: 59 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.573147:0:6493:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217fa00/0x5bf8706fdac8c787 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.573216:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8c75d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d68c1 expref: 59 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.573234:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8c75d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d68c1 expref: 59 pid: 6493 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574218.573249:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3ea4700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6493:1875455681636352:192.168.204.51@tcp:104: 00000100:00100000:1.0:1788574218.573605:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85d0e7f240 going to sleep for 11 seconds 00000100:00100000:3.0:1788574218.576778:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574218.577182:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668973696 00000100:00100000:0.0:1788574218.577233:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668973696 00010000:00010000:0.0:1788574218.577425:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8c75d lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d68c1 expref: 60 pid: 6493 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574218.577479:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 71 00000100:00100000:0.0:1788574218.577490:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3768380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:659467ff-94af-418e-92fe-11e4323a48aa+60:2394:x1875455668973696:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788574218.577508:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574218.577516:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8c75d lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d68c1 expref: 60 pid: 6493 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.577532:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8c75d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d68c1 expref: 60 pid: 6493 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.577561:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c85fa28c700) 00010000:00010000:0.0:1788574218.577568:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217fa00/0x5bf8706fdac8c787 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.577579:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217fa00/0x5bf8706fdac8c787 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.577609:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217fa00/0x5bf8706fdac8c787 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.577635:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574218.577716:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3768380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:659467ff-94af-418e-92fe-11e4323a48aa+60:2394:x1875455668973696:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 218us (944us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574218.577725:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 71 00010000:00010000:1.0:1788574218.578922:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8c75d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d68c1 expref: 59 pid: 6493 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574218.578952:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3ea4700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6493:1875455681636352:192.168.204.51@tcp:104: 00010000:00010000:1.0:1788574218.578988:0:6493:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217fa00/0x5bf8706fdac8c787 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.579001:0:6493:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217fa00/0x5bf8706fdac8c787 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.579029:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217fa00/0x5bf8706fdac8c787 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788574218.579165:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788574218.579171:0:6493:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788574218.579467:0:6493:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217fa00/0x5bf8706fdac8c787 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.579512:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e800/0x5bf8706fdac8c780 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d68cf expref: 59 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.579529:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217fa00/0x5bf8706fdac8c787 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d68cf expref: 58 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.579539:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c85fa28c700) 00010000:00010000:1.0:1788574218.579542:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788574218.579545:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c860217fa00, rc 0) 00000100:00100000:1.0:1788574218.579621:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3769500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+58:11386:x1875455668973568:12345-192.168.204.51@tcp:101:bash.0 Request processed in 6688us (6863us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574218.579630:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 118 00000100:00100000:3.0:1788574218.583065:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574218.583158:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668973952 00000100:00100000:1.0:1788574218.583173:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668973952 00000100:00100000:1.0:1788574218.583294:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 29 00000100:00100000:1.0:1788574218.583308:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3769180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:659467ff-94af-418e-92fe-11e4323a48aa+58:11386:x1875455668973952:12345-192.168.204.51@tcp:35:bash.0 00000100:00100000:1.0:1788574218.583615:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3769180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:659467ff-94af-418e-92fe-11e4323a48aa+59:11386:x1875455668973952:12345-192.168.204.51@tcp:35:bash.0 Request processed in 309us (565us total) trans 4294967397 rc 0/0 00000100:00100000:1.0:1788574218.583623:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 29 00000100:00100000:0.0:1788574218.643006:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574218.643114:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668974080 00000100:00100000:3.0:1788574218.643129:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668974080 00000100:00100000:3.0:1788574218.643248:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 119 00000100:00100000:3.0:1788574218.643272:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c37a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+59:11392:x1875455668974080:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:3.0:1788574218.643308:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574218.643334:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617600/0x5bf8706fdac8c78e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d68d6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.643423:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8c795 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.643441:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8c795 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.643455:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8c795 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788574218.643513:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1788574218.643518:0:6494:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788574218.643542:0:6494:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8c795 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.643596:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617600/0x5bf8706fdac8c78e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d68d6 expref: 61 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.643625:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8c795 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d68d6 expref: 60 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.643635:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c85ec19ac00) 00010000:00010000:3.0:1788574218.643638:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788574218.643643:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c84c2617000, rc 0) 00000100:00100000:3.0:1788574218.643731:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c37a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+60:11392:x1875455668974080:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 472us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574218.643740:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 119 00000100:00100000:2.0:1788574218.647936:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574218.648075:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668974208 00000100:00100000:0.0:1788574218.648089:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668974208 00000100:00100000:0.0:1788574218.648167:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 120 00000100:00100000:0.0:1788574218.648179:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3da6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+60:11392:x1875455668974208:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:0.0:1788574218.648249:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574218.648288:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6a00/0x5bf8706fdac8c79c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d68dd expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.648380:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c7a3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.648397:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c7a3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.648411:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c7a3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.648423:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c7aa lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.648431:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c7aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.648458:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c7aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.648556:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8c7b1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.648567:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8c7b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.648574:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8c7b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788574218.648627:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788574218.648631:0:6492:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788574218.648654:0:6492:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8c7b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.648669:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8c7b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.648679:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c7a3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.648686:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c7a3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.648694:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c7a3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.648700:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d7e00 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:0.0:1788574218.648716:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c7a3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.648732:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c7a3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.648749:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c85ec19ac00) 00010000:00010000:0.0:1788574218.648752:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574218.648758:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c7a3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.648766:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c7a3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.648782:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c7aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.648788:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c7aa lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.648794:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c7aa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.648799:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d6600 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:0.0:1788574218.648802:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c7aa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.648807:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c7aa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.648814:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c85c3ba6c00) 00010000:00010000:0.0:1788574218.648816:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574218.648819:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c7aa lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.648835:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c7aa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.648868:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6a00/0x5bf8706fdac8c79c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d68dd expref: 62 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.648882:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8c7b1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d68dd expref: 61 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.648891:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c85fa28c700) 00010000:00010000:0.0:1788574218.648894:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788574218.648896:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d20d6800, rc 0) 00000100:00100000:0.0:1788574218.648974:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3da6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+61:11392:x1875455668974208:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 797us (1052us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574218.648981:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 120 00000100:00100000:0.0:1788574218.652914:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574218.653052:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668974464 00000100:00100000:1.0:1788574218.653069:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668974464 00000100:00100000:1.0:1788574218.653147:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 121 00000100:00100000:1.0:1788574218.653164:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c37aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+61:11392:x1875455668974464:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:1.0:1788574218.653228:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574218.653278:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e800/0x5bf8706fdac8c7b8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d68e4 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.653481:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8c7bf lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.653508:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217fa00/0x5bf8706fdac8c787 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d68cf expref: 62 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.653520:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8c7b1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d68dd expref: 62 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.653530:0:6493:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8c7bf lrc: 5/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.653584:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8c7b1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d68dd expref: 62 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.653597:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8c7b1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d68dd expref: 62 pid: 6492 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574218.653612:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3ea4700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6493:1875455681636480:192.168.204.51@tcp:104: 00010000:00010000:1.0:1788574218.653770:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217fa00/0x5bf8706fdac8c787 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d68cf expref: 62 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.653801:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217fa00/0x5bf8706fdac8c787 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d68cf expref: 62 pid: 6493 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574218.653812:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3ea4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6493:1875455681636608:192.168.204.51@tcp:104: 00000100:00100000:1.0:1788574218.653840:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85d0e7fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788574218.657817:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574218.657870:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574218.657978:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668974592 00000100:00100000:0.0:1788574218.657990:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668974592 00010000:00010000:0.0:1788574218.658059:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8c7b1 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d68dd expref: 63 pid: 6492 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574218.658103:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668974720 00000100:00100000:0.0:1788574218.658107:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668974720 00010000:00010000:0.0:1788574218.658121:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217fa00/0x5bf8706fdac8c787 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d68cf expref: 64 pid: 6493 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574218.658145:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 72 00000100:00100000:0.0:1788574218.658155:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3ea6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:659467ff-94af-418e-92fe-11e4323a48aa+64:2396:x1875455668974592:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788574218.658229:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574218.658238:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8c7b1 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d68dd expref: 64 pid: 6492 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.658253:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8c7b1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d68dd expref: 64 pid: 6492 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.658460:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c85fa28c700) 00010000:00010000:0.0:1788574218.658466:0:6477:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8c7bf lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.658477:0:6477:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8c7bf lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.658484:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574218.658554:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3ea6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:659467ff-94af-418e-92fe-11e4323a48aa+64:2396:x1875455668974592:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 400us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574218.658562:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 72 00000100:00100000:0.0:1788574218.658583:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 73 00000100:00100000:0.0:1788574218.658590:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3ea6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:659467ff-94af-418e-92fe-11e4323a48aa+63:2393:x1875455668974720:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788574218.658599:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574218.658604:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217fa00/0x5bf8706fdac8c787 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d68cf expref: 63 pid: 6493 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.658615:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217fa00/0x5bf8706fdac8c787 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d68cf expref: 63 pid: 6493 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.658640:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c85fa28c700) 00010000:00010000:0.0:1788574218.658644:0:6477:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8c7bf lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.658654:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8c7bf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.658663:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8c7bf lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.658686:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574218.658719:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3ea6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:659467ff-94af-418e-92fe-11e4323a48aa+63:2393:x1875455668974720:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 118us (837us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574218.658726:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 73 00010000:00010000:0.0:1788574218.659379:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8c7b1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d68dd expref: 62 pid: 6492 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574218.659410:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3ea4700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6493:1875455681636480:192.168.204.51@tcp:104: 00010000:00010000:0.0:1788574218.659428:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217fa00/0x5bf8706fdac8c787 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d68cf expref: 61 pid: 6493 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574218.659442:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3ea4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6493:1875455681636608:192.168.204.51@tcp:104: 00010000:00010000:0.0:1788574218.659474:0:6493:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8c7bf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.659489:0:6493:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8c7bf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.659511:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8c7bf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788574218.659536:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788574218.659880:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e800/0x5bf8706fdac8c7b8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d68e4 expref: 62 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.659898:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8c7bf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d68e4 expref: 61 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.659907:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c85fa28c700) 00010000:00010000:0.0:1788574218.659910:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788574218.659913:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85faea2600, rc 0) 00000100:00100000:0.0:1788574218.659972:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c37aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+61:11392:x1875455668974464:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 6814us (7074us total) trans 4294967398 rc 0/0 00000100:00100000:0.0:1788574218.659980:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 121 00000100:00100000:1.0:1788574218.667086:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574218.667233:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668974976 00000100:00100000:0.0:1788574218.667247:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668974976 00000100:00100000:0.0:1788574218.667328:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 8 00000100:00100000:0.0:1788574218.667339:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3ea6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:659467ff-94af-418e-92fe-11e4323a48aa+61:11392:x1875455668974976:12345-192.168.204.51@tcp:103:lfs.0 00010000:00010000:0.0:1788574218.667358:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574218.667389:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616400/0x5bf8706fdac8c710 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d68b3 expref: 61 pid: 11893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.667412:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c85fa28c700) 00010000:00010000:0.0:1788574218.667418:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574218.667561:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3ea6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:659467ff-94af-418e-92fe-11e4323a48aa+60:11392:x1875455668974976:12345-192.168.204.51@tcp:103:lfs.0 Request processed in 223us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574218.667569:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 8 00000100:00100000:2.0:1788574218.672703:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574218.673704:0:11893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668975104 00000100:00100000:3.0:1788574218.673733:0:11893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668975104 00000100:00100000:3.0:1788574218.673850:0:11893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 122 00000100:00100000:3.0:1788574218.673862:0:11893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3da6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:659467ff-94af-418e-92fe-11e4323a48aa+60:11392:x1875455668975104:12345-192.168.204.51@tcp:58:lfs.0 00010000:00010000:3.0:1788574218.674430:0:11893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617600/0x5bf8706fdac8c7cd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.674467:0:11893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617600/0x5bf8706fdac8c7cd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.674481:0:11893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617600/0x5bf8706fdac8c7cd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788574218.674618:0:11893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:3.0:1788574218.674819:0:11893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3da6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:659467ff-94af-418e-92fe-11e4323a48aa+60:11392:x1875455668975104:12345-192.168.204.51@tcp:58:lfs.0 Request processed in 956us (2129us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574218.674845:0:11893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 122 00000100:00100000:2.0:1788574218.677283:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574218.677406:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668975232 00000100:00100000:1.0:1788574218.677419:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668975232 00000100:00100000:1.0:1788574218.677599:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 123 00000100:00100000:1.0:1788574218.677612:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3da6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+60:11392:x1875455668975232:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:1.0:1788574218.677641:0:7439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574218.677665:0:7439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3600/0x5bf8706fdac8c7d4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d68eb expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.677750:0:7439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617600/0x5bf8706fdac8c7cd lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.677764:0:7439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3600/0x5bf8706fdac8c7d4 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d68eb expref: 61 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.677786:0:7439:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617600/0x5bf8706fdac8c7cd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.677802:0:7439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3600/0x5bf8706fdac8c7d4 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d68eb expref: 61 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.677841:0:7439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c85fa28c700) 00010000:00010000:1.0:1788574218.677845:0:7439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788574218.677849:0:7439:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3600/0x5bf8706fdac8c7d4 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d68eb expref: 61 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.677858:0:7439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85faea3600, rc 0) 00000100:00100000:1.0:1788574218.677992:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3da6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+61:11392:x1875455668975232:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 382us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574218.678000:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 123 00000040:00080000:0.0:1788574218.707522:0:13764:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788574218.707536:0:13764:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788574218.707600:0:13764:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1788574218.707613:0:13764:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788574218.707833:0:13764:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3f25880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13764:1875455681636736:192.168.204.51@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788574218.708055:0:13764:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c86002749c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788574218.719287:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574218.719479:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668975360 00000100:00100000:1.0:1788574218.719491:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668975360 00000100:00100000:1.0:1788574218.719570:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 124 00000100:00100000:1.0:1788574218.719583:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3da5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+62:11393:x1875455668975360:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788574218.719632:0:6493:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788574218.719807:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3da5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+62:11393:x1875455668975360:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 Request processed in 226us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574218.719816:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 124 00000100:00100000:0.0:1788574218.725310:0:13764:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3f25880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13764:1875455681636736:192.168.204.51@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788574218.725971:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574218.726391:0:11893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668975488 00000100:00100000:3.0:1788574218.726409:0:11893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668975488 00000100:00100000:3.0:1788574218.726485:0:11893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 125 00000100:00100000:3.0:1788574218.726496:0:11893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3ea5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:659467ff-94af-418e-92fe-11e4323a48aa+61:11393:x1875455668975488:12345-192.168.204.51@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788574218.726601:0:11893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617200/0x5bf8706fdac8c7db lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.726625:0:11893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617200/0x5bf8706fdac8c7db lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.726640:0:11893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617200/0x5bf8706fdac8c7db lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.726661:0:11893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616400/0x5bf8706fdac8c7e2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.726669:0:11893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616400/0x5bf8706fdac8c7e2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.726675:0:11893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616400/0x5bf8706fdac8c7e2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.726703:0:11893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8c7e9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.726723:0:11893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8c7e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.726730:0:11893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8c7e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788574218.726809:0:11893:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788574218.726814:0:11893:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788574218.726831:0:11893:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8c7e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.726845:0:11893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617200/0x5bf8706fdac8c7db lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.726852:0:11893:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617200/0x5bf8706fdac8c7db lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.726859:0:11893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617200/0x5bf8706fdac8c7db lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.726865:0:11893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c84c2617200 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:3.0:1788574218.726871:0:11893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617200/0x5bf8706fdac8c7db lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.726879:0:11893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617200/0x5bf8706fdac8c7db lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.726894:0:11893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c85c90c8800) 00010000:00010000:3.0:1788574218.726898:0:11893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574218.726904:0:11893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617200/0x5bf8706fdac8c7db lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.726909:0:11893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617200/0x5bf8706fdac8c7db lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.726925:0:11893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616400/0x5bf8706fdac8c7e2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.726942:0:11893:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616400/0x5bf8706fdac8c7e2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.726959:0:11893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616400/0x5bf8706fdac8c7e2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.726966:0:11893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c84c2616400 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:3.0:1788574218.726968:0:11893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616400/0x5bf8706fdac8c7e2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.726975:0:11893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616400/0x5bf8706fdac8c7e2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.726983:0:11893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff9c85fa28c500) 00010000:00010000:3.0:1788574218.726985:0:11893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574218.726988:0:11893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616400/0x5bf8706fdac8c7e2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.726993:0:11893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616400/0x5bf8706fdac8c7e2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.727669:0:11893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8c7e9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.727682:0:11893:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8c7e9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.727689:0:11893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8c7e9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.727695:0:11893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c84c2617400 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:3.0:1788574218.727719:0:11893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8c7e9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.727727:0:11893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8c7e9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.727738:0:11893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c85fa28c700) 00010000:00010000:3.0:1788574218.727741:0:11893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574218.727745:0:11893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8c7e9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.727751:0:11893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8c7e9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574218.727929:0:11893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3ea5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:659467ff-94af-418e-92fe-11e4323a48aa+61:11393:x1875455668975488:12345-192.168.204.51@tcp:34:lhsmtool_posix.0 Request processed in 1429us (1956us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574218.727939:0:11893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 125 00000100:00100000:2.0:1788574218.735609:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574218.735770:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668975744 00000100:00100000:3.0:1788574218.735782:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668975744 00000100:00100000:3.0:1788574218.735904:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 126 00000100:00100000:3.0:1788574218.735916:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3da5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+61:11393:x1875455668975744:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788574218.735946:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574218.735983:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616a00/0x5bf8706fdac8c7f0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d68f2 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.736130:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616200/0x5bf8706fdac8c7f7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.736151:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616200/0x5bf8706fdac8c7f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.736212:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616200/0x5bf8706fdac8c7f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788574218.736238:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788574218.736355:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616200/0x5bf8706fdac8c7f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.736364:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616200/0x5bf8706fdac8c7f7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.736371:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616200/0x5bf8706fdac8c7f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.736379:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c84c2616200 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:3.0:1788574218.736384:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616200/0x5bf8706fdac8c7f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.736394:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616200/0x5bf8706fdac8c7f7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.736423:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c85fa28c700) 00010000:00010000:3.0:1788574218.736427:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788574218.736433:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616200/0x5bf8706fdac8c7f7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.736439:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616200/0x5bf8706fdac8c7f7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.736494:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616a00/0x5bf8706fdac8c7f0 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d68f2 expref: 63 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.736517:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c85c90c8800) 00010000:00010000:3.0:1788574218.736520:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788574218.736525:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616a00/0x5bf8706fdac8c7f0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d68f2 expref: 63 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.736536:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c84c2616a00, rc 0) 00000100:00100000:3.0:1788574218.736622:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3da5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+62:11393:x1875455668975744:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 708us (1029us total) trans 4294967399 rc 301/301 00000100:00100000:3.0:1788574218.736630:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 126 00000100:00100000:2.0:1788574218.742751:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574218.742924:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668975872 00000100:00100000:0.0:1788574218.742938:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668975872 00000100:00100000:0.0:1788574218.743025:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 127 00000100:00100000:0.0:1788574218.743037:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3da7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+62:11393:x1875455668975872:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788574218.743089:0:6492:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788574218.743294:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3da7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+62:11393:x1875455668975872:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 Request processed in 258us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574218.743303:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 127 00000100:00100000:0.0:1788574218.749138:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574218.750119:0:11893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668976128 00000100:00100000:3.0:1788574218.750136:0:11893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668976128 00000100:00100000:3.0:1788574218.750568:0:11893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 128 00000100:00100000:3.0:1788574218.750583:0:11893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3f25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:659467ff-94af-418e-92fe-11e4323a48aa+62:11393:x1875455668976128:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788574218.750616:0:11893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574218.750620:0:11893:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788574218.750670:0:11893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8c795 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d68d6 expref: 62 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.750693:0:11893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c85ec19ac00) 00010000:00010000:3.0:1788574218.750702:0:11893:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788574218.750728:0:11893:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616a00/0x5bf8706fdac8c805 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d68f9 expref: -99 pid: 11893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788574218.751775:0:11893:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:2.0:1788574218.753462:0:11893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ee00/0x5bf8706fdac8c80c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.753494:0:11893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ee00/0x5bf8706fdac8c80c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.753511:0:11893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ee00/0x5bf8706fdac8c80c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.753611:0:11893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616a00/0x5bf8706fdac8c805 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d68f9 expref: 64 pid: 11893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.753638:0:11893:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ee00/0x5bf8706fdac8c80c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d68f9 expref: 63 pid: 11893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.753657:0:11893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9c85ec19aa00) 00010000:00010000:2.0:1788574218.753679:0:11893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788574218.753684:0:11893:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85fa32ee00, rc 0) 00000100:00100000:2.0:1788574218.753876:0:11893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3f25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:659467ff-94af-418e-92fe-11e4323a48aa+63:11393:x1875455668976128:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 3295us (4757us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1788574218.754010:0:11893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 128 00000100:00100000:2.0:1788574218.758759:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574218.758906:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668976384 00000100:00100000:3.0:1788574218.758931:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668976384 00000100:00100000:3.0:1788574218.759033:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 129 00000100:00100000:3.0:1788574218.759053:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3da5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+63:11393:x1875455668976384:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788574218.759132:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574218.759167:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ee00/0x5bf8706fdac8c80c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d68f9 expref: 63 pid: 11893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.759220:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9c85ec19aa00) 00010000:00010000:3.0:1788574218.759235:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788574218.759272:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8c81a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.759289:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8c81a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.759301:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8c81a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.759339:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616200/0x5bf8706fdac8c821 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xa3d450eb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.759347:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616200/0x5bf8706fdac8c821 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xa3d450eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.759353:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616200/0x5bf8706fdac8c821 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xa3d450eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.759414:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8c81a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.759421:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8c81a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.759434:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8c81a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.759440:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c84c2617000 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:3.0:1788574218.759445:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8c81a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.759454:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8c81a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.759463:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c85ec19ac00) 00010000:00010000:3.0:1788574218.759466:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574218.759470:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8c81a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.759477:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8c81a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.759485:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616200/0x5bf8706fdac8c821 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xa3d450eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.759490:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616200/0x5bf8706fdac8c821 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xa3d450eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.759496:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616200/0x5bf8706fdac8c821 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xa3d450eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.759501:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c84c2616200 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:3.0:1788574218.759504:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616200/0x5bf8706fdac8c821 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xa3d450eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.759517:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616200/0x5bf8706fdac8c821 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xa3d450eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.759524:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xa3d450eb (ffff9c85fa28c500) 00010000:00010000:3.0:1788574218.759526:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574218.759529:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616200/0x5bf8706fdac8c821 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xa3d450eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.759534:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616200/0x5bf8706fdac8c821 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xa3d450eb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574218.759639:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3da5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+62:11393:x1875455668976384:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 Request processed in 588us (893us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788574218.759648:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 129 00000100:00100000:2.0:1788574218.763233:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574218.763553:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668976512 00000100:00100000:1.0:1788574218.763566:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668976512 00000100:00100000:1.0:1788574218.763643:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 130 00000100:00100000:1.0:1788574218.763654:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3da5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+62:11393:x1875455668976512:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788574218.763682:0:7439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574218.763725:0:7439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8c828 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6900 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.763796:0:7439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c82f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.764139:0:7439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c82f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.764158:0:7439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c82f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.764574:0:7439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8c828 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6900 expref: 64 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.764603:0:7439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c82f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6900 expref: 63 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.764614:0:7439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9c84c34f0f00) 00010000:00010000:1.0:1788574218.764617:0:7439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788574218.764621:0:7439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85faea2000, rc 0) 00000100:00100000:1.0:1788574218.764765:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3da5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+63:11393:x1875455668976512:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 1111us (1586us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574218.764775:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 130 00000100:00100000:1.0:1788574218.770482:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574218.770638:0:11893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668976768 00000100:00100000:2.0:1788574218.770652:0:11893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668976768 00000100:00100000:2.0:1788574218.771770:0:11893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 131 00000100:00100000:2.0:1788574218.771792:0:11893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3ea5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:659467ff-94af-418e-92fe-11e4323a48aa+63:11393:x1875455668976768:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788574218.771928:0:11893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8c836 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.771951:0:11893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8c836 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.771968:0:11893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8c836 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788574218.772471:0:11893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00010000:2.0:1788574218.772556:0:11893:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000109ea013 reply state 00000000a818f0b9 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8c836 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.772573:0:11893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8c836 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.772583:0:11893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9c84c34f0f00) 00010000:00010000:2.0:1788574218.772586:0:11893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788574218.772591:0:11893:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788574218.772777:0:11893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3ea5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:659467ff-94af-418e-92fe-11e4323a48aa+65:11393:x1875455668976768:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 Request processed in 992us (2310us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1788574218.772786:0:11893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 131 00000100:00100000:3.0:1788574218.775476:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574218.778127:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668976896 00000100:00100000:0.0:1788574218.778151:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668976896 00000100:00100000:2.0:1788574218.780077:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 132 00000100:00100000:2.0:1788574218.780108:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3769f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+65:11393:x1875455668976896:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788574218.780148:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574218.780218:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f400/0x5bf8706fdac8c83d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6907 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.780612:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f400/0x5bf8706fdac8c83d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6907 expref: 66 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.780632:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f400/0x5bf8706fdac8c83d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6907 expref: 66 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.780658:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9c84c34f0f00) 00010000:00010000:2.0:1788574218.780661:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788574218.780667:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85fa32f400, rc 0) 00000100:00100000:2.0:1788574218.780764:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3769f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+66:11393:x1875455668976896:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 670us (5304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574218.783728:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574218.783989:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668977024 00000100:00100000:0.0:1788574218.784003:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668977024 00000100:00100000:0.0:1788574218.784100:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 45 00000100:00100000:0.0:1788574218.784115:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:659467ff-94af-418e-92fe-11e4323a48aa+8:2396:x1875455668977024:12345-192.168.204.51@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1788574218.784360:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788574218.784661:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:659467ff-94af-418e-92fe-11e4323a48aa+9:2396:x1875455668977024:12345-192.168.204.51@tcp:2:lhsmtool_posix.0 Request processed in 548us (953us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1788574218.784690:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 45 00000100:00100000:2.0:1788574218.786398:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 132 00000100:00100000:0.0:1788574218.787510:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574218.788781:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668977280 00000100:00100000:1.0:1788574218.788800:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668977280 00000100:00100000:1.0:1788574218.789014:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 30 00000100:00100000:1.0:1788574218.789028:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3f27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:659467ff-94af-418e-92fe-11e4323a48aa+66:11393:x1875455668977280:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788574218.789396:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3f27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:659467ff-94af-418e-92fe-11e4323a48aa+67:11393:x1875455668977280:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 Request processed in 371us (1892us total) trans 4294967402 rc 0/0 00000100:00100000:1.0:1788574218.789426:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 30 00000100:00100000:3.0:1788574218.793371:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574218.793554:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668977536 00000100:00100000:1.0:1788574218.793567:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668977536 00000100:00100000:1.0:1788574218.793651:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 133 00000100:00100000:1.0:1788574218.793664:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+67:11393:x1875455668977536:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788574218.794038:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+67:11393:x1875455668977536:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 Request processed in 375us (682us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574218.794047:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 133 00000100:00100000:3.0:1788574218.798451:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574218.798790:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668977664 00000100:00100000:1.0:1788574218.798805:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668977664 00000100:00100000:1.0:1788574218.798889:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 134 00000100:00100000:1.0:1788574218.798901:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+67:11393:x1875455668977664:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788574218.798927:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574218.798954:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8c844 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d690e expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.799059:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8c84b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.799089:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8c84b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.799105:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8c84b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788574218.799165:0:6494:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788574218.799595:0:6494:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8c84b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.799656:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8c844 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d690e expref: 69 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.799680:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8c84b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d690e expref: 68 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.799691:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9c84c34f0f00) 00010000:00010000:1.0:1788574218.799694:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788574218.799698:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85faea3e00, rc 0) 00000100:00100000:1.0:1788574218.799805:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+68:11393:x1875455668977664:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 905us (1369us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574218.799814:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 134 00000100:00100000:1.0:1788574218.804173:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574218.804420:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668977792 00000100:00100000:2.0:1788574218.804433:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668977792 00000100:00100000:2.0:1788574218.804509:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 46 00000100:00100000:2.0:1788574218.804521:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3ea7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:659467ff-94af-418e-92fe-11e4323a48aa+9:2393:x1875455668977792:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788574218.804546:0:8409:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574218.804574:0:8409:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003fa0120b/0x5bf8706fdac8c852 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6915 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788574218.804625:0:8409:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9b7a0a, blocks: 0x0 00010000:00010000:2.0:1788574218.804652:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=358s v=(0 0) 00010000:00010000:2.0:1788574218.804657:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574218.804669:0:8409:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003fa0120b/0x5bf8706fdac8c852 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6915 expref: 10 pid: 8409 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.804694:0:8409:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003fa0120b/0x5bf8706fdac8c852 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6915 expref: 10 pid: 8409 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.804721:0:8409:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85fa32e000, rc 0) 00000100:00100000:2.0:1788574218.804798:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3ea7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:659467ff-94af-418e-92fe-11e4323a48aa+10:2393:x1875455668977792:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 279us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574218.804806:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 46 00000100:00100000:2.0:1788574218.816165:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574218.816399:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668978048 00000100:00100000:0.0:1788574218.816413:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668978048 00000100:00100000:0.0:1788574218.816494:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 135 00000100:00100000:0.0:1788574218.816506:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3da7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+68:11393:x1875455668978048:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788574218.816638:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3da7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+68:11393:x1875455668978048:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 Request processed in 134us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574218.816646:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 135 00000100:00100000:3.0:1788574218.823061:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574218.823256:0:13791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668978176 00000100:00100000:2.0:1788574218.823270:0:13791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668978176 00000100:00100000:2.0:1788574218.823335:0:13791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 47 00000100:00100000:2.0:1788574218.823348:0:13791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2f46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:659467ff-94af-418e-92fe-11e4323a48aa+10:11393:x1875455668978176:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788574218.823373:0:13791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574218.823401:0:13791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003bd3353c/0x5bf8706fdac8c859 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d691c expref: -99 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.823444:0:13791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003fa0120b/0x5bf8706fdac8c852 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6915 expref: 11 pid: 8409 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.823479:0:13791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574218.823485:0:13791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574218.823491:0:13791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003bd3353c/0x5bf8706fdac8c859 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d691c expref: 11 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.823534:0:13791:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003fa0120b/0x5bf8706fdac8c852 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6915 expref: 11 pid: 8409 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.823550:0:13791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003fa0120b/0x5bf8706fdac8c852 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6915 expref: 11 pid: 8409 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574218.823568:0:13791:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3da6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:13791:1875455681636864:192.168.204.51@tcp:104: 00000100:00100000:2.0:1788574218.823724:0:13791:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c3e48780 going to sleep for 11 seconds 00000100:00100000:3.0:1788574218.836561:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574218.837242:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668978304 00000100:00100000:1.0:1788574218.837266:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668978304 00010000:00010000:1.0:1788574218.837327:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003fa0120b/0x5bf8706fdac8c852 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6915 expref: 12 pid: 8409 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574218.837385:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 74 00000100:00100000:1.0:1788574218.837398:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e0bdd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:659467ff-94af-418e-92fe-11e4323a48aa+12:2394:x1875455668978304:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788574218.837419:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574218.837450:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003fa0120b/0x5bf8706fdac8c852 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6915 expref: 12 pid: 8409 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.837468:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003fa0120b/0x5bf8706fdac8c852 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6915 expref: 12 pid: 8409 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.837525:0:6478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574218.837530:0:6478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574218.837541:0:6478:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003bd3353c/0x5bf8706fdac8c859 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d691c expref: 12 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.837553:0:6478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003bd3353c/0x5bf8706fdac8c859 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d691c expref: 12 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.837608:0:6478:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000003bd3353c/0x5bf8706fdac8c859 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d691c expref: 12 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574218.837625:0:6478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3ea5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6478:1875455681636992:192.168.204.51@tcp:105: 00010000:00010000:2.0:1788574218.837855:0:13791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003fa0120b/0x5bf8706fdac8c852 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6915 expref: 12 pid: 8409 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574218.837877:0:13791:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3da6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:13791:1875455681636864:192.168.204.51@tcp:104: 00010000:00010000:2.0:1788574218.837914:0:13791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003bd3353c/0x5bf8706fdac8c859 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d691c expref: 11 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.837927:0:13791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85fa32ee00, rc 0) 00000100:00100000:2.0:1788574218.838009:0:13791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2f46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:659467ff-94af-418e-92fe-11e4323a48aa+11:11393:x1875455668978176:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 14663us (14961us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574218.838029:0:13791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 47 00000100:00100000:1.0:1788574218.839158:0:6478:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85d0e7f240 going to sleep for 11 seconds 00000100:00100000:2.0:1788574218.845957:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574218.846066:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668978432 00000100:00100000:3.0:1788574218.846080:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668978432 00002000:00100000:3.0:1788574218.846152:0:8415:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff9c84c3da6a00 x1875455668978432/t0(0) o4->659467ff-94af-418e-92fe-11e4323a48aa@192.168.204.51@tcp:369/0 lens 504/0 e 0 to 0 dl 1788574229 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788574218.846166:0:8415:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c84c3da6a00 with x1875455668978432 ext(0->12) 00002000:00010000:3.0:1788574218.846173:0:8415:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c84c3da6a00 00000100:00100000:3.0:1788574218.846269:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 2 00000100:00100000:3.0:1788574218.846280:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3da6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:659467ff-94af-418e-92fe-11e4323a48aa+11:2394:x1875455668978432:12345-192.168.204.51@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788574218.848395:0:6478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3ea5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6478:1875455681636992:192.168.204.51@tcp:105: 00010000:00010000:1.0:1788574218.848434:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788574218.848536:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e0bdd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:659467ff-94af-418e-92fe-11e4323a48aa+13:2394:x1875455668978304:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 11139us (11987us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574218.848550:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 74 00000100:00100000:3.0:1788574218.849500:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3da6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:659467ff-94af-418e-92fe-11e4323a48aa+12:2394:x1875455668978432:12345-192.168.204.51@tcp:4:lhsmtool_posix.0 Request processed in 3209us (3556us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1788574218.849517:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 2 00002000:00100000:3.0:1788574218.849533:0:8415:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff9c84c3da6a00 x1875455668978432/t4294967309(0) o4->659467ff-94af-418e-92fe-11e4323a48aa@192.168.204.51@tcp:369/0 lens 504/448 e 0 to 0 dl 1788574229 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788574218.849545:0:8415:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c84c3da6a00 with x1875455668978432 ext(0->12) 00002000:00010000:3.0:1788574218.849552:0:8415:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c84c3da6a00 00000100:00100000:2.0:1788574218.855960:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574218.856085:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668978560 00000100:00100000:1.0:1788574218.856098:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668978560 00000100:00100000:1.0:1788574218.856328:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 136 00000100:00100000:1.0:1788574218.856342:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+68:11393:x1875455668978560:12345-192.168.204.51@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788574218.860691:0:6471:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:3.0:1788574218.860741:0:6471:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:3.0:1788574218.860762:0:6471:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c84c3629480 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:3.0:1788574218.860767:0:6471:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c85fae5ff00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c85fa3dab40 00000020:00080000:3.0:1788574218.860771:0:6471:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c85fae5fc00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c84c3ec5800 00000004:00080000:3.0:1788574218.860801:0:6471:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:3.0:1788574218.860841:0:6471:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c86002740c0 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:3.0:1788574218.860845:0:6471:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c85fadac800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c8600274000 00000020:00080000:3.0:1788574218.860849:0:6471:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c85fadacf00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c84c27f6000 00000020:00080000:0.0:1788574218.861134:0:6524:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00010000:00010000:2.0:1788574218.861165:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2c00/0x5bf8706fdac8c55e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788574218.861239:0:6524:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1788574218.861274:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c2f44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681637248:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1788574218.861332:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2c00/0x5bf8706fdac8c55e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.861345:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2c00/0x5bf8706fdac8c55e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.861353:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85faea2c00 already unused, calling callback (ffffffffc1a834f0) 00000100:00100000:0.0:1788574218.861363:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788574218.861365:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2c00/0x5bf8706fdac8c55e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.861377:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2c00/0x5bf8706fdac8c55e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.861403:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9c85ec19ad00) 00010000:00010000:2.0:1788574218.861407:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788574218.861413:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2c00/0x5bf8706fdac8c55e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574218.861414:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:2.0:1788574218.861427:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2c00/0x5bf8706fdac8c55e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574218.861446:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3ea6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681637120:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1788574218.861466:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617800/0x5bf8706fdac8c606 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.861475:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617800/0x5bf8706fdac8c606 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574218.861483:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788574218.861504:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617800/0x5bf8706fdac8c606 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.861510:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c84c2617800 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:2.0:1788574218.861514:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617800/0x5bf8706fdac8c606 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.861522:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617800/0x5bf8706fdac8c606 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.861533:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9c85c3ba6200) 00010000:00010000:2.0:1788574218.861536:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788574218.861540:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617800/0x5bf8706fdac8c606 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.861546:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617800/0x5bf8706fdac8c606 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.861564:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617a00/0x5bf8706fdac8c684 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.861569:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617a00/0x5bf8706fdac8c684 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.861575:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617a00/0x5bf8706fdac8c684 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.861580:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c84c2617a00 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:2.0:1788574218.861583:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617a00/0x5bf8706fdac8c684 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.861597:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617a00/0x5bf8706fdac8c684 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.861604:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c85c3ba6c00) 00010000:00010000:2.0:1788574218.861606:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788574218.861608:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617a00/0x5bf8706fdac8c684 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.861614:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617a00/0x5bf8706fdac8c684 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.861624:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c6a7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.861630:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c6a7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.861636:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c6a7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.861641:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85faea2e00 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:2.0:1788574218.861643:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c6a7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.861649:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c6a7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.861655:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c85c3ba6c00) 00010000:00010000:2.0:1788574218.861658:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788574218.861660:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c6a7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.861672:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c6a7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.861690:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fa00/0x5bf8706fdac8c779 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.861696:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fa00/0x5bf8706fdac8c779 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.861712:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fa00/0x5bf8706fdac8c779 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.861718:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32fa00 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:2.0:1788574218.861721:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fa00/0x5bf8706fdac8c779 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.861727:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fa00/0x5bf8706fdac8c779 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.861736:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c85fa28c700) 00010000:00010000:2.0:1788574218.861738:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788574218.861740:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fa00/0x5bf8706fdac8c779 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.861746:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fa00/0x5bf8706fdac8c779 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.861757:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8c836 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.861762:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8c836 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.861774:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8c836 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.861779:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32fe00 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:2.0:1788574218.861783:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8c836 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.861789:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8c836 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.861799:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9c84c34f0f00) 00010000:00010000:2.0:1788574218.861802:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788574218.861805:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8c836 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574218.861809:0:8815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681637248 00010000:00010000:2.0:1788574218.861812:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8c836 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574218.861821:0:8815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681637248 00000100:00100000:2.0:1788574218.861847:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681637120 00000100:00100000:2.0:1788574218.861856:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681637120 00000100:00100000:2.0:1788574218.861919:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788574218.861930:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601b6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3617:x1875455681637120:12345-0@lo:6:osp-syn-1-0.0 00000100:00080000:0.0:1788574218.861941:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:2.0:1788574218.861965:0:8409:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00002000:00010000:2.0:1788574218.862004:0:8409:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a9b7a09, atime: 0x6a9b7a09, ctime: 0x6a9b7a09, blocks: 0x8 00010000:00010000:2.0:1788574218.862012:0:8409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097d9bd86/0x5bf8706fdac8c860 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.862029:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=358s v=(0 0) 00010000:00010000:2.0:1788574218.862034:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00000100:00100000:1.0:1788574218.863849:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+16:11393:x1875455668978560:12345-192.168.204.51@tcp:44:lhsmtool_posix.0 Request processed in 7486us (7880us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574218.863886:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 136 00010000:00010000:2.0:1788574218.864894:0:8409:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000097d9bd86/0x5bf8706fdac8c860 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.864932:0:8409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000097d9bd86/0x5bf8706fdac8c860 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.864948:0:8409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097d9bd86/0x5bf8706fdac8c860 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.865283:0:8409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000097d9bd86/0x5bf8706fdac8c860 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.865313:0:8409:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788574218.865596:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601b6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3617:x1875455681637120:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3664us (4111us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788574218.865607:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788574218.865644:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788574218.865657:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3f25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3617:x1875455681637248:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788574218.865694:0:8409:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00010000:00010000:2.0:1788574218.865736:0:8409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6d2d339/0x5bf8706fdac8c867 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.865758:0:8409:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f3810157/0x5bf8706fdac8c614 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6874 expref: 11 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.865768:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1788574218.865773:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788574218.865795:0:8409:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6d2d339/0x5bf8706fdac8c867 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.865836:0:8409:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f3810157/0x5bf8706fdac8c614 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6874 expref: 11 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.865853:0:8409:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f3810157/0x5bf8706fdac8c614 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6874 expref: 11 pid: 13791 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574218.865871:0:8409:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36adf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8409:1875455681637376:192.168.204.51@tcp:104: 00010000:00010000:1.0:1788574218.866431:0:7444:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788574218.866443:0:7444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000097d9bd86/0x5bf8706fdac8c860 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.866454:0:7444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32e600 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:1.0:1788574218.866459:0:7444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000097d9bd86/0x5bf8706fdac8c860 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.866472:0:7444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000097d9bd86/0x5bf8706fdac8c860 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.866495:0:7444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000097d9bd86/0x5bf8706fdac8c860 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.866503:0:7444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000097d9bd86/0x5bf8706fdac8c860 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.866533:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574218.866536:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574218.866538:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574218.866906:0:8409:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c3e48300 going to sleep for 11 seconds 00000004:00080000:1.0:1788574218.867035:0:3617:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c84c3ea6680/2, rc 0, transno 4294967305 00000100:00100000:1.0:1788574218.867045:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3ea6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681637120:0@lo:6:osp-syn-1-0.0 00000001:00080000:1.0:1788574218.871377:0:9487:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:1.0:1788574218.871400:0:9487:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:1.0:1788574218.872868:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574218.872990:0:13791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668978688 00000100:00100000:0.0:1788574218.873001:0:13791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668978688 00000100:00100000:0.0:1788574218.873063:0:13791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 50 00000100:00100000:0.0:1788574218.873074:0:13791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3ea6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:659467ff-94af-418e-92fe-11e4323a48aa+12:2396:x1875455668978688:12345-192.168.204.51@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788574218.873506:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574218.874009:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668978816 00000100:00100000:3.0:1788574218.874017:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668978816 00010000:00010000:3.0:1788574218.874051:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f3810157/0x5bf8706fdac8c614 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6874 expref: 13 pid: 13791 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574218.874413:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 75 00000100:00100000:0.0:1788574218.874440:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3f25180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:659467ff-94af-418e-92fe-11e4323a48aa+13:2393:x1875455668978816:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788574218.874482:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574218.874493:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f3810157/0x5bf8706fdac8c614 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6874 expref: 13 pid: 13791 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.874513:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f3810157/0x5bf8706fdac8c614 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6874 expref: 13 pid: 13791 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.874545:0:6477:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788574218.874550:0:6477:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788574218.874557:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6d2d339/0x5bf8706fdac8c867 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.874568:0:6477:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6d2d339/0x5bf8706fdac8c867 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.874597:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574218.874678:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3f25180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:659467ff-94af-418e-92fe-11e4323a48aa+13:2393:x1875455668978816:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 252us (1253us total) trans 0 rc 0/0 00010000:00010000:2.0:1788574218.874720:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3810157/0x5bf8706fdac8c614 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6874 expref: 13 pid: 13791 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574218.874740:0:8409:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36adf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8409:1875455681637376:192.168.204.51@tcp:104: 00010000:00010000:2.0:1788574218.874769:0:8409:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a6d2d339/0x5bf8706fdac8c867 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.874781:0:8409:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a6d2d339/0x5bf8706fdac8c867 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.874788:0:8409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6d2d339/0x5bf8706fdac8c867 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.874799:0:8409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6d2d339/0x5bf8706fdac8c867 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.874814:0:8409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6d2d339/0x5bf8706fdac8c867 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.874833:0:8409:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788574218.874907:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788574218.874915:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6d2d339/0x5bf8706fdac8c867 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.874925:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32f200 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:2.0:1788574218.874930:0:6480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6d2d339/0x5bf8706fdac8c867 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.874940:0:6480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6d2d339/0x5bf8706fdac8c867 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.876794:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6d2d339/0x5bf8706fdac8c867 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.876911:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6d2d339/0x5bf8706fdac8c867 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.876940:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574218.876942:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574218.876945:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574218.878153:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 75 00000001:00080000:0.0:1788574218.878629:0:8404:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:0.0:1788574218.878651:0:8404:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000100:00100000:2.0:1788574218.878721:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3f25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3617:x1875455681637248:12345-0@lo:6:osp-syn-0-0.0 Request processed in 13064us (17361us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788574218.878755:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000004:00080000:0.0:1788574218.878756:0:3617:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c85c2f44700/2, rc 0, transno 4294967310 00000100:00100000:0.0:1788574218.878778:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c2f44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681637248:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788574218.878869:0:13791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3ea6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:659467ff-94af-418e-92fe-11e4323a48aa+6:2396:x1875455668978688:12345-192.168.204.51@tcp:16:lhsmtool_posix.0 Request processed in 5786us (5997us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574218.878885:0:13791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 50 00000100:00100000:0.0:1788574218.884652:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574218.884741:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668979072 00000100:00100000:1.0:1788574218.884757:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668979072 00000100:00100000:1.0:1788574218.884836:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 137 00000100:00100000:1.0:1788574218.884847:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3f27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+16:11393:x1875455668979072:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788574218.884905:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574218.884932:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8c84b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d690e expref: 16 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.884953:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9c84c34f0f00) 00010000:00010000:1.0:1788574218.884958:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788574218.884990:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c86e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.885006:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c86e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.885016:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c86e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788574218.885147:0:6494:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000086901bd8 reply state 00000000709428dc transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c86e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.885159:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c86e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.885164:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9c84c34f0f00) 00010000:00010000:1.0:1788574218.885167:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788574218.885184:0:6494:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788574218.885355:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3f27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+17:11393:x1875455668979072:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 Request processed in 508us (721us total) trans 4294967403 rc 0/0 00000100:00100000:1.0:1788574218.885365:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 137 00000100:00100000:0.0:1788574218.888065:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574218.888176:0:8815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668979200 00000100:00100000:2.0:1788574218.888186:0:8815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668979200 00000100:00100000:2.0:1788574218.888966:0:8815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 51 00000100:00100000:2.0:1788574218.888977:0:8815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3f26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:659467ff-94af-418e-92fe-11e4323a48aa+6:2394:x1875455668979200:12345-192.168.204.51@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788574218.889127:0:8815:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788574218.889132:0:8815:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788574218 00002000:00010000:2.0:1788574218.889135:0:8815:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1788574217 00002000:00010000:2.0:1788574218.889137:0:8815:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1788574218 -> 1788574218 00002000:00010000:2.0:1788574218.889140:0:8815:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1788574218.889234:0:8815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3f26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:659467ff-94af-418e-92fe-11e4323a48aa+7:2394:x1875455668979200:12345-192.168.204.51@tcp:2:lhsmtool_posix.0 Request processed in 258us (1179us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1788574218.889243:0:8815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 51 00000100:00100000:2.0:1788574218.894001:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574218.897888:0:11893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668979456 00000100:00100000:3.0:1788574218.897904:0:11893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668979456 00000100:00100000:3.0:1788574218.898049:0:11893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 138 00000100:00100000:3.0:1788574218.898061:0:11893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:659467ff-94af-418e-92fe-11e4323a48aa+17:11393:x1875455668979456:12345-192.168.204.51@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788574218.898137:0:11893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616200/0x5bf8706fdac8c875 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.898156:0:11893:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c82f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6900 expref: 17 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.898167:0:11893:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616200/0x5bf8706fdac8c875 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.898227:0:11893:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c82f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6900 expref: 17 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.898244:0:11893:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c82f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6900 expref: 17 pid: 7439 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574218.898260:0:11893:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c2f46680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11893:1875455681637504:192.168.204.51@tcp:104: 00000100:00100000:3.0:1788574218.898353:0:11893:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c267ecc0 going to sleep for 11 seconds 00010000:00010000:0.0:1788574218.899665:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574218.900582:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c2f45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681637632:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788574218.900678:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574218.901379:0:7533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681637632 00000100:00100000:1.0:1788574218.901393:0:7533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681637632 00000100:00100000:1.0:1788574218.901518:0:7533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1788574218.901530:0:7533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3f27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681637632:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788574218.901579:0:7533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1788574218.905365:0:7533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3f27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681637632:12345-0@lo:41:osp-pre-0-1.0 Request processed in 3821us (4671us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574218.905385:0:7533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788574218.905645:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574218.906473:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c2f45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681637632:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788574218.906593:0:7433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668979584 00000100:00100000:1.0:1788574218.906602:0:7433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668979584 00010000:00010000:1.0:1788574218.906649:0:7433:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c82f lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6900 expref: 18 pid: 7439 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574218.906685:0:7433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 76 00000100:00100000:1.0:1788574218.906695:0:7433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8335180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:659467ff-94af-418e-92fe-11e4323a48aa+18:2393:x1875455668979584:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788574218.906725:0:7433:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574218.906734:0:7433:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c82f lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6900 expref: 18 pid: 7439 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.906747:0:7433:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c82f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6900 expref: 18 pid: 7439 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.906774:0:7433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9c84c34f0f00) 00010000:00010000:1.0:1788574218.906780:0:7433:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616200/0x5bf8706fdac8c875 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.906809:0:7433:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616200/0x5bf8706fdac8c875 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.906817:0:7433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616200/0x5bf8706fdac8c875 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.906853:0:7433:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788574218.906929:0:7433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8335180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:659467ff-94af-418e-92fe-11e4323a48aa+18:2393:x1875455668979584:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 234us (1286us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574218.906936:0:7433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 76 00010000:00010000:3.0:1788574218.908634:0:11893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8c82f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6900 expref: 17 pid: 7439 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574218.908667:0:11893:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c2f46680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11893:1875455681637504:192.168.204.51@tcp:104: 00010000:00010000:3.0:1788574218.908696:0:11893:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616200/0x5bf8706fdac8c875 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.911050:0:11893:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616200/0x5bf8706fdac8c875 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.911075:0:11893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616200/0x5bf8706fdac8c875 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.911144:0:11893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616200/0x5bf8706fdac8c875 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.911154:0:11893:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616200/0x5bf8706fdac8c875 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.911163:0:11893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616200/0x5bf8706fdac8c875 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.911169:0:11893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c84c2616200 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:0.0:1788574218.911175:0:11893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616200/0x5bf8706fdac8c875 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.911374:0:11893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616200/0x5bf8706fdac8c875 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.911464:0:11893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9c84c34f0f00) 00010000:00010000:0.0:1788574218.911467:0:11893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788574218.911473:0:11893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616200/0x5bf8706fdac8c875 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574218.911481:0:11893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616200/0x5bf8706fdac8c875 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574218.911787:0:11893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:659467ff-94af-418e-92fe-11e4323a48aa+16:11393:x1875455668979456:12345-192.168.204.51@tcp:55:lhsmtool_posix.0 Request processed in 13720us (17787us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788574218.911802:0:11893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 138 00000100:00100000:1.0:1788574218.918979:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574218.926677:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668979712 00000100:00100000:0.0:1788574218.926699:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668979712 00000100:00100000:1.0:1788574218.926901:0:13791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 52 00000100:00100000:1.0:1788574218.926918:0:13791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3ea6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:659467ff-94af-418e-92fe-11e4323a48aa+7:2394:x1875455668979712:12345-192.168.204.51@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788574218.926987:0:13791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f4577505/0x5bf8706fdac8c87c lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.927014:0:13791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003bd3353c/0x5bf8706fdac8c859 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d691c expref: 7 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.927025:0:13791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574218.927030:0:13791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788574218.927036:0:13791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4577505/0x5bf8706fdac8c87c lrc: 4/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.927085:0:13791:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003bd3353c/0x5bf8706fdac8c859 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d691c expref: 7 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.927127:0:13791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003bd3353c/0x5bf8706fdac8c859 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d691c expref: 7 pid: 13791 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574218.927155:0:13791:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3ea5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:13791:1875455681637760:192.168.204.51@tcp:104: 00000100:00100000:1.0:1788574218.927327:0:13791:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85d0e7f300 going to sleep for 11 seconds 00000100:00100000:1.0:1788574218.936288:0:13791:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3ea5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:13791:1875455681637760:192.168.204.51@tcp:104: 00010000:00010000:1.0:1788574218.936335:0:13791:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f4577505/0x5bf8706fdac8c87c lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574218.940585:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574218.941766:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668979840 00000100:00100000:1.0:1788574218.941783:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668979840 00010000:00010000:1.0:1788574218.941847:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003bd3353c/0x5bf8706fdac8c859 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d691c expref: 8 pid: 13791 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574218.941907:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 77 00000100:00100000:1.0:1788574218.941919:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3f24380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:659467ff-94af-418e-92fe-11e4323a48aa+8:2394:x1875455668979840:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788574218.941940:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574218.941969:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003bd3353c/0x5bf8706fdac8c859 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d691c expref: 8 pid: 13791 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.941986:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003bd3353c/0x5bf8706fdac8c859 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d691c expref: 8 pid: 13791 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.942015:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003bd3353c/0x5bf8706fdac8c859 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d691c expref: 8 pid: 13791 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.942057:0:6479:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788574218.942062:0:6479:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788574218.942069:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f4577505/0x5bf8706fdac8c87c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.942079:0:6479:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4577505/0x5bf8706fdac8c87c lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.942320:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788574218.942396:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3f24380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:659467ff-94af-418e-92fe-11e4323a48aa+7:2394:x1875455668979840:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 477us (1825us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574218.942404:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 77 00010000:00010000:2.0:1788574218.945696:0:13791:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f4577505/0x5bf8706fdac8c87c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.945737:0:13791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4577505/0x5bf8706fdac8c87c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.945978:0:13791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f4577505/0x5bf8706fdac8c87c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.945989:0:13791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4577505/0x5bf8706fdac8c87c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.946023:0:13791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4577505/0x5bf8706fdac8c87c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.946030:0:13791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85faea3e00 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:2.0:1788574218.946036:0:13791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4577505/0x5bf8706fdac8c87c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.946047:0:13791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4577505/0x5bf8706fdac8c87c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.946074:0:13791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4577505/0x5bf8706fdac8c87c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574218.946083:0:13791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4577505/0x5bf8706fdac8c87c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574218.946746:0:13791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3ea6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:659467ff-94af-418e-92fe-11e4323a48aa+6:2394:x1875455668979712:12345-192.168.204.51@tcp:1:lhsmtool_posix.0 Request processed in 19824us (27771us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574218.946761:0:13791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 52 00000100:00100000:0.0:1788574218.955084:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574218.960131:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668980096 00000100:00100000:1.0:1788574218.960941:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668980096 00000100:00100000:1.0:1788574218.961183:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 139 00000100:00100000:1.0:1788574218.961229:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3f27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+16:11393:x1875455668980096:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788574218.961343:0:7439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2c00/0x5bf8706fdac8c883 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.961362:0:7439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e200/0x5bf8706fdac8c772 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d68c8 expref: 16 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.961373:0:7439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2c00/0x5bf8706fdac8c883 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.961417:0:7439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e200/0x5bf8706fdac8c772 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d68c8 expref: 16 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.961451:0:7439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e200/0x5bf8706fdac8c772 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d68c8 expref: 16 pid: 7439 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574218.961469:0:7439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3ea5500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7439:1875455681637888:192.168.204.51@tcp:104: 00000100:00100000:1.0:1788574218.961582:0:7439:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85d0e7f300 going to sleep for 11 seconds 00000100:00100000:2.0:1788574218.971804:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574218.974077:0:7433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668980224 00000100:00100000:3.0:1788574218.974095:0:7433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668980224 00010000:00010000:3.0:1788574218.974172:0:7433:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e200/0x5bf8706fdac8c772 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d68c8 expref: 17 pid: 7439 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574218.974482:0:7433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 78 00000100:00100000:3.0:1788574218.974494:0:7433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c09500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:659467ff-94af-418e-92fe-11e4323a48aa+17:2394:x1875455668980224:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788574218.974512:0:7433:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574218.974519:0:7433:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e200/0x5bf8706fdac8c772 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d68c8 expref: 17 pid: 7439 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.974535:0:7433:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e200/0x5bf8706fdac8c772 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d68c8 expref: 17 pid: 7439 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.974562:0:7433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c85fa28c700) 00010000:00010000:3.0:1788574218.974568:0:7433:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3600/0x5bf8706fdac8c7d4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d68eb expref: 17 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.974584:0:7433:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2c00/0x5bf8706fdac8c883 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.974592:0:7433:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2c00/0x5bf8706fdac8c883 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.974601:0:7433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2c00/0x5bf8706fdac8c883 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.974623:0:7433:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788574218.974736:0:7433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c09500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:659467ff-94af-418e-92fe-11e4323a48aa+17:2394:x1875455668980224:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 244us (2946us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574218.974745:0:7433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 78 00010000:00010000:1.0:1788574218.976554:0:7439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e200/0x5bf8706fdac8c772 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d68c8 expref: 16 pid: 7439 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574218.976586:0:7439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3ea5500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7439:1875455681637888:192.168.204.51@tcp:104: 00010000:00010000:1.0:1788574218.976618:0:7439:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2c00/0x5bf8706fdac8c883 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.976629:0:7439:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2c00/0x5bf8706fdac8c883 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.976636:0:7439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2c00/0x5bf8706fdac8c883 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.977108:0:7439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8c88a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.977126:0:7439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f400/0x5bf8706fdac8c83d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6907 expref: 16 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.977137:0:7439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8c88a lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.977498:0:7439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f400/0x5bf8706fdac8c83d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6907 expref: 16 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.977539:0:7439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f400/0x5bf8706fdac8c83d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6907 expref: 16 pid: 6492 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574218.977557:0:7439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3ea5500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7439:1875455681638016:192.168.204.51@tcp:104: 00000100:00100000:1.0:1788574218.977677:0:7439:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85d0e7fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788574218.984330:0:7439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3ea5500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7439:1875455681638016:192.168.204.51@tcp:104: 00010000:00010000:1.0:1788574218.984541:0:7439:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8c88a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574218.984670:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574218.984749:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668980352 00000100:00100000:3.0:1788574218.984759:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668980352 00010000:00010000:3.0:1788574218.984825:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f400/0x5bf8706fdac8c83d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6907 expref: 17 pid: 6492 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574218.984871:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 79 00000100:00100000:3.0:1788574218.984883:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faff3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:659467ff-94af-418e-92fe-11e4323a48aa+17:2393:x1875455668980352:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788574218.984905:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574218.984914:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f400/0x5bf8706fdac8c83d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6907 expref: 17 pid: 6492 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.984929:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f400/0x5bf8706fdac8c83d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6907 expref: 17 pid: 6492 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.984968:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f400/0x5bf8706fdac8c83d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6907 expref: 17 pid: 6492 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.984988:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9c84c34f0f00) 00010000:00010000:3.0:1788574218.984994:0:6477:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8c88a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.985007:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8c88a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.985016:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8c88a lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574218.985080:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788574218.985118:0:7439:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8c88a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.985129:0:7439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8c88a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574218.985165:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faff3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:659467ff-94af-418e-92fe-11e4323a48aa+16:2393:x1875455668980352:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 282us (1040us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574218.985174:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 79 00000001:00080000:1.0:1788574218.985325:0:7439:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:1.0:1788574218.985503:0:7439:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:1.0:1788574218.985548:0:7439:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:1.0:1788574218.985651:0:7439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3ea5500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7439:1875455681638144:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788574218.985733:0:7439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574218.985773:0:7439:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85d0591f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788574218.985784:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681638144 00000100:00100000:0.0:1788574218.985835:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681638144 00000100:00100000:0.0:1788574218.985920:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788574218.985930:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3ea5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7439:x1875455681638144:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788574218.986059:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3ea5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7439:x1875455681638144:12345-0@lo:1000:mdt00_003.0 Request processed in 131us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574218.986067:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788574218.986403:0:7439:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:1.0:1788574218.986410:0:7439:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:1.0:1788574218.986766:0:7439:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9c85c2f44700 x1875455681637248/t4294967310(4294967310) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788574234 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574218.986784:0:7439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3ea5500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7439:1875455681638144:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1788574218.988405:0:7439:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:1.0:1788574218.988603:0:7439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3ea5500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7439:1875455681638272:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788574218.988693:0:7439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574218.988746:0:7439:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85d0e7f840 going to sleep for 11 seconds 00000100:00100000:0.0:1788574218.989053:0:7533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681638272 00000100:00100000:0.0:1788574218.989064:0:7533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681638272 00000100:00100000:0.0:1788574218.989175:0:7533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788574218.989213:0:7533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3ea7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7439:x1875455681638272:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788574218.989439:0:7533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3ea7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:7439:x1875455681638272:12345-0@lo:1000:mdt00_003.0 Request processed in 254us (744us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1788574218.989448:0:7533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1788574218.990565:0:7439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3ea5500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7439:1875455681638272:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1788574218.990642:0:7439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8c88a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.990654:0:7439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8c88a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.990663:0:7439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8c88a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.990670:0:7439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85faea3800 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:1.0:1788574218.990677:0:7439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8c88a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.990687:0:7439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8c88a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.990720:0:7439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9c84c34f0f00) 00010000:00010000:1.0:1788574218.990724:0:7439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788574218.990729:0:7439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8c88a lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.990736:0:7439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8c88a lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.990768:0:7439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617600/0x5bf8706fdac8c7cd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.990797:0:7439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617600/0x5bf8706fdac8c7cd lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.990805:0:7439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617600/0x5bf8706fdac8c7cd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.990811:0:7439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c84c2617600 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:1.0:1788574218.990814:0:7439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617600/0x5bf8706fdac8c7cd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.990821:0:7439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617600/0x5bf8706fdac8c7cd lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.992567:0:7439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c85fa28c700) 00010000:00010000:1.0:1788574218.992580:0:7439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788574218.992593:0:7439:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3600/0x5bf8706fdac8c7d4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d68eb expref: 19 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.992610:0:7439:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3600/0x5bf8706fdac8c7d4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d68eb expref: 19 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.992620:0:7439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3600/0x5bf8706fdac8c7d4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d68eb expref: 19 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.992685:0:7439:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3600/0x5bf8706fdac8c7d4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d68eb expref: 19 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574218.992713:0:7439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3ea6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7439:1875455681638400:192.168.204.51@tcp:105: 00000100:00100000:1.0:1788574218.994932:0:7439:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c860198ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788574218.999559:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574218.999694:0:7439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3ea6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7439:1875455681638400:192.168.204.51@tcp:105: 00010000:00010000:1.0:1788574218.999747:0:7439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617600/0x5bf8706fdac8c7cd lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.999760:0:7439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617600/0x5bf8706fdac8c7cd lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.999802:0:7439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8c891 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.999821:0:7439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8c891 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.999844:0:7439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8c891 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.999857:0:7439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8c891 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.999863:0:7439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8c891 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.999871:0:7439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8c891 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.999877:0:7439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85faea3800 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:1.0:1788574218.999882:0:7439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8c891 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.999889:0:7439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8c891 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.999928:0:7439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c85fa28c700) 00010000:00010000:1.0:1788574218.999931:0:7439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788574218.999936:0:7439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8c891 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.999942:0:7439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8c891 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.999952:0:7439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2c00/0x5bf8706fdac8c883 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.999960:0:7439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2c00/0x5bf8706fdac8c883 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.999966:0:7439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2c00/0x5bf8706fdac8c883 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.999971:0:7439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85faea2c00 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:1.0:1788574218.999974:0:7439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2c00/0x5bf8706fdac8c883 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.999980:0:7439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2c00/0x5bf8706fdac8c883 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.999987:0:7439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c85fa28c700) 00010000:00010000:1.0:1788574218.999989:0:7439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788574218.999992:0:7439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2c00/0x5bf8706fdac8c883 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574218.999999:0:7439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2c00/0x5bf8706fdac8c883 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574219.000292:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3f27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+19:11393:x1875455668980096:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 Request processed in 39071us (45221us total) trans 4294967408 rc 0/0 00000100:00100000:1.0:1788574219.000305:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 139 00000020:00080000:1.0:1788574219.000312:0:7439:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788574219.000550:0:13764:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788574219.000557:0:13764:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788574219.001108:0:13764:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1788574219.001119:0:13764:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788574219.003130:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668980480 00000100:00100000:3.0:1788574219.004081:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668980480 00000100:00100000:0.0:1788574219.004606:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 31 00000100:00100000:0.0:1788574219.004643:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faff1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:659467ff-94af-418e-92fe-11e4323a48aa+19:11392:x1875455668980480:12345-192.168.204.51@tcp:49:lfs.0 00000100:00080000:3.0:1788574219.005580:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788574219.005765:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faff1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:659467ff-94af-418e-92fe-11e4323a48aa+19:11392:x1875455668980480:12345-192.168.204.51@tcp:49:lfs.0 Request processed in 1121us (6215us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574219.005779:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 31 00000100:00100000:2.0:1788574219.006048:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574219.006592:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668980736 00000100:00100000:1.0:1788574219.006604:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668980736 00000100:00100000:1.0:1788574219.006665:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 32 00000100:00100000:1.0:1788574219.006675:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85d01f5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:659467ff-94af-418e-92fe-11e4323a48aa+19:11393:x1875455668980736:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788574219.008939:0:6496:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788574219.009734:0:6496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:1.0:1788574219.009819:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2c00/0x5bf8706fdac8c898 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574219.009856:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2c00/0x5bf8706fdac8c898 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574219.009870:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2c00/0x5bf8706fdac8c898 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574219.009880:0:6496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2c00/0x5bf8706fdac8c898 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574219.009887:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2c00/0x5bf8706fdac8c898 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574219.009894:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2c00/0x5bf8706fdac8c898 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574219.009928:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788574219.010127:0:7444:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788574219.010138:0:7444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2c00/0x5bf8706fdac8c898 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574219.010156:0:7444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85faea2c00 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:3.0:1788574219.010161:0:7444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2c00/0x5bf8706fdac8c898 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574219.010171:0:7444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2c00/0x5bf8706fdac8c898 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574219.010203:0:7444:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9c84c34f0f00) 00010000:00010000:3.0:1788574219.010207:0:7444:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788574219.010213:0:7444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2c00/0x5bf8706fdac8c898 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574219.010220:0:7444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2c00/0x5bf8706fdac8c898 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574219.010244:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574219.010246:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574219.010248:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574219.011656:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85d01f5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:659467ff-94af-418e-92fe-11e4323a48aa+21:11393:x1875455668980736:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 Request processed in 4968us (5595us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1788574219.011673:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 32 00000020:00080000:1.0:1788574219.011683:0:6496:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788574219.012183:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574219.012729:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668980992 00000100:00100000:0.0:1788574219.012742:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668980992 00000100:00100000:0.0:1788574219.012813:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 140 00000100:00100000:0.0:1788574219.012823:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2f46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+21:11392:x1875455668980992:12345-192.168.204.51@tcp:58:lfs.0 00000040:00080000:0.0:1788574219.013594:0:6492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:0.0:1788574219.013733:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2f46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+21:11392:x1875455668980992:12345-192.168.204.51@tcp:58:lfs.0 Request processed in 908us (1550us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574219.013745:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 140 00000100:00100000:3.0:1788574219.061063:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574219.061580:0:11893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668981120 00000100:00100000:0.0:1788574219.061596:0:11893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668981120 00000100:00100000:0.0:1788574219.061694:0:11893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 141 00000100:00100000:0.0:1788574219.061718:0:11893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2f45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:659467ff-94af-418e-92fe-11e4323a48aa+21:11396:x1875455668981120:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:0.0:1788574219.061757:0:11893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574219.061788:0:11893:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8c89f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6923 expref: -99 pid: 11893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574219.063822:0:11893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c8a6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574219.064575:0:11893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c8a6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574219.064598:0:11893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c8a6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574219.064656:0:11893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c8ad lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574219.064665:0:11893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c8ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574219.064673:0:11893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c8ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574219.064796:0:11893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6a00/0x5bf8706fdac8c8b4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574219.064816:0:11893:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8c7bf lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d68e4 expref: 22 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574219.066564:0:11893:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6a00/0x5bf8706fdac8c8b4 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574219.066665:0:11893:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8c7bf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d68e4 expref: 22 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574219.066689:0:11893:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8c7bf lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d68e4 expref: 22 pid: 6493 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574219.066721:0:11893:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3f24a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11893:1875455681638528:192.168.204.51@tcp:104: 00000100:00100000:0.0:1788574219.067778:0:11893:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c86002749c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788574219.074864:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574219.075395:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668981376 00000100:00100000:1.0:1788574219.075409:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668981376 00000100:00100000:1.0:1788574219.075493:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 33 00000100:00100000:1.0:1788574219.075505:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2f47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:659467ff-94af-418e-92fe-11e4323a48aa+23:6161:x1875455668981376:12345-192.168.204.51@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788574219.075854:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2f47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:659467ff-94af-418e-92fe-11e4323a48aa+24:6161:x1875455668981376:12345-192.168.204.51@tcp:35:ldlm_bl.0 Request processed in 350us (1009us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1788574219.075863:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 33 00000100:00100000:2.0:1788574219.079510:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574219.079770:0:7433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668981504 00000100:00100000:3.0:1788574219.079783:0:7433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668981504 00010000:00010000:3.0:1788574219.080043:0:7433:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8c7bf lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d68e4 expref: 24 pid: 6493 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574219.080101:0:7433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 80 00000100:00100000:3.0:1788574219.080901:0:7433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faff1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:659467ff-94af-418e-92fe-11e4323a48aa+24:2393:x1875455668981504:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788574219.081082:0:7433:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788574219.081115:0:7433:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8c7bf lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d68e4 expref: 24 pid: 6493 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574219.081135:0:7433:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8c7bf lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d68e4 expref: 24 pid: 6493 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574219.081551:0:7433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c85fa28c700) 00010000:00010000:2.0:1788574219.081558:0:7433:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6a00/0x5bf8706fdac8c8b4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574219.081572:0:7433:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6a00/0x5bf8706fdac8c8b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574219.081582:0:7433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6a00/0x5bf8706fdac8c8b4 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574219.081615:0:7433:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788574219.081715:0:7433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faff1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:659467ff-94af-418e-92fe-11e4323a48aa+24:2393:x1875455668981504:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 1602us (2386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574219.081726:0:7433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 80 00010000:00010000:0.0:1788574219.082096:0:11893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8c7bf lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d68e4 expref: 23 pid: 6493 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574219.082138:0:11893:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3f24a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11893:1875455681638528:192.168.204.51@tcp:104: 00010000:00010000:0.0:1788574219.082924:0:11893:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6a00/0x5bf8706fdac8c8b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574219.084750:0:11893:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6a00/0x5bf8706fdac8c8b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574219.084770:0:11893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6a00/0x5bf8706fdac8c8b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788574219.086641:0:11893:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788574219.086655:0:11893:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788574219.086711:0:11893:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6a00/0x5bf8706fdac8c8b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574219.086737:0:11893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6a00/0x5bf8706fdac8c8b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574219.086777:0:11893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c8a6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574219.086785:0:11893:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c8a6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574219.086793:0:11893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c8a6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574219.086800:0:11893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d6600 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:2.0:1788574219.086806:0:11893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c8a6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574219.086816:0:11893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c8a6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574219.086838:0:11893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c85ec19ac00) 00010000:00010000:2.0:1788574219.086841:0:11893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788574219.086847:0:11893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c8a6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574219.086855:0:11893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c8a6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574219.086877:0:11893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c8ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574219.086884:0:11893:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c8ad lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574219.086890:0:11893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c8ad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574219.086902:0:11893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d7e00 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:2.0:1788574219.086905:0:11893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c8ad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574219.086912:0:11893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c8ad lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574219.086920:0:11893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9c85d07b8e00) 00010000:00010000:2.0:1788574219.086923:0:11893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788574219.086927:0:11893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c8ad lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574219.086934:0:11893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c8ad lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574219.087003:0:11893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8c89f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6923 expref: 23 pid: 11893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574219.087020:0:11893:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6a00/0x5bf8706fdac8c8b4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6923 expref: 22 pid: 11893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574219.087029:0:11893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c85fa28c700) 00010000:00010000:2.0:1788574219.087032:0:11893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788574219.087034:0:11893:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d20d6a00, rc 0) 00000100:00100000:2.0:1788574219.087143:0:11893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2f45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:659467ff-94af-418e-92fe-11e4323a48aa+22:11396:x1875455668981120:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 25427us (26109us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574219.087154:0:11893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 141 00010000:00010000:2.0:1788574219.928693:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788574220.059677:0:13764:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788574220.059696:0:13764:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788574220.059742:0:13764:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788574220.059753:0:13764:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788574220.059901:0:13764:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3ea6a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13764:1875455681638656:192.168.204.51@tcp:107:hsm_cdtr.0 00000040:00080000:0.0:1788574220.062104:0:14237:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788574220.062113:0:14237:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788574220.062144:0:14237:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788574220.062149:0:14237:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788574220.069619:0:13764:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c860198e600 going to sleep for 11 seconds 00000100:00100000:2.0:1788574220.081312:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574220.081352:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668981632 00000100:00100000:2.0:1788574220.081360:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668981632 00000100:00100000:2.0:1788574220.081413:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 142 00000100:00100000:2.0:1788574220.081424:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+23:11407:x1875455668981632:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788574220.081467:0:7439:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788574220.082110:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+23:11407:x1875455668981632:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 Request processed in 685us (806us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574220.082120:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 142 00000100:00100000:2.0:1788574220.082275:0:13764:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3ea6a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13764:1875455681638656:192.168.204.51@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788574220.089846:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574220.090706:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668981888 00000100:00100000:3.0:1788574220.090719:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668981888 00000100:00100000:3.0:1788574220.090787:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 143 00000100:00100000:3.0:1788574220.090798:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa0e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+22:11407:x1875455668981888:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788574220.090821:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574220.090843:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8c8bb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d692a expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574220.090965:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8c8c2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574220.090980:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8c8c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574220.090994:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8c8c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788574220.091007:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788574220.091119:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8c8bb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d692a expref: 25 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574220.091149:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8c8c2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d692a expref: 24 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574220.091157:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c85fa28c700) 00010000:00010000:3.0:1788574220.091160:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788574220.091164:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c84c2617000, rc 0) 00000100:00100000:3.0:1788574220.091252:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa0e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+24:11407:x1875455668981888:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 456us (1418us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1788574220.091260:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 143 00000100:00100000:1.0:1788574220.097818:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574220.097866:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574220.097929:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668982016 00000100:00100000:2.0:1788574220.097930:0:11893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668982272 00000100:00100000:3.0:1788574220.097942:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668982016 00000100:00100000:3.0:1788574220.098013:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 9 00000100:00100000:3.0:1788574220.098024:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e0bddc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:659467ff-94af-418e-92fe-11e4323a48aa+24:2394:x1875455668982016:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788574220.098048:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574220.098075:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8c8c2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d692a expref: 24 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574220.098092:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c85fa28c700) 00010000:00010000:3.0:1788574220.098097:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788574220.098098:0:11893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668982272 00000100:00100000:3.0:1788574220.098152:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e0bddc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:659467ff-94af-418e-92fe-11e4323a48aa+24:2394:x1875455668982016:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 130us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574220.098160:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 9 00000100:00100000:2.0:1788574220.098257:0:11893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 144 00000100:00100000:2.0:1788574220.098267:0:11893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3ea7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:659467ff-94af-418e-92fe-11e4323a48aa+23:11407:x1875455668982272:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788574220.098334:0:11893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8c8d0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574220.098350:0:11893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8c8d0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574220.098361:0:11893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8c8d0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574220.098646:0:11893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8c8d0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574220.098655:0:11893:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8c8d0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574220.098668:0:11893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8c8d0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574220.098674:0:11893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32fe00 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:2.0:1788574220.098690:0:11893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8c8d0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574220.098699:0:11893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8c8d0 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574220.098708:0:11893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c85fa28c700) 00010000:00010000:2.0:1788574220.098711:0:11893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788574220.098715:0:11893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8c8d0 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574220.098722:0:11893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8c8d0 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574220.098803:0:11893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3ea7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:659467ff-94af-418e-92fe-11e4323a48aa+24:11407:x1875455668982272:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 Request processed in 537us (935us total) trans 4294967413 rc 0/0 00000100:00100000:2.0:1788574220.098810:0:11893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 144 00000040:00080000:3.0:1788574220.099108:0:13764:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788574220.099114:0:13764:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788574220.099609:0:13764:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1788574220.099622:0:13764:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788574220.129404:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574220.129459:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668982528 00000100:00100000:3.0:1788574220.129467:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668982528 00000100:00100000:3.0:1788574220.129514:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 34 00000100:00100000:3.0:1788574220.129523:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2f47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:659467ff-94af-418e-92fe-11e4323a48aa+24:11407:x1875455668982528:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788574220.129810:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2f47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:659467ff-94af-418e-92fe-11e4323a48aa+25:11407:x1875455668982528:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 Request processed in 287us (631us total) trans 4294967414 rc 0/0 00000100:00100000:3.0:1788574220.129818:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 34 00000100:00100000:3.0:1788574220.436491:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788574220.436516:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3f24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681638784:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788574220.436596:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574220.436864:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681638784 00000100:00100000:0.0:1788574220.436873:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681638784 00000100:00100000:0.0:1788574220.436930:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788574220.436941:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2f44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681638784:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788574220.436976:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000004:00080000:1.0:1788574220.437161:0:8811:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 360416970241ns, next at 361416967594ns, rc = 0 00000100:00100000:1.0:1788574220.437232:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3ea4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681638912:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788574220.437268:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574220.437303:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788574220.437309:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3ea7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681639040:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788574220.437341:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574220.437374:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681638912 00000100:00100000:1.0:1788574220.437391:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681638912 00000100:00100000:1.0:1788574220.437424:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681639040 00000100:00100000:1.0:1788574220.437427:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681639040 00000100:00100000:1.0:1788574220.437442:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788574220.437448:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3ea6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3617:x1875455681638912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788574220.437470:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788574220.437505:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3ea6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3617:x1875455681638912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 56us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574220.437511:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788574220.437527:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788574220.437532:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3ea4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681639040:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788574220.437541:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788574220.437563:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3ea4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681639040:12345-0@lo:13:osp-pre-0-1.0 Request processed in 31us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574220.437568:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00080000:1.0:1788574220.437584:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788574220.437617:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3ea7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681639040:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788574220.437631:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3ea4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681638912:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788574220.438420:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2f44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681638784:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1478us (1820us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574220.438430:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788574220.442638:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3f24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681638784:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788574220.872781:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574220.872841:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574220.872876:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574220.872910:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574220.872939:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574220.872967:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668983168 00000100:00100000:3.0:1788574220.872978:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668983168 00000100:00100000:2.0:1788574220.873613:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668982912 00000100:00100000:2.0:1788574220.873621:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668982912 00000100:00100000:2.0:1788574220.873805:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668983040 00000100:00100000:0.0:1788574220.873808:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668982656 00000100:00100000:2.0:1788574220.873809:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668983040 00000100:00100000:0.0:1788574220.873812:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668982656 00000100:00100000:2.0:1788574220.873834:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 116 00000100:00100000:0.0:1788574220.873838:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 388 00000100:00100000:2.0:1788574220.873844:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2f46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:659467ff-94af-418e-92fe-11e4323a48aa+6:2395:x1875455668982912:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1788574220.873844:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5674450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+13:2395:x1875455668982656:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1788574220.873919:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5674450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+13:2395:x1875455668982656:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 74us (1300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574220.873926:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 388 00000100:00100000:0.0:1788574220.873962:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 117 00000100:00100000:0.0:1788574220.873970:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faff3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:659467ff-94af-418e-92fe-11e4323a48aa+5:2395:x1875455668983040:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1788574220.874008:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faff3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:659467ff-94af-418e-92fe-11e4323a48aa+5:2395:x1875455668983040:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 39us (1068us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574220.874014:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 117 00000100:00080000:0.0:1788574220.874062:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788574220.874067:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788574220.874447:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2f46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:659467ff-94af-418e-92fe-11e4323a48aa+6:2395:x1875455668982912:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 603us (1604us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574220.874455:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 116 00000100:00100000:1.0:1788574220.875241:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668982784 00000100:00100000:1.0:1788574220.875250:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668982784 00000100:00100000:1.0:1788574220.875351:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 315 00000100:00100000:1.0:1788574220.875360:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+5:2395:x1875455668982784:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788574220.875407:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+5:2395:x1875455668982784:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 48us (2496us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574220.875414:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 315 00000100:00080000:0.0:1788574220.878592:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788574220.884073:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574220.884125:0:11893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668983296 00000100:00100000:2.0:1788574220.884136:0:11893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668983296 00000100:00100000:2.0:1788574220.884220:0:11893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 316 00000100:00100000:2.0:1788574220.884232:0:11893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3648a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2395:x1875455668983296:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1788574220.884300:0:11893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3648a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2395:x1875455668983296:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 71us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574220.884322:0:11893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 316 00000100:00080000:2.0:1788574220.884349:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788574220.888756:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788574220.896274:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 317 00000100:00100000:3.0:1788574220.896297:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8335180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2395:x1875455668983168:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1788574220.896552:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8335180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2395:x1875455668983168:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 266us (23674us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574220.896561:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 317 00010000:00010000:0.0:1788574220.947485:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574221.461349:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3f24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875455681639424:0@lo:400:kworker.0 00000100:00100000:0.0:1788574221.461431:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574221.461483:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3f26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1875455681639936:0@lo:400:kworker.0 00000100:00100000:0.0:1788574221.461504:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574221.461526:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3f24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3617:1875455681640448:0@lo:400:kworker.0 00000100:00100000:0.0:1788574221.461546:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574221.461568:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788574221.461573:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3f24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681639552:0@lo:400:kworker.0 00000100:00100000:0.0:1788574221.461596:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574221.461611:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3f25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1875455681640064:0@lo:400:kworker.0 00000100:00100000:0.0:1788574221.461640:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574221.461667:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3f27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1875455681640576:0@lo:400:kworker.0 00000100:00100000:0.0:1788574221.461688:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574221.461718:0:7533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681639552 00000100:00100000:0.0:1788574221.461725:0:7533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681639552 00000100:00100000:0.0:1788574221.461766:0:7533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788574221.461774:0:7533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c26bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681639552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574221.461820:0:7533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c26bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681639552:12345-0@lo:400:kworker.0 Request processed in 47us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574221.461840:0:7533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788574221.461862:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681639424 00000100:00100000:0.0:1788574221.461866:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681639424 00000100:00100000:0.0:1788574221.461883:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681639936 00000100:00100000:0.0:1788574221.461886:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681639936 00000100:00100000:0.0:1788574221.461907:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681640448 00000100:00100000:0.0:1788574221.461910:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681640448 00000100:00100000:0.0:1788574221.461920:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681640064 00000100:00100000:0.0:1788574221.461922:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681640064 00000100:00100000:0.0:1788574221.461931:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681640576 00000100:00100000:0.0:1788574221.461933:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681640576 00000100:00100000:0.0:1788574221.461944:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1788574221.461949:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c26b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875455681639424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574221.461976:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c26b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875455681639424:12345-0@lo:400:kworker.0 Request processed in 28us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574221.461982:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1788574221.461991:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1788574221.461996:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c26bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875455681639936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574221.462016:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c26bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875455681639936:12345-0@lo:400:kworker.0 Request processed in 20us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574221.462020:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1788574221.462028:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1788574221.462033:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c26b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875455681640448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574221.462051:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c26b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875455681640448:12345-0@lo:400:kworker.0 Request processed in 19us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574221.462056:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1788574221.462063:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1788574221.462075:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c26b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875455681640064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574221.462099:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c26b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875455681640064:12345-0@lo:400:kworker.0 Request processed in 25us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574221.462105:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1788574221.462117:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1788574221.462123:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2bded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875455681640576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574221.462146:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2bded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875455681640576:12345-0@lo:400:kworker.0 Request processed in 24us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574221.462152:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1788574221.462211:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3f24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681639552:0@lo:400:kworker.0 00010000:00080000:0.0:1788574221.462227:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3f25f80 x1875455681640064/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574237 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574221.462237:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3f25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1875455681640064:0@lo:400:kworker.0 00010000:00080000:0.0:1788574221.462246:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3f27100 x1875455681640576/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574237 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574221.462254:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3f27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1875455681640576:0@lo:400:kworker.0 00000100:00100000:0.0:1788574221.462263:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3f24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875455681639424:0@lo:400:kworker.0 00000100:00100000:0.0:1788574221.462271:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3f26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1875455681639936:0@lo:400:kworker.0 00000100:00100000:0.0:1788574221.462279:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3f24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3617:1875455681640448:0@lo:400:kworker.0 00000100:00100000:3.0:1788574221.463058:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3f25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:69505170-06bc-41d1-9626-ab1a3c7f32a0:3620:1875455681639296:0@lo:400:kworker.0 00000100:00100000:3.0:1788574221.463110:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574221.463165:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3f26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681639808:0@lo:400:kworker.0 00000100:00100000:3.0:1788574221.463215:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574221.463234:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3f25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681640320:0@lo:400:kworker.0 00000100:00100000:3.0:1788574221.463256:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574221.463273:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85e56c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681640832:0@lo:400:kworker.0 00000100:00100000:3.0:1788574221.463291:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574221.463310:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1788574221.463315:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3f24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681639168:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788574221.463336:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574221.463352:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3f26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875455681639680:0@lo:400:kworker.0 00000100:00100000:3.0:1788574221.463371:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574221.463386:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3f24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681640192:0@lo:400:kworker.0 00000100:00100000:3.0:1788574221.463404:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574221.463537:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3f25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681640704:0@lo:400:kworker.0 00000100:00100000:3.0:1788574221.463562:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574221.463598:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681639296 00000100:00100000:3.0:1788574221.463604:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681639296 00000100:00100000:3.0:1788574221.463638:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:3.0:1788574221.463645:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5676050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:3620:x1875455681639296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574221.463698:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5676050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:3620:x1875455681639296:12345-0@lo:400:kworker.0 Request processed in 53us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574221.463705:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:3.0:1788574221.463734:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681639808 00000100:00100000:3.0:1788574221.463737:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681639808 00000100:00100000:3.0:1788574221.463758:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1788574221.463764:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faff1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681639808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574221.463800:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faff1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681639808:12345-0@lo:400:kworker.0 Request processed in 37us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574221.463806:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1788574221.463822:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681640320 00000100:00100000:3.0:1788574221.463825:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681640320 00000100:00100000:3.0:1788574221.463845:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681640832 00000100:00100000:3.0:1788574221.463848:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681640832 00000100:00100000:3.0:1788574221.463863:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681640192 00000100:00100000:3.0:1788574221.463865:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681640192 00000100:00100000:3.0:1788574221.463874:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681640704 00000100:00100000:3.0:1788574221.463876:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681640704 00000100:00100000:3.0:1788574221.463889:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788574221.463895:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85d10d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3620:x1875455681640320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574221.463923:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85d10d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3620:x1875455681640320:12345-0@lo:400:kworker.0 Request processed in 28us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574221.463929:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788574221.463940:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788574221.463944:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85d10d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681640832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574221.463968:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85d10d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681640832:12345-0@lo:400:kworker.0 Request processed in 23us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574221.463973:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788574221.463984:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788574221.463990:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681640192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574221.464015:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681640192:12345-0@lo:400:kworker.0 Request processed in 26us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574221.464021:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788574221.464031:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788574221.464043:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa32b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681640704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574221.464070:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa32b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681640704:12345-0@lo:400:kworker.0 Request processed in 28us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574221.464076:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788574221.464092:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681639680 00000100:00100000:3.0:1788574221.464095:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681639680 00000100:00100000:3.0:1788574221.464118:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1788574221.464123:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875455681639680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574221.464292:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875455681639680:12345-0@lo:400:kworker.0 Request processed in 169us (919us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574221.464298:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:3.0:1788574221.464349:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3f26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875455681639680:0@lo:400:kworker.0 00000100:00100000:3.0:1788574221.464360:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3f24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681640192:0@lo:400:kworker.0 00000100:00100000:3.0:1788574221.464368:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3f25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681640704:0@lo:400:kworker.0 00000100:00100000:3.0:1788574221.464375:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3f25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:69505170-06bc-41d1-9626-ab1a3c7f32a0:3620:1875455681639296:0@lo:400:kworker.0 00000100:00100000:3.0:1788574221.464382:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3f26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681639808:0@lo:400:kworker.0 00000100:00100000:3.0:1788574221.464391:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3f25180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681640320:0@lo:400:kworker.0 00000100:00100000:3.0:1788574221.464398:0:3620:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:3.0:1788574221.464403:0:3620:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967305 00000004:00080000:3.0:1788574221.464552:0:3620:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c84c3d9b100, transno 4294967302 00000004:00080000:3.0:1788574221.465618:0:3620:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:3.0:1788574221.465641:0:3620:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c84c3ea6680, transno 4294967305 00000100:00100000:3.0:1788574221.465650:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85e56c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681640832:0@lo:400:kworker.0 00000100:00080000:3.0:1788574221.465735:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788574221.465740:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788574221.465744:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788574221.465784:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681639168 00000100:00100000:3.0:1788574221.465790:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681639168 00000100:00100000:3.0:1788574221.465827:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788574221.465834:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85d10d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681639168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788574221.465861:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788574221.465923:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85d10d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681639168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (2586us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574221.465931:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788574221.465975:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3f24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681639168:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788574221.469799:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788574221.469831:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3ea4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681640960:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788574221.469901:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574221.469947:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681640960 00000100:00100000:1.0:1788574221.469954:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681640960 00000100:00100000:1.0:1788574221.470008:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788574221.470016:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fb136850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681640960:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788574221.470036:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788574221.470075:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fb136850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681640960:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574221.470082:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788574221.470327:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3ea4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681640960:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788574221.971782:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788574222.014884:0:14288:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788574222.014893:0:14288:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788574222.014922:0:14288:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788574222.014928:0:14288:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788574222.254524:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574222.254672:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668983552 00000100:00100000:0.0:1788574222.254684:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668983552 00000100:00100000:0.0:1788574222.254766:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 145 00000100:00100000:0.0:1788574222.254777:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c364a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+25:11428:x1875455668983552:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:0.0:1788574222.254802:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574222.254824:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c8d7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6931 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574222.254935:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8c8de lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788574222.254945:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788574222.254963:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8c8de lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574222.254978:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8c8de lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788574222.254992:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788574222.255106:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c8d7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6931 expref: 28 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574222.255125:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8c8de lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6931 expref: 27 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574222.255134:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c85fa28c700) 00010000:00010000:0.0:1788574222.255137:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788574222.255140:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d20d6800, rc 0) 00000100:00100000:0.0:1788574222.255244:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c364a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+27:11428:x1875455668983552:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 468us (729us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1788574222.255269:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 145 00000100:00100000:0.0:1788574222.260768:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574222.260843:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668983680 00000100:00100000:3.0:1788574222.260855:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668983680 00000100:00100000:2.0:1788574222.260997:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 146 00000100:00100000:2.0:1788574222.261007:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2bde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+27:11428:x1875455668983680:12345-192.168.204.51@tcp:54:lfs.0 00010000:00010000:2.0:1788574222.261094:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f200/0x5bf8706fdac8c8ec lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574222.261115:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f200/0x5bf8706fdac8c8ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574222.261131:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f200/0x5bf8706fdac8c8ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574222.261173:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f200/0x5bf8706fdac8c8ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574222.261228:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f200/0x5bf8706fdac8c8ec lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574222.261235:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f200/0x5bf8706fdac8c8ec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574222.261244:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32f200 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:2.0:1788574222.261251:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f200/0x5bf8706fdac8c8ec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574222.261261:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f200/0x5bf8706fdac8c8ec lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574222.261276:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c85fa28c700) 00010000:00010000:2.0:1788574222.261279:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788574222.261285:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f200/0x5bf8706fdac8c8ec lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574222.261292:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f200/0x5bf8706fdac8c8ec lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574222.261376:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2bde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+27:11428:x1875455668983680:12345-192.168.204.51@tcp:54:lfs.0 Request processed in 370us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574222.261385:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 146 00000100:00100000:1.0:1788574222.349403:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574222.349662:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668983808 00000100:00100000:3.0:1788574222.349674:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668983808 00000100:00100000:2.0:1788574222.353055:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 53 00000100:00100000:2.0:1788574222.353074:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3ea4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:659467ff-94af-418e-92fe-11e4323a48aa+6:2393:x1875455668983808:12345-192.168.204.51@tcp:101:cat.0 00010000:00010000:2.0:1788574222.353093:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574222.353114:0:8410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6d2d339/0x5bf8706fdac8c8f3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6938 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788574222.353159:0:8410:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a9b7a0a, atime: 0x6a9b7a09, ctime: 0x6a9b7a0a, blocks: 0x8 00010000:00010000:2.0:1788574222.353183:0:8410:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=362s v=(0 0) 00010000:00010000:2.0:1788574222.353220:0:8410:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574222.353231:0:8410:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6d2d339/0x5bf8706fdac8c8f3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6938 expref: 7 pid: 8410 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574222.353263:0:8410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6d2d339/0x5bf8706fdac8c8f3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6938 expref: 7 pid: 8410 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574222.353277:0:8410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85fa32f200, rc 0) 00000100:00100000:2.0:1788574222.353350:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3ea4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:659467ff-94af-418e-92fe-11e4323a48aa+7:2393:x1875455668983808:12345-192.168.204.51@tcp:101:cat.0 Request processed in 282us (3957us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574222.353358:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 53 00000100:00080000:3.0:1788574222.357069:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788574222.358720:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574222.359420:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668983936 00000100:00100000:2.0:1788574222.359433:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668983936 00002000:00100000:2.0:1788574222.359491:0:8416:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff9c85c2bdca80 x1875455668983936/t0(0) o3->659467ff-94af-418e-92fe-11e4323a48aa@192.168.204.51@tcp:373/0 lens 488/0 e 0 to 0 dl 1788574233 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788574222.359503:0:8416:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c85c2bdca80 with x1875455668983936 ext(0->4095) 00002000:00010000:2.0:1788574222.359509:0:8416:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c85c2bdca80 00000100:00100000:2.0:1788574222.359597:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 3 00000100:00100000:2.0:1788574222.359607:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2bdca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:659467ff-94af-418e-92fe-11e4323a48aa+7:2394:x1875455668983936:12345-192.168.204.51@tcp:3:cat.0 00000100:00100000:2.0:1788574222.359824:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2bdca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:659467ff-94af-418e-92fe-11e4323a48aa+7:2394:x1875455668983936:12345-192.168.204.51@tcp:3:cat.0 Request processed in 218us (1113us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788574222.359841:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 3 00002000:00100000:2.0:1788574222.359848:0:8416:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff9c85c2bdca80 x1875455668983936/t0(0) o3->659467ff-94af-418e-92fe-11e4323a48aa@192.168.204.51@tcp:373/0 lens 488/4536 e 0 to 0 dl 1788574233 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788574222.359857:0:8416:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c85c2bdca80 with x1875455668983936 ext(0->4095) 00002000:00010000:2.0:1788574222.359860:0:8416:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c85c2bdca80 00010000:00010000:3.0:1788574222.995437:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788574223.188122:0:13764:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788574223.188134:0:13764:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788574223.188184:0:13764:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788574223.188217:0:13764:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1788574223.510153:0:13768:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788574224.019819:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788574224.019842:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fa328380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681641088:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788574224.019912:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574224.020086:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681641088 00000100:00100000:3.0:1788574224.020094:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681641088 00000100:00100000:3.0:1788574224.020147:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1788574224.020166:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2bdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681641088:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788574224.020220:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1788574224.020282:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2bdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681641088:12345-0@lo:41:osp-pre-0-1.0 Request processed in 126us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574224.020289:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1788574224.020428:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fa328380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681641088:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788574224.021055:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574225.044481:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788574225.044824:0:8404:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:0.0:1788574225.044837:0:8404:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:0.0:1788574225.048786:0:6471:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000004:00080000:0.0:1788574225.048808:0:6471:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:0.0:1788574225.048843:0:6471:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c85d0591600 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1788574225.048849:0:6471:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c84c371c800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c85d0591f00 00000020:00080000:0.0:1788574225.048853:0:6471:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c84c371c300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c860192a800 00000020:00080000:0.0:1788574225.048872:0:6471:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:0.0:1788574225.048946:0:6524:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:0.0:1788574225.049022:0:6524:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:0.0:1788574225.049040:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3f24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681641216:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788574225.049113:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574225.049226:0:8815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681641216 00000100:00100000:0.0:1788574225.049234:0:8815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681641216 00000100:00100000:0.0:1788574225.049289:0:8815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788574225.049299:0:8815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3f25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681641216:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1788574225.049418:0:8815:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1788574225.049422:0:8815:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 1788574218 -> 1788574218 00002000:00010000:0.0:1788574225.049424:0:8815:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 1788574217 -> 1788574217 00002000:00010000:0.0:1788574225.049435:0:8815:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1788574218 -> 1788574218 00002000:00010000:0.0:1788574225.049438:0:8815:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1788574225.049480:0:8815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3f25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3619:x1875455681641216:12345-0@lo:2:osp-syn-0-0.0 Request processed in 182us (366us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1788574225.049488:0:8815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:0.0:1788574225.049510:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788574225.049544:0:3619:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:0.0:1788574225.049549:0:3619:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c85c2f44700, transno 4294967310 00000004:00080000:0.0:1788574225.049559:0:3619:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:0.0:1788574225.049578:0:3619:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9c84c3f24000 x1875455681641216/t4294967313(4294967313) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1788574241 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1788574225.049602:0:3619:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c84c3f24000/2, rc 0, transno 4294967313 00000100:00100000:0.0:1788574225.049607:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3f24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681641216:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1788574225.049746:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c86e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574225.049756:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c86e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574225.049764:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c86e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574225.049770:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85faea2e00 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:2.0:1788574225.049774:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c86e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574225.049782:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c86e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574225.049799:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9c84c34f0f00) 00010000:00010000:2.0:1788574225.049803:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788574225.049815:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c86e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574225.049821:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c86e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574225.555506:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3ea6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681641344:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788574225.555595:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574225.555712:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681641344 00000100:00100000:1.0:1788574225.555721:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681641344 00000100:00100000:1.0:1788574225.555779:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788574225.555790:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3648000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3620:x1875455681641344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788574225.555819:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788574225.555932:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fa328380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681641472:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788574225.555992:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574225.556359:0:8413:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:0.0:1788574225.556368:0:8413:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:3.0:1788574225.556717:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3f26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681641600:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788574225.556756:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574225.558519:0:7533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681641600 00000100:00100000:0.0:1788574225.558534:0:7533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681641600 00000100:00100000:0.0:1788574225.558622:0:7533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788574225.558641:0:7533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e56c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681641600:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788574225.558682:0:7533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788574225.558770:0:7533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e56c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681641600:12345-0@lo:41:osp-pre-1-0.0 Request processed in 138us (2011us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574225.558777:0:7533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788574225.558845:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3f26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681641600:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788574225.558882:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681641472 00000100:00100000:0.0:1788574225.558887:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681641472 00000100:00080000:0.0:1788574225.558922:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788574225.559381:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788574225.559390:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa32ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681641472:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788574225.559406:0:14401:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788574225.559585:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa32ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681641472:12345-0@lo:13:osp-pre-0-1.0 Request processed in 186us (3581us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574225.559593:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788574225.560645:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fa328380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681641472:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788574225.561700:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3648000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3620:x1875455681641344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5905us (6098us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574225.561714:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788574225.568295:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3ea6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681641344:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788574225.992338:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574225.992382:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574225.992407:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574225.992427:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574225.992447:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574225.992482:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574225.992508:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574225.992834:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668984320 00000100:00100000:3.0:1788574225.992849:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668984320 00000100:00100000:3.0:1788574225.992946:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668984832 00000100:00100000:3.0:1788574225.992950:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668984832 00000100:00100000:3.0:1788574225.992970:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668984192 00000100:00100000:3.0:1788574225.992973:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668984192 00000100:00100000:3.0:1788574225.992999:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668984704 00000100:00100000:3.0:1788574225.993003:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668984704 00000100:00100000:3.0:1788574225.993027:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 324 00000100:00100000:3.0:1788574225.993039:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3ea4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+5:2395:x1875455668984320:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1788574225.993140:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668984064 00000100:00100000:3.0:1788574225.993148:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3ea4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+5:2395:x1875455668984320:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 109us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574225.993161:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 324 00000100:00100000:0.0:1788574225.993161:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668984064 00000100:00100000:3.0:1788574225.993225:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 325 00000100:00100000:3.0:1788574225.993240:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3ea7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2395:x1875455668984832:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1788574225.993285:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 390 00000100:00100000:3.0:1788574225.993291:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3ea7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2395:x1875455668984832:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 53us (858us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574225.993306:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5674050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+13:2395:x1875455668984064:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1788574225.993328:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 325 00000100:00100000:3.0:1788574225.993352:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 326 00000100:00100000:3.0:1788574225.993362:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3ea4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+13:2395:x1875455668984192:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1788574225.993405:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5674050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+13:2395:x1875455668984064:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 102us (1075us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574225.993413:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3ea4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+13:2395:x1875455668984192:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 48us (959us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574225.993423:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 390 00000100:00100000:3.0:1788574225.993443:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 326 00000100:00100000:3.0:1788574225.993477:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 327 00000100:00100000:3.0:1788574225.993486:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3ea6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2395:x1875455668984704:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1788574225.993512:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668984576 00000100:00100000:0.0:1788574225.993519:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668984576 00000100:00100000:3.0:1788574225.993521:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3ea6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2395:x1875455668984704:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 34us (1010us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574225.993532:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 327 00000100:00100000:0.0:1788574225.993585:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668984448 00000100:00100000:0.0:1788574225.993590:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668984448 00000100:00100000:3.0:1788574225.993594:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 122 00000100:00100000:3.0:1788574225.993607:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3ea7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:659467ff-94af-418e-92fe-11e4323a48aa+5:2395:x1875455668984576:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1788574225.993631:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 123 00000100:00100000:0.0:1788574225.993641:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3ea4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:659467ff-94af-418e-92fe-11e4323a48aa+6:2395:x1875455668984448:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1788574225.993651:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3ea7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:659467ff-94af-418e-92fe-11e4323a48aa+5:2395:x1875455668984576:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 41us (1236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574225.993663:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 122 00000100:00100000:0.0:1788574225.993692:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3ea4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:659467ff-94af-418e-92fe-11e4323a48aa+6:2395:x1875455668984448:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 51us (1206us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574225.993701:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 123 00000100:00080000:1.0:1788574225.996307:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788574225.996321:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788574225.996325:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788574225.996329:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788574226.069101:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574226.580620:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3f25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875455681641984:0@lo:400:kworker.0 00000100:00100000:0.0:1788574226.580717:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574226.580784:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3f26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1875455681642496:0@lo:400:kworker.0 00000100:00100000:0.0:1788574226.580810:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574226.580836:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3f24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3617:1875455681643008:0@lo:400:kworker.0 00000100:00100000:0.0:1788574226.580860:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574226.580887:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788574226.580894:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3f24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681642112:0@lo:400:kworker.0 00000100:00100000:0.0:1788574226.580939:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574226.580960:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3f24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1875455681642624:0@lo:400:kworker.0 00000100:00100000:0.0:1788574226.580994:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574226.581015:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fa328380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1875455681643136:0@lo:400:kworker.0 00000100:00100000:0.0:1788574226.581039:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574226.581074:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681641984 00000100:00100000:0.0:1788574226.581083:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681641984 00000100:00100000:0.0:1788574226.581604:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681642496 00000100:00100000:0.0:1788574226.581613:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681642496 00000100:00100000:0.0:1788574226.581651:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681643008 00000100:00100000:0.0:1788574226.581654:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681643008 00000100:00100000:0.0:1788574226.581670:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681642624 00000100:00100000:0.0:1788574226.581672:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681642624 00000100:00100000:0.0:1788574226.581687:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681643136 00000100:00100000:0.0:1788574226.581690:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681643136 00000100:00100000:0.0:1788574226.581709:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1788574226.581722:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85d10dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875455681641984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574226.581820:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85d10dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875455681641984:12345-0@lo:400:kworker.0 Request processed in 100us (1103us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574226.581830:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1788574226.581856:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:0.0:1788574226.581863:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85d10df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875455681642496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574226.581896:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85d10df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875455681642496:12345-0@lo:400:kworker.0 Request processed in 34us (1085us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574226.581903:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:0.0:1788574226.581914:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:0.0:1788574226.581920:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c2335f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875455681643008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574226.581969:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c2335f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875455681643008:12345-0@lo:400:kworker.0 Request processed in 49us (1107us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574226.581975:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:0.0:1788574226.581987:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:0.0:1788574226.581993:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875455681642624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574226.582022:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875455681642624:12345-0@lo:400:kworker.0 Request processed in 29us (1027us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574226.582028:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:0.0:1788574226.582040:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1788574226.582047:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875455681643136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574226.582075:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875455681643136:12345-0@lo:400:kworker.0 Request processed in 29us (1035us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574226.582081:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1788574226.582119:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681642112 00000100:00100000:0.0:1788574226.582124:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681642112 00000100:00100000:0.0:1788574226.582152:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788574226.582159:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681642112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574226.582220:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681642112:12345-0@lo:400:kworker.0 Request processed in 62us (1281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574226.582227:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1788574226.582404:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3f26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681641728:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788574226.582454:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574226.582489:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3f26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875455681642240:0@lo:400:kworker.0 00000100:00100000:3.0:1788574226.582517:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574226.582551:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3f27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681642752:0@lo:400:kworker.0 00000100:00100000:3.0:1788574226.582596:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574226.582631:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85d10dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681643264:0@lo:400:kworker.0 00000100:00100000:3.0:1788574226.582662:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574226.582698:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1788574226.582706:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3f25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69505170-06bc-41d1-9626-ab1a3c7f32a0:3619:1875455681641856:0@lo:400:kworker.0 00000100:00100000:3.0:1788574226.582742:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574226.582770:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3f24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681642368:0@lo:400:kworker.0 00000100:00100000:3.0:1788574226.582801:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574226.582823:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3f25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681642880:0@lo:400:kworker.0 00000100:00100000:3.0:1788574226.582857:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574226.582876:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85d10ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681643392:0@lo:400:kworker.0 00000100:00100000:3.0:1788574226.582896:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574226.583060:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3f24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681642112:0@lo:400:kworker.0 00010000:00080000:0.0:1788574226.583082:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3f24700 x1875455681642624/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574242 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574226.583094:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3f24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1875455681642624:0@lo:400:kworker.0 00010000:00080000:0.0:1788574226.583121:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85fa328380 x1875455681643136/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574242 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574226.583131:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fa328380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1875455681643136:0@lo:400:kworker.0 00000100:00100000:0.0:1788574226.583145:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3f25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875455681641984:0@lo:400:kworker.0 00000100:00100000:0.0:1788574226.583157:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3f26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1875455681642496:0@lo:400:kworker.0 00000100:00100000:0.0:1788574226.583169:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3f24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3617:1875455681643008:0@lo:400:kworker.0 00000100:00080000:1.0:1788574226.583488:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788574226.583496:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788574226.583597:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788574226.583608:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fa328380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681643520:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788574226.583647:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574226.588463:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681642240 00000100:00100000:3.0:1788574226.588490:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681642240 00000100:00100000:3.0:1788574226.588591:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1788574226.588605:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85d10d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875455681642240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574226.588762:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85d10d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875455681642240:12345-0@lo:400:kworker.0 Request processed in 160us (6243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574226.588771:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1788574226.588812:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681641728 00000100:00100000:3.0:1788574226.588817:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681641728 00000100:00100000:3.0:1788574226.588869:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681643520 00000100:00100000:3.0:1788574226.588873:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681643520 00000100:00100000:3.0:1788574226.588893:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788574226.588900:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85d10d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681641728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788574226.588932:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788574226.588974:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85d10d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681641728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (6520us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574226.589016:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788574226.589032:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788574226.589046:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3f24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681643520:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788574226.589059:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788574226.589092:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3f24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681643520:12345-0@lo:13:osp-pre-1-1.0 Request processed in 47us (5443us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574226.589098:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788574226.589444:0:13791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681642752 00000100:00100000:3.0:1788574226.589451:0:13791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681642752 00000100:00100000:3.0:1788574226.589486:0:13791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681643264 00000100:00100000:3.0:1788574226.589489:0:13791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681643264 00000100:00100000:3.0:1788574226.589500:0:13791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681642880 00000100:00100000:3.0:1788574226.589503:0:13791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681642880 00000100:00100000:3.0:1788574226.589515:0:13791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681643392 00000100:00100000:3.0:1788574226.589518:0:13791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681643392 00000100:00100000:3.0:1788574226.589532:0:13791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788574226.589539:0:13791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8ab3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681642752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574226.589594:0:13791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8ab3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681642752:12345-0@lo:400:kworker.0 Request processed in 55us (6996us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574226.589600:0:13791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788574226.589612:0:13791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788574226.589617:0:13791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8ab2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681643264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574226.589648:0:13791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8ab2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681643264:12345-0@lo:400:kworker.0 Request processed in 31us (6986us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574226.589653:0:13791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788574226.589663:0:13791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788574226.589669:0:13791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8ab1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3619:x1875455681642880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574226.589708:0:13791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8ab1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3619:x1875455681642880:12345-0@lo:400:kworker.0 Request processed in 39us (6850us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574226.589714:0:13791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788574226.589725:0:13791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788574226.589731:0:13791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8ab2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681643392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574226.589757:0:13791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8ab2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681643392:12345-0@lo:400:kworker.0 Request processed in 26us (6860us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574226.589764:0:13791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788574226.589794:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681641856 00000100:00100000:3.0:1788574226.589798:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681641856 00000100:00100000:3.0:1788574226.589830:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:3.0:1788574226.589837:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5677850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:3619:x1875455681641856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574226.589872:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5677850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:3619:x1875455681641856:12345-0@lo:400:kworker.0 Request processed in 36us (7130us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574226.589878:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:3.0:1788574226.589918:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681642368 00000100:00100000:3.0:1788574226.589923:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681642368 00000100:00100000:3.0:1788574226.589953:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1788574226.589960:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8ab1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681642368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574226.590013:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8ab1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681642368:12345-0@lo:400:kworker.0 Request processed in 53us (7211us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574226.590020:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1788574226.590782:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3f25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69505170-06bc-41d1-9626-ab1a3c7f32a0:3619:1875455681641856:0@lo:400:kworker.0 00000100:00100000:3.0:1788574226.590804:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3f24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681642368:0@lo:400:kworker.0 00000100:00100000:3.0:1788574226.590822:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3f25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681642880:0@lo:400:kworker.0 00000100:00100000:3.0:1788574226.590853:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85d10ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681643392:0@lo:400:kworker.0 00000100:00100000:3.0:1788574226.590880:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3f26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681641728:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788574226.590894:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3f26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875455681642240:0@lo:400:kworker.0 00000100:00100000:3.0:1788574226.590909:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3f27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681642752:0@lo:400:kworker.0 00000100:00100000:3.0:1788574226.590922:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85d10dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681643264:0@lo:400:kworker.0 00000100:00080000:1.0:1788574226.591648:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788574226.592574:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fa328380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681643520:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788574226.807874:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574226.807929:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668984960 00000100:00100000:3.0:1788574226.807942:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668984960 00000100:00100000:3.0:1788574226.808019:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 147 00000100:00100000:3.0:1788574226.808031:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8ab0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+13:11081:x1875455668984960:12345-192.168.204.51@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788574226.808174:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8ab0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+13:11081:x1875455668984960:12345-192.168.204.51@tcp:60:lhsmtool_posix.0 Request processed in 145us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574226.808184:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 147 00000100:00100000:0.0:1788574226.818490:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574226.819077:0:11893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668985088 00000100:00100000:2.0:1788574226.819093:0:11893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668985088 00000100:00100000:2.0:1788574226.819178:0:11893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 148 00000100:00100000:2.0:1788574226.819225:0:11893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3f26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:659467ff-94af-418e-92fe-11e4323a48aa+5:11081:x1875455668985088:12345-192.168.204.51@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788574226.819390:0:11893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3f26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:659467ff-94af-418e-92fe-11e4323a48aa+5:11081:x1875455668985088:12345-192.168.204.51@tcp:60:lhsmtool_posix.0 Request processed in 201us (919us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574226.819399:0:11893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 148 00000100:00100000:3.0:1788574226.827785:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574226.828366:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668985344 00000100:00100000:0.0:1788574226.828381:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668985344 00000100:00100000:0.0:1788574226.828461:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 35 00000100:00100000:0.0:1788574226.828473:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85d10dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:659467ff-94af-418e-92fe-11e4323a48aa+13:11081:x1875455668985344:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788574226.828815:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85d10dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:659467ff-94af-418e-92fe-11e4323a48aa+14:11081:x1875455668985344:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 Request processed in 343us (1049us total) trans 4294967416 rc 0/0 00000100:00100000:0.0:1788574226.828825:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 35 00010000:00010000:0.0:1788574227.092700:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574227.190970:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574227.191305:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668985472 00000100:00100000:0.0:1788574227.191323:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668985472 00000100:00100000:0.0:1788574227.191432:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 149 00000100:00100000:0.0:1788574227.191450:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85d10ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38a8b838-f1df-4bf7-be24-5141ce328dae+5:11887:x1875455668985472:12345-192.168.204.51@tcp:101:lsof.0 00010000:00010000:0.0:1788574227.191513:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574227.191554:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c8fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d693f expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574227.191638:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c901 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574227.191655:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c901 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574227.191669:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c901 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788574227.191734:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788574227.191739:0:6492:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788574227.191793:0:6492:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c901 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574227.191823:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c8fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d693f expref: 7 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574227.191847:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c901 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d693f expref: 6 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574227.191857:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c84c34f0a00) 00010000:00010000:0.0:1788574227.191861:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788574227.191864:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d20d6600, rc 0) 00000100:00080000:1.0:1788574227.191998:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788574227.192748:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85d10ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38a8b838-f1df-4bf7-be24-5141ce328dae+6:11887:x1875455668985472:12345-192.168.204.51@tcp:101:lsof.0 Request processed in 1300us (1790us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574227.192758:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 149 00010000:00010000:1.0:1788574228.115387:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574229.139964:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574229.140248:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788574229.140272:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3d9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681643648:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788574229.140349:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574229.140553:0:7533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681643648 00000100:00100000:2.0:1788574229.140561:0:7533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681643648 00000100:00100000:2.0:1788574229.140620:0:7533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1788574229.140630:0:7533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3ea5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681643648:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788574229.140673:0:7533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1788574229.140732:0:7533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3ea5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681643648:12345-0@lo:41:osp-pre-0-1.0 Request processed in 104us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574229.140739:0:7533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1788574229.140790:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3d9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681643648:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788574230.163892:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788574230.622719:0:14486:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 22:10:28 (1788574228) 00000100:00100000:2.0:1788574230.675362:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788574230.675386:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c364ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681643776:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788574230.675462:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574230.675541:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681643776 00000100:00100000:2.0:1788574230.675549:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681643776 00000100:00100000:2.0:1788574230.675604:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788574230.675614:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3725c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3620:x1875455681643776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788574230.675647:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1788574230.675692:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3725c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3620:x1875455681643776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574230.675700:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00080000:2.0:1788574230.675722:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788574230.675759:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c364ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681643776:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788574230.675866:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788574230.675875:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3f25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681643904:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788574230.675918:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574230.675953:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681643904 00000100:00100000:0.0:1788574230.675956:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681643904 00000100:00100000:0.0:1788574230.675984:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1788574230.675990:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3f24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681643904:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788574230.675993:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3726a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681644032:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788574230.676026:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574230.676072:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681644032 00000100:00100000:2.0:1788574230.676075:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681644032 00000100:00100000:2.0:1788574230.676116:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788574230.676122:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c364ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681644032:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788574230.676132:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1788574230.676250:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c364ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681644032:12345-0@lo:13:osp-pre-0-1.0 Request processed in 127us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574230.676257:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000004:00000024:0.0:1788574230.676321:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00080000:2.0:1788574230.676371:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788574230.676394:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3726a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681644032:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788574230.676442:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3f24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681643904:12345-0@lo:41:osp-pre-1-0.0 Request processed in 452us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574230.676447:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1788574230.676708:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3f25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681643904:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788574231.120446:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574231.120628:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574231.120661:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574231.120718:0:13791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668985984 00000100:00100000:2.0:1788574231.120743:0:13791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668985984 00000100:00100000:2.0:1788574231.122343:0:13791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 128 00000100:00100000:2.0:1788574231.122361:0:13791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3d98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:659467ff-94af-418e-92fe-11e4323a48aa+6:2394:x1875455668985984:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1788574231.122442:0:13791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3d98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:659467ff-94af-418e-92fe-11e4323a48aa+6:2394:x1875455668985984:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 87us (1813us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574231.122450:0:13791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 128 00000100:00080000:0.0:1788574231.126744:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788574231.126816:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574231.126853:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574231.126859:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668985600 00000100:00100000:0.0:1788574231.126874:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668985600 00000100:00100000:0.0:1788574231.126927:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 392 00000100:00100000:0.0:1788574231.126938:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5675050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+13:2394:x1875455668985600:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1788574231.127027:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5675050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+13:2394:x1875455668985600:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 90us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574231.127035:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 392 00000100:00100000:1.0:1788574231.129279:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668985728 00000100:00100000:1.0:1788574231.129296:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668985728 00000100:00100000:1.0:1788574231.129378:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668986240 00000100:00100000:1.0:1788574231.129382:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668986240 00000100:00100000:1.0:1788574231.129413:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 334 00000100:00100000:1.0:1788574231.129422:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3d9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+14:2394:x1875455668985728:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788574231.129520:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3d9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+14:2394:x1875455668985728:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 99us (9084us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574231.129528:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 334 00000100:00100000:1.0:1788574231.129546:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 335 00000100:00100000:1.0:1788574231.129553:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3d9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38a8b838-f1df-4bf7-be24-5141ce328dae+6:2394:x1875455668986240:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788574231.129579:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3d9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38a8b838-f1df-4bf7-be24-5141ce328dae+6:2394:x1875455668986240:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 27us (8918us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574231.129602:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 335 00000100:00080000:0.0:1788574231.130030:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788574231.132204:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574231.132258:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574231.132323:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668986112 00000100:00100000:1.0:1788574231.132333:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668986112 00000100:00100000:1.0:1788574231.132398:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 129 00000100:00100000:1.0:1788574231.132407:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c335f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:659467ff-94af-418e-92fe-11e4323a48aa+5:2394:x1875455668986112:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788574231.132487:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c335f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:659467ff-94af-418e-92fe-11e4323a48aa+5:2394:x1875455668986112:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 80us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574231.132495:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 129 00000100:00080000:2.0:1788574231.133750:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788574231.135146:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668985856 00000100:00100000:0.0:1788574231.135160:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668985856 00000100:00100000:0.0:1788574231.135251:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668986368 00000100:00100000:0.0:1788574231.135255:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668986368 00000100:00100000:0.0:1788574231.135286:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 336 00000100:00100000:0.0:1788574231.135296:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c335c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+5:2394:x1875455668985856:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1788574231.135367:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c335c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+5:2394:x1875455668985856:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 72us (8512us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574231.135388:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 336 00000100:00100000:0.0:1788574231.135406:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 337 00000100:00100000:0.0:1788574231.135413:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c335ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2394:x1875455668986368:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1788574231.135439:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c335ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2394:x1875455668986368:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 27us (3181us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574231.135444:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 337 00000100:00080000:2.0:1788574231.135721:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1788574231.187561:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788574231.204956:0:6471:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:3.0:1788574231.204985:0:6471:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:0.0:1788574231.205046:0:6524:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1788574231.205065:0:6524:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000001:00080000:2.0:1788574231.207281:0:8404:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000100:00100000:0.0:1788574231.701465:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788574231.701497:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3f24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681644160:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788574231.701611:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574231.701702:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8337100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681644544:0@lo:400:kworker.0 00000100:00100000:0.0:1788574231.701736:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574231.701763:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8335f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69505170-06bc-41d1-9626-ab1a3c7f32a0:3619:1875455681644288:0@lo:400:kworker.0 00000100:00100000:0.0:1788574231.701764:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fa0e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1875455681645056:0@lo:400:kworker.0 00000100:00100000:3.0:1788574231.701813:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574231.701845:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c365b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681644800:0@lo:400:kworker.0 00000100:00100000:3.0:1788574231.701873:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574231.701895:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c26bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681645312:0@lo:400:kworker.0 00000100:00100000:3.0:1788574231.701924:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574231.701939:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681644160 00000100:00100000:1.0:1788574231.701949:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681644160 00000100:00100000:3.0:1788574231.701950:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3ea6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681645824:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788574231.701979:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574231.702003:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788574231.702009:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8337b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875455681644416:0@lo:400:kworker.0 00000100:00100000:1.0:1788574231.702023:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681645824 00000100:00100000:1.0:1788574231.702028:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681645824 00000100:00100000:3.0:1788574231.702043:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574231.702056:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788574231.702068:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3f25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681644160:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788574231.702070:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fa0e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3619:1875455681644928:0@lo:400:kworker.0 00000100:00100000:3.0:1788574231.702102:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:1.0:1788574231.702112:0:14401:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788574231.702140:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c26b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1875455681645440:0@lo:400:kworker.0 00000100:00100000:3.0:1788574231.702178:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574231.702179:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3f25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681644160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574231.702218:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788574231.702242:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788574231.702247:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681644544 00000100:00100000:1.0:1788574231.702250:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffaf6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681645824:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788574231.702254:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681644544 00002000:00000024:1.0:1788574231.702263:0:14401:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788574231.702290:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681644800 00000100:00100000:3.0:1788574231.702294:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681644800 00000100:00100000:1.0:1788574231.702301:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffaf6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681645824:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574231.702310:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788574231.702314:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1788574231.702322:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3f27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681644544:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788574231.702355:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788574231.702367:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3f27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681644544:12345-0@lo:400:kworker.0 Request processed in 44us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574231.702376:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1788574231.702405:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3ea6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681645824:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788574231.702409:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1788574231.702419:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffaf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681644800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574231.702451:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681644416 00000100:00100000:1.0:1788574231.702469:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681644416 00000100:00100000:3.0:1788574231.702474:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffaf5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681644800:12345-0@lo:400:kworker.0 Request processed in 54us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574231.702482:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1788574231.702507:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681644928 00000100:00100000:3.0:1788574231.702511:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681644288 00000100:00100000:1.0:1788574231.702512:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681644928 00000100:00100000:3.0:1788574231.702518:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681644288 00000100:00100000:1.0:1788574231.702544:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681645440 00000100:00100000:1.0:1788574231.702551:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681645440 00000100:00100000:3.0:1788574231.702555:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:3.0:1788574231.702564:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5675c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:3619:x1875455681644288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574231.702577:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:1.0:1788574231.702587:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3da4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875455681644416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574231.702602:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5675c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:3619:x1875455681644288:12345-0@lo:400:kworker.0 Request processed in 38us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574231.702610:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:1.0:1788574231.702631:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3da4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875455681644416:12345-0@lo:400:kworker.0 Request processed in 45us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574231.702640:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:3.0:1788574231.702649:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681645312 00000100:00100000:1.0:1788574231.702658:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:1.0:1788574231.702665:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3da4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875455681644928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574231.702695:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3da4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875455681644928:12345-0@lo:400:kworker.0 Request processed in 31us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574231.702701:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:1.0:1788574231.702712:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:1.0:1788574231.702718:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c37ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875455681645440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574231.702780:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3658380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875455681644672:0@lo:400:kworker.0 00000100:00100000:2.0:1788574231.702816:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574231.702832:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faff0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681645184:0@lo:400:kworker.0 00000100:00100000:2.0:1788574231.702855:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574231.702874:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c2f44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681645696:0@lo:400:kworker.0 00000100:00100000:2.0:1788574231.702895:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574231.702924:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681645184 00000100:00100000:2.0:1788574231.702928:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681645184 00000100:00100000:2.0:1788574231.702957:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681645696 00000100:00100000:2.0:1788574231.702960:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681645696 00000100:00100000:2.0:1788574231.702978:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788574231.702985:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffaffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681645184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574231.703002:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c37ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875455681645440:12345-0@lo:400:kworker.0 Request processed in 282us (825us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574231.703010:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:1.0:1788574231.703025:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681644672 00000100:00100000:2.0:1788574231.703029:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffaffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681645184:12345-0@lo:400:kworker.0 Request processed in 42us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574231.703030:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681644672 00000100:00100000:2.0:1788574231.703040:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788574231.703055:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1788574231.703063:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788574231.703066:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3726a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875455681644672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574231.703075:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffaff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681645696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574231.703121:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3726a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875455681644672:12345-0@lo:400:kworker.0 Request processed in 57us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574231.703128:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1788574231.703135:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffaff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681645696:12345-0@lo:400:kworker.0 Request processed in 62us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574231.703142:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:1.0:1788574231.703156:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788574231.703209:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8337b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875455681644416:0@lo:400:kworker.0 00000100:00100000:2.0:1788574231.703210:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3658380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875455681644672:0@lo:400:kworker.0 00000100:00100000:2.0:1788574231.703227:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faff0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681645184:0@lo:400:kworker.0 00000100:00100000:2.0:1788574231.703235:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c2f44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681645696:0@lo:400:kworker.0 00000100:00100000:0.0:1788574231.703297:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574231.703328:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c2f44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1875455681645568:0@lo:400:kworker.0 00000100:00100000:0.0:1788574231.703354:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574231.703388:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fa0e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3619:1875455681644928:0@lo:400:kworker.0 00000100:00100000:1.0:1788574231.703400:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c26b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1875455681645440:0@lo:400:kworker.0 00000100:00100000:1.0:1788574231.703411:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8335f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69505170-06bc-41d1-9626-ab1a3c7f32a0:3619:1875455681644288:0@lo:400:kworker.0 00000100:00100000:1.0:1788574231.703421:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c365b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681644800:0@lo:400:kworker.0 00000100:00100000:3.0:1788574231.703478:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681645312 00000100:00100000:3.0:1788574231.703636:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788574231.703645:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffaf6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681645312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574231.703749:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffaf6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681645312:12345-0@lo:400:kworker.0 Request processed in 106us (1824us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574231.703755:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788574231.703993:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3f24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681644160:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788574231.704020:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8337100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681644544:0@lo:400:kworker.0 00000100:00100000:0.0:1788574231.704061:0:3619:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:0.0:1788574231.704068:0:3619:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c84c3f24000, transno 4294967313 00000100:00100000:0.0:1788574231.704080:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c26bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681645312:0@lo:400:kworker.0 00000100:00100000:2.0:1788574231.705974:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681645056 00000100:00100000:2.0:1788574231.705995:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681645056 00000100:00100000:2.0:1788574231.706094:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681645568 00000100:00100000:2.0:1788574231.706099:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681645568 00000100:00100000:2.0:1788574231.706143:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:2.0:1788574231.706156:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3f26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875455681645056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574231.706164:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1788574231.706178:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3f26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875455681645568:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788574231.706283:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788574231.706669:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3f26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875455681645568:12345-0@lo:400:kworker.0 Request processed in 495us (3313us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574231.706678:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00010000:00080000:0.0:1788574231.707438:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85c2f44700 x1875455681645568/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574247 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574231.707473:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c2f44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1875455681645568:0@lo:400:kworker.0 00000100:00100000:2.0:1788574231.708110:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3f26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875455681645056:12345-0@lo:400:kworker.0 Request processed in 1954us (4809us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574231.708139:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00010000:00080000:0.0:1788574231.709132:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85fa0e5f80 x1875455681645056/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574247 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574231.709152:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fa0e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1875455681645056:0@lo:400:kworker.0 00000100:00100000:1.0:1788574231.920368:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574231.920504:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668986624 00000100:00100000:0.0:1788574231.920519:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668986624 00000100:00100000:0.0:1788574231.920838:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 150 00000100:00100000:0.0:1788574231.920853:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3ea6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+13:12153:x1875455668986624:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788574231.920884:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574231.920916:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7c00/0x5bf8706fdac8c908 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6946 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574231.921034:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8c90f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574231.921065:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8c90f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574231.921080:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8c90f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574231.921099:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c916 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574231.921106:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c916 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574231.921137:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c916 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574231.921385:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8c91d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574231.921395:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8c91d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574231.921403:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8c91d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788574231.921415:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1788574231.921538:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8c90f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574231.921547:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8c90f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574231.921555:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8c90f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574231.921562:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d7200 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:0.0:1788574231.921567:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8c90f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574231.921575:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8c90f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574231.921605:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9c85c6b83800) 00010000:00010000:0.0:1788574231.921610:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574231.921624:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8c90f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574231.921632:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8c90f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574231.921650:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c916 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574231.921657:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c916 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574231.921662:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c916 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574231.921668:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d7e00 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:0.0:1788574231.921671:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c916 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574231.921677:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c916 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574231.921685:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9c85d07b8800) 00010000:00010000:0.0:1788574231.921688:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574231.921691:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c916 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574231.921697:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c916 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574231.922165:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7c00/0x5bf8706fdac8c908 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6946 expref: 16 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574231.922253:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8c91d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6946 expref: 15 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574231.922262:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c85c90c8800) 00010000:00010000:0.0:1788574231.922265:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574231.922268:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d20d6400, rc 0) 00000100:00100000:0.0:1788574231.922367:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3ea6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+15:12153:x1875455668986624:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 1518us (2014us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1788574231.922377:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 150 00000100:00100000:0.0:1788574231.937311:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574231.937423:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574231.937539:0:7433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668986880 00000100:00100000:2.0:1788574231.937555:0:7433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668986880 00000100:00100000:2.0:1788574231.937659:0:7433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 10 00000100:00100000:2.0:1788574231.937672:0:7433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3f24a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:659467ff-94af-418e-92fe-11e4323a48aa+15:2394:x1875455668986880:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788574231.937699:0:7433:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788574231.937734:0:7433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8c91d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6946 expref: 15 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574231.937758:0:7433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c85c90c8800) 00010000:00010000:2.0:1788574231.937765:0:7433:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788574231.937871:0:7433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3f24a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:659467ff-94af-418e-92fe-11e4323a48aa+14:2394:x1875455668986880:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 202us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574231.937880:0:7433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 10 00000100:00100000:1.0:1788574231.938897:0:11893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668986752 00000100:00100000:1.0:1788574231.938911:0:11893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668986752 00000100:00100000:1.0:1788574231.938975:0:11893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 151 00000100:00100000:1.0:1788574231.938984:0:11893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3f24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:659467ff-94af-418e-92fe-11e4323a48aa+14:12153:x1875455668986752:12345-192.168.204.51@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788574231.939108:0:11893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3f24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:659467ff-94af-418e-92fe-11e4323a48aa+14:12153:x1875455668986752:12345-192.168.204.51@tcp:59:lhsmtool_posix.0 Request processed in 126us (1814us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574231.939116:0:11893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 151 00000100:00100000:0.0:1788574231.948932:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574231.949071:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668987008 00000100:00100000:3.0:1788574231.949088:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668987008 00000100:00100000:3.0:1788574231.949234:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 152 00000100:00100000:3.0:1788574231.949252:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3f25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+5:12153:x1875455668987008:12345-192.168.204.51@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788574231.949424:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3f25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+5:12153:x1875455668987008:12345-192.168.204.51@tcp:59:lhsmtool_posix.0 Request processed in 176us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574231.949432:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 152 00010000:00010000:1.0:1788574232.211592:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788574232.406846:0:13764:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788574232.406861:0:13764:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788574232.407369:0:13764:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1788574232.407384:0:13764:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1788574232.724900:0:13768:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788574233.235838:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788574233.427590:0:13764:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788574233.427603:0:13764:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788574233.427753:0:13764:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:3.0:1788574233.427763:0:13764:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1788574233.747809:0:13768:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788574234.189391:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574234.189703:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668987136 00000100:00100000:0.0:1788574234.189715:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668987136 00000100:00100000:0.0:1788574234.189806:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 153 00000100:00100000:0.0:1788574234.189821:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c37a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+14:12197:x1875455668987136:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:0.0:1788574234.189844:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:3.0:1788574234.189864:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788574234.189873:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7c00/0x5bf8706fdac8c92b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d694d expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.189945:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8c932 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.189962:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8c932 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.189977:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8c932 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.190076:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c939 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.190086:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c939 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.190094:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c939 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.190149:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8c932 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.190156:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8c932 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.190164:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8c932 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.190170:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d6400 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:0.0:1788574234.190175:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8c932 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.190183:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8c932 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.190533:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c84c34f0a00) 00010000:00010000:0.0:1788574234.190608:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574234.190615:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8c932 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.190623:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8c932 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.190645:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c939 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.190651:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c939 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.190657:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c939 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.190662:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d7e00 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:0.0:1788574234.190665:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c939 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.190671:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c939 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.190679:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9c85d07b8800) 00010000:00010000:0.0:1788574234.190682:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574234.190685:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c939 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.190690:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c939 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.190727:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7c00/0x5bf8706fdac8c92b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d694d expref: 15 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.190738:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c84c34f0a00) 00010000:00010000:0.0:1788574234.190740:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574234.190752:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7c00/0x5bf8706fdac8c92b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d694d expref: 15 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.190763:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d20d7c00, rc 0) 00000100:00100000:0.0:1788574234.190841:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c37a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+14:12197:x1875455668987136:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 1025us (1462us total) trans 0 rc 301/301 00000100:00100000:0.0:1788574234.190849:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 153 00000100:00100000:0.0:1788574234.206265:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574234.206481:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668987392 00000100:00100000:2.0:1788574234.206491:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668987392 00000100:00100000:2.0:1788574234.206542:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 154 00000100:00100000:2.0:1788574234.206551:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3f24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+14:12197:x1875455668987392:12345-192.168.204.51@tcp:36:lfs.0 00010000:00010000:2.0:1788574234.206603:0:7439:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788574234.206628:0:7439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8c27f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6771 expref: 14 pid: 11893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574234.206645:0:7439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c84c34f0a00) 00010000:00010000:2.0:1788574234.206650:0:7439:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788574234.206773:0:7439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8c940 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574234.206787:0:7439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c901 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d693f expref: 5 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574234.206796:0:7439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8c940 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574234.206828:0:7439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c901 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d693f expref: 5 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574234.206840:0:7439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c901 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d693f expref: 5 pid: 6492 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574234.206868:0:7439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c2f44700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7439:1875455681645952:192.168.204.51@tcp:104: 00000100:00100000:2.0:1788574234.207096:0:7439:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c53cb6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788574234.211744:0:7439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c2f44700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7439:1875455681645952:192.168.204.51@tcp:104: 00010000:00010000:2.0:1788574234.211781:0:7439:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8c940 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574234.214440:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574234.215172:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668987520 00000100:00100000:1.0:1788574234.215185:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668987520 00010000:00010000:1.0:1788574234.215554:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c901 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d693f expref: 6 pid: 6492 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574234.215634:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 81 00000100:00080000:3.0:1788574234.215642:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788574234.215646:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3f25c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:38a8b838-f1df-4bf7-be24-5141ce328dae+6:2394:x1875455668987520:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788574234.215722:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574234.215731:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c901 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d693f expref: 6 pid: 6492 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574234.215746:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c901 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d693f expref: 6 pid: 6492 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574234.215769:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c901 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d693f expref: 6 pid: 6492 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574234.215786:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c84c34f0a00) 00010000:00010000:1.0:1788574234.215792:0:6477:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8c940 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574234.215803:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8c940 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574234.215811:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8c940 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574234.215849:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788574234.215913:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3f25c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2394:x1875455668987520:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 269us (1482us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574234.215937:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 81 00010000:00010000:0.0:1788574234.216000:0:7439:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8c940 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.216008:0:7439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8c940 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.216032:0:7439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c947 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.216042:0:7439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c947 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.216051:0:7439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c947 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.216635:0:7439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8c94e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.216645:0:7439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8c94e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.216665:0:7439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8c94e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788574234.216695:0:7439:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d4b6eea9 reply state 0000000059b46288 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8c94e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.216707:0:7439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8c94e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.216713:0:7439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c85d07b8d00) 00010000:00010000:0.0:1788574234.216716:0:7439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788574234.216719:0:7439:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788574234.216726:0:7439:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1788574234.216733:0:7439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8c940 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.216740:0:7439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8c940 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.216747:0:7439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8c940 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.216753:0:7439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32e000 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:0.0:1788574234.216757:0:7439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8c940 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.216765:0:7439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8c940 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.216774:0:7439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c84c34f0a00) 00010000:00010000:0.0:1788574234.216776:0:7439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574234.216780:0:7439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8c940 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.216797:0:7439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8c940 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788574234.216814:0:7439:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d4b6eea9 reply state 0000000059b46288 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c947 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.216822:0:7439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c947 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.216828:0:7439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9c85d07b8800) 00010000:00010000:0.0:1788574234.216830:0:7439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788574234.216832:0:7439:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1788574234.216906:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3f24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+15:12197:x1875455668987392:12345-192.168.204.51@tcp:36:lfs.0 Request processed in 10355us (10649us total) trans 4294967418 rc 0/0 00000100:00100000:0.0:1788574234.216914:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 154 00010000:00010000:1.0:1788574234.260306:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574234.262475:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c37a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681646080:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788574234.262549:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574234.263370:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681646080 00000100:00100000:3.0:1788574234.263383:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681646080 00000100:00100000:3.0:1788574234.263465:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1788574234.263476:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2f44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681646080:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788574234.263533:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1788574234.263612:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2f44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681646080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 137us (1062us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574234.263619:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1788574234.264087:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c37a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681646080:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788574234.346150:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574234.346516:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668987648 00000100:00100000:3.0:1788574234.346527:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668987648 00000100:00100000:3.0:1788574234.346632:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 155 00000100:00100000:3.0:1788574234.346644:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa328380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+15:12205:x1875455668987648:12345-192.168.204.51@tcp:101:lctl.0 00010000:00010000:3.0:1788574234.346674:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574234.346700:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8c955 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6954 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574234.346767:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616400/0x5bf8706fdac8c95c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574234.346795:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616400/0x5bf8706fdac8c95c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574234.346806:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616400/0x5bf8706fdac8c95c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788574234.346876:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788574234.346880:0:6494:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788574234.346903:0:6494:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616400/0x5bf8706fdac8c95c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574234.346930:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8c955 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6954 expref: 17 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574234.346948:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616400/0x5bf8706fdac8c95c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6954 expref: 16 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574234.346958:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c85fa28c100) 00010000:00010000:3.0:1788574234.346961:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788574234.346965:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c84c2616400, rc 0) 00000100:00100000:3.0:1788574234.347031:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa328380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+16:12205:x1875455668987648:12345-192.168.204.51@tcp:101:lctl.0 Request processed in 390us (892us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574234.347038:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 155 00000100:00100000:3.0:1788574234.458718:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574234.459279:0:11893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668987776 00000100:00100000:0.0:1788574234.459291:0:11893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668987776 00000100:00100000:0.0:1788574234.459365:0:11893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 156 00000100:00100000:0.0:1788574234.459377:0:11893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c37abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:659467ff-94af-418e-92fe-11e4323a48aa+16:12211:x1875455668987776:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:0.0:1788574234.459400:0:11893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574234.459432:0:11893:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8c963 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d695b expref: -99 pid: 11893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.459501:0:11893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c96a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.459538:0:11893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c96a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.459550:0:11893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c96a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.459564:0:11893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7c00/0x5bf8706fdac8c971 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.459572:0:11893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7c00/0x5bf8706fdac8c971 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.459578:0:11893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7c00/0x5bf8706fdac8c971 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.459664:0:11893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e200/0x5bf8706fdac8c978 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.459671:0:11893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e200/0x5bf8706fdac8c978 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.459678:0:11893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e200/0x5bf8706fdac8c978 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788574234.459714:0:11893:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1788574234.459718:0:11893:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788574234.459737:0:11893:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e200/0x5bf8706fdac8c978 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.459749:0:11893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c96a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.459765:0:11893:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c96a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.459771:0:11893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c96a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.459777:0:11893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d6600 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:0.0:1788574234.459781:0:11893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c96a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.459787:0:11893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c96a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.459802:0:11893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c85fa28c100) 00010000:00010000:0.0:1788574234.459804:0:11893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574234.459809:0:11893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c96a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.459814:0:11893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c96a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.459846:0:11893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7c00/0x5bf8706fdac8c971 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.459852:0:11893:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7c00/0x5bf8706fdac8c971 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.459858:0:11893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7c00/0x5bf8706fdac8c971 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.459870:0:11893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d7c00 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:0.0:1788574234.459879:0:11893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7c00/0x5bf8706fdac8c971 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.459885:0:11893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7c00/0x5bf8706fdac8c971 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.459894:0:11893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9c85d07b8800) 00010000:00010000:0.0:1788574234.459897:0:11893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574234.459900:0:11893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7c00/0x5bf8706fdac8c971 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.459907:0:11893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7c00/0x5bf8706fdac8c971 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.460639:0:11893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8c963 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d695b expref: 18 pid: 11893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.460662:0:11893:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e200/0x5bf8706fdac8c978 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d695b expref: 17 pid: 11893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.460670:0:11893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c85d07b8d00) 00010000:00010000:0.0:1788574234.460672:0:11893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788574234.460675:0:11893:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c860217e200, rc 0) 00000100:00100000:0.0:1788574234.460753:0:11893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c37abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:659467ff-94af-418e-92fe-11e4323a48aa+17:12211:x1875455668987776:12345-192.168.204.51@tcp:101:bash.0 Request processed in 1378us (2044us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574234.460762:0:11893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 156 00000100:00100000:2.0:1788574234.467012:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574234.467784:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668988032 00000100:00100000:0.0:1788574234.467796:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668988032 00000100:00100000:0.0:1788574234.467868:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 157 00000100:00100000:0.0:1788574234.467879:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2f44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+17:12211:x1875455668988032:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:0.0:1788574234.467929:0:7439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574234.467952:0:7439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e800/0x5bf8706fdac8c97f lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6962 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.468070:0:7439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217fa00/0x5bf8706fdac8c986 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.468085:0:7439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217fa00/0x5bf8706fdac8c986 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.468096:0:7439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217fa00/0x5bf8706fdac8c986 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.468132:0:7439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7c00/0x5bf8706fdac8c98d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.468140:0:7439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7c00/0x5bf8706fdac8c98d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.468146:0:7439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7c00/0x5bf8706fdac8c98d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788574234.468494:0:7439:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:0.0:1788574234.468637:0:7439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c994 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.468646:0:7439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c994 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.468654:0:7439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c994 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.468700:0:7439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217fa00/0x5bf8706fdac8c986 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.468707:0:7439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217fa00/0x5bf8706fdac8c986 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.468713:0:7439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217fa00/0x5bf8706fdac8c986 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.468719:0:7439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c860217fa00 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:0.0:1788574234.468723:0:7439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217fa00/0x5bf8706fdac8c986 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.468730:0:7439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217fa00/0x5bf8706fdac8c986 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.468741:0:7439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c85d07b8d00) 00010000:00010000:0.0:1788574234.468744:0:7439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574234.468748:0:7439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217fa00/0x5bf8706fdac8c986 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.468754:0:7439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217fa00/0x5bf8706fdac8c986 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788574234.468766:0:7439:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a9f89ba0 reply state 00000000d5b5d6c9 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7c00/0x5bf8706fdac8c98d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.468776:0:7439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7c00/0x5bf8706fdac8c98d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.468782:0:7439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c85d07b8b00) 00010000:00010000:0.0:1788574234.468789:0:7439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788574234.468792:0:7439:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788574234.468820:0:7439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e800/0x5bf8706fdac8c97f lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6962 expref: 20 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.468834:0:7439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c994 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6962 expref: 19 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.468847:0:7439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c85d07b8000) 00010000:00010000:0.0:1788574234.468849:0:7439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788574234.468851:0:7439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d20d6600, rc 0) 00000100:00100000:0.0:1788574234.468921:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2f44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+20:12211:x1875455668988032:12345-192.168.204.51@tcp:101:bash.0 Request processed in 1044us (1921us total) trans 4294967419 rc 0/0 00000100:00100000:0.0:1788574234.468929:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 157 00000100:00100000:3.0:1788574234.477912:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574234.478015:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668988160 00000100:00100000:2.0:1788574234.478025:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668988160 00000100:00100000:2.0:1788574234.478093:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 55 00000100:00100000:2.0:1788574234.478103:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c37ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:659467ff-94af-418e-92fe-11e4323a48aa+5:2394:x1875455668988160:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:2.0:1788574234.478123:0:8411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574234.478147:0:8411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000caa9a49e/0x5bf8706fdac8c9a2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6969 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788574234.478174:0:8411:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788574234.478229:0:8411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=374s v=(0 0) 00010000:00010000:2.0:1788574234.478235:0:8411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574234.478245:0:8411:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000caa9a49e/0x5bf8706fdac8c9a2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6969 expref: 6 pid: 8411 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574234.478265:0:8411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000caa9a49e/0x5bf8706fdac8c9a2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6969 expref: 6 pid: 8411 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574234.478296:0:8411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85fa32f000, rc 0) 00000100:00100000:2.0:1788574234.478345:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c37ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:659467ff-94af-418e-92fe-11e4323a48aa+6:2394:x1875455668988160:12345-192.168.204.51@tcp:101:bash.0 Request processed in 243us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574234.478352:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 55 00000100:00080000:3.0:1788574234.478657:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788574234.483519:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574234.483686:0:13791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668988288 00000100:00100000:2.0:1788574234.483694:0:13791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668988288 00000100:00100000:2.0:1788574234.483755:0:13791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 56 00000100:00100000:2.0:1788574234.483767:0:13791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c37a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:659467ff-94af-418e-92fe-11e4323a48aa+6:12211:x1875455668988288:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:2.0:1788574234.483787:0:13791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574234.483814:0:13791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003fa0120b/0x5bf8706fdac8c9a9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6970 expref: -99 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574234.483848:0:13791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000caa9a49e/0x5bf8706fdac8c9a2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6969 expref: 7 pid: 8411 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574234.483858:0:13791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574234.483862:0:13791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574234.483868:0:13791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003fa0120b/0x5bf8706fdac8c9a9 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6970 expref: 7 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574234.483903:0:13791:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000caa9a49e/0x5bf8706fdac8c9a2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6969 expref: 7 pid: 8411 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574234.483918:0:13791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000caa9a49e/0x5bf8706fdac8c9a2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6969 expref: 7 pid: 8411 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574234.483947:0:13791:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faff0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13791:1875455681646208:192.168.204.51@tcp:104: 00000100:00100000:2.0:1788574234.484321:0:13791:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c53cb6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788574234.489972:0:13791:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faff0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13791:1875455681646208:192.168.204.51@tcp:104: 00010000:00010000:2.0:1788574234.490014:0:13791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003fa0120b/0x5bf8706fdac8c9a9 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6970 expref: 7 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574234.490037:0:13791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85fa32e000, rc 0) 00000100:00100000:2.0:1788574234.490120:0:13791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c37a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:659467ff-94af-418e-92fe-11e4323a48aa+7:12211:x1875455668988288:12345-192.168.204.51@tcp:101:bash.0 Request processed in 6355us (6611us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574234.490130:0:13791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 56 00000100:00100000:3.0:1788574234.491367:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574234.491454:0:7433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668988416 00000100:00100000:2.0:1788574234.491462:0:7433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668988416 00010000:00010000:2.0:1788574234.491494:0:7433:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000caa9a49e/0x5bf8706fdac8c9a2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6969 expref: 7 pid: 8411 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574234.491536:0:7433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 82 00000100:00100000:2.0:1788574234.491544:0:7433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3769180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:659467ff-94af-418e-92fe-11e4323a48aa+7:2394:x1875455668988416:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788574234.491558:0:7433:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788574234.491578:0:7433:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000caa9a49e/0x5bf8706fdac8c9a2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6969 expref: 7 pid: 8411 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574234.491592:0:7433:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000caa9a49e/0x5bf8706fdac8c9a2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6969 expref: 7 pid: 8411 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574234.491629:0:7433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000caa9a49e/0x5bf8706fdac8c9a2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6969 expref: 7 pid: 8411 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574234.491646:0:7433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574234.491650:0:7433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574234.491658:0:7433:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003fa0120b/0x5bf8706fdac8c9a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6970 expref: 6 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574234.491670:0:7433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003fa0120b/0x5bf8706fdac8c9a9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6970 expref: 6 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574234.491709:0:7433:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003fa0120b/0x5bf8706fdac8c9a9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6970 expref: 6 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574234.491724:0:7433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faff0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7433:1875455681646336:192.168.204.51@tcp:105: 00000100:00100000:2.0:1788574234.491892:0:7433:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c53cb6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788574234.495070:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574234.495214:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668988672 00000100:00100000:1.0:1788574234.495224:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668988672 00000100:00100000:1.0:1788574234.495287:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 36 00000100:00100000:1.0:1788574234.495297:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3768000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:659467ff-94af-418e-92fe-11e4323a48aa+20:12211:x1875455668988672:12345-192.168.204.51@tcp:35:bash.0 00000100:00100000:1.0:1788574234.495597:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3768000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:659467ff-94af-418e-92fe-11e4323a48aa+21:12211:x1875455668988672:12345-192.168.204.51@tcp:35:bash.0 Request processed in 300us (535us total) trans 4294967420 rc 0/0 00000100:00100000:1.0:1788574234.495605:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 36 00000100:00100000:2.0:1788574234.495777:0:7433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faff0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7433:1875455681646336:192.168.204.51@tcp:105: 00010000:00010000:2.0:1788574234.495802:0:7433:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788574234.495824:0:7433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3769180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:659467ff-94af-418e-92fe-11e4323a48aa+6:2394:x1875455668988416:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 4281us (4463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574234.495832:0:7433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 82 00000100:00100000:0.0:1788574234.561922:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574234.562097:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668988928 00000100:00100000:3.0:1788574234.562107:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668988928 00000100:00100000:3.0:1788574234.562239:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 158 00000100:00100000:3.0:1788574234.562260:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+21:12221:x1875455668988928:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:3.0:1788574234.562323:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574234.562344:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8c9b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6977 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788574234.562457:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1788574234.562564:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8c9b0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6977 expref: 23 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574234.562578:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c85fa28c100) 00010000:00010000:3.0:1788574234.562581:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788574234.562586:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8c9b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6977 expref: 23 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574234.562600:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c84c2617400, rc 0) 00000100:00100000:3.0:1788574234.562652:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+22:12221:x1875455668988928:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 405us (740us total) trans 4294967421 rc 301/301 00000100:00100000:3.0:1788574234.562665:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 158 00000100:00100000:3.0:1788574234.567031:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574234.567137:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668989184 00000100:00100000:0.0:1788574234.567148:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668989184 00000100:00100000:0.0:1788574234.567309:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 37 00000100:00100000:0.0:1788574234.567321:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3769c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:659467ff-94af-418e-92fe-11e4323a48aa+22:12221:x1875455668989184:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:0.0:1788574234.567581:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3769c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:659467ff-94af-418e-92fe-11e4323a48aa+23:12221:x1875455668989184:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 263us (628us total) trans 4294967422 rc 0/0 00000100:00100000:0.0:1788574234.567589:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 37 00000100:00100000:0.0:1788574234.687906:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574234.688456:0:11893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668989312 00000100:00100000:1.0:1788574234.688469:0:11893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668989312 00000100:00100000:1.0:1788574234.688568:0:11893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 159 00000100:00100000:1.0:1788574234.688579:0:11893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:659467ff-94af-418e-92fe-11e4323a48aa+23:12227:x1875455668989312:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:1.0:1788574234.688605:0:11893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574234.688627:0:11893:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2c00/0x5bf8706fdac8c9be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d697e expref: -99 pid: 11893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574234.688700:0:11893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c9c5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574234.688716:0:11893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c9c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574234.688728:0:11893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c9c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788574234.688775:0:11893:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1788574234.688793:0:11893:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788574234.688818:0:11893:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c9c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574234.688846:0:11893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2c00/0x5bf8706fdac8c9be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d697e expref: 25 pid: 11893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574234.688864:0:11893:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c9c5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d697e expref: 24 pid: 11893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574234.688873:0:11893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c85d07b8d00) 00010000:00010000:1.0:1788574234.688876:0:11893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788574234.688880:0:11893:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85faea2e00, rc 0) 00000100:00100000:1.0:1788574234.689566:0:11893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:659467ff-94af-418e-92fe-11e4323a48aa+24:12227:x1875455668989312:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 984us (1666us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574234.689576:0:11893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 159 00000100:00100000:3.0:1788574234.699334:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574234.699617:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668989568 00000100:00100000:1.0:1788574234.699628:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668989568 00000100:00100000:1.0:1788574234.699694:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 160 00000100:00100000:1.0:1788574234.699704:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c376b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+24:12227:x1875455668989568:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:1.0:1788574234.699726:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574234.699748:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8c9cc lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6985 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574234.699852:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8c9d3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574234.699867:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8c9d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574234.699895:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8c9d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788574234.699907:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788574234.700031:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8c9cc lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6985 expref: 27 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574234.700051:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8c9d3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6985 expref: 26 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574234.700060:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c85d07b8000) 00010000:00010000:1.0:1788574234.700063:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788574234.700068:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85faea3800, rc 0) 00000100:00100000:1.0:1788574234.700149:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c376b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+26:12227:x1875455668989568:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 445us (1072us total) trans 4294967423 rc 0/0 00000100:00100000:1.0:1788574234.700157:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 160 00000100:00100000:3.0:1788574234.705318:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574234.705468:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668989696 00000100:00100000:1.0:1788574234.705478:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668989696 00000100:00100000:1.0:1788574234.705542:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 11 00000100:00100000:1.0:1788574234.705553:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3769880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:659467ff-94af-418e-92fe-11e4323a48aa+26:2393:x1875455668989696:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788574234.705571:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574234.705596:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8c9d3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6985 expref: 26 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574234.705616:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c85d07b8000) 00010000:00010000:1.0:1788574234.705621:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788574234.705697:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3769880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:659467ff-94af-418e-92fe-11e4323a48aa+25:2393:x1875455668989696:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 145us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574234.705704:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 11 00000100:00100000:0.0:1788574234.717661:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574234.717903:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668989952 00000100:00100000:3.0:1788574234.717914:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668989952 00000100:00100000:3.0:1788574234.717981:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 161 00000100:00100000:3.0:1788574234.718006:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+25:12227:x1875455668989952:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:3.0:1788574234.718034:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574234.718065:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8c9e1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d698c expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574234.718472:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8c9e8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574234.718488:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8c9e8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574234.718500:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8c9e8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788574234.718513:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788574234.718614:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8c9e1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d698c expref: 28 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574234.718631:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8c9e8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d698c expref: 27 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574234.718639:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c85d07b8000) 00010000:00010000:3.0:1788574234.718642:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788574234.718645:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c84c2617400, rc 0) 00000100:00100000:3.0:1788574234.718812:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+27:12227:x1875455668989952:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 807us (1160us total) trans 4294967424 rc 0/0 00000100:00100000:3.0:1788574234.718820:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 161 00000100:00100000:0.0:1788574234.728987:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574234.729076:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668990080 00000100:00100000:3.0:1788574234.729094:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668990080 00000100:00100000:3.0:1788574234.729173:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 57 00000100:00100000:3.0:1788574234.729183:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:659467ff-94af-418e-92fe-11e4323a48aa+6:2396:x1875455668990080:12345-192.168.204.51@tcp:1:lfs.0 00010000:00010000:3.0:1788574234.729265:0:8409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8813cf2/0x5bf8706fdac8c9f6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574234.729287:0:8409:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003fa0120b/0x5bf8706fdac8c9a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6970 expref: 6 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574234.729296:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574234.729300:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788574234.729305:0:8409:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e8813cf2/0x5bf8706fdac8c9f6 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574234.729341:0:8409:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003fa0120b/0x5bf8706fdac8c9a9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6970 expref: 6 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574234.729357:0:8409:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003fa0120b/0x5bf8706fdac8c9a9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6970 expref: 6 pid: 13791 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574234.729372:0:8409:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3768380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8409:1875455681646464:192.168.204.51@tcp:104: 00000100:00100000:3.0:1788574234.729495:0:8409:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c253a300 going to sleep for 11 seconds 00000100:00100000:3.0:1788574234.732426:0:8409:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3768380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8409:1875455681646464:192.168.204.51@tcp:104: 00010000:00010000:3.0:1788574234.732456:0:8409:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e8813cf2/0x5bf8706fdac8c9f6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574234.733875:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574234.734076:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668990208 00000100:00100000:3.0:1788574234.734110:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668990208 00002000:00100000:3.0:1788574234.734161:0:8414:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff9c84c1be3480 x1875455668990208/t0(0) o4->659467ff-94af-418e-92fe-11e4323a48aa@192.168.204.51@tcp:385/0 lens 504/0 e 0 to 0 dl 1788574245 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788574234.734173:0:8414:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c84c1be3480 with x1875455668990208 ext(0->12) 00010000:00010000:3.0:1788574234.734182:0:8414:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003fa0120b/0x5bf8706fdac8c9a9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6970 expref: 7 pid: 13791 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574234.734234:0:8414:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003fa0120b/0x5bf8706fdac8c9a9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6970 expref: 7 pid: 13791 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788574234.734243:0:8414:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9c84c1be3480 00000100:00100000:3.0:1788574234.734315:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 2 00000100:00100000:3.0:1788574234.734324:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:659467ff-94af-418e-92fe-11e4323a48aa+7:2394:x1875455668990208:12345-192.168.204.51@tcp:4:lfs.0 00000100:00100000:3.0:1788574234.735651:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:659467ff-94af-418e-92fe-11e4323a48aa+9:2394:x1875455668990208:12345-192.168.204.51@tcp:4:lfs.0 Request processed in 1322us (1776us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1788574234.735663:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 2 00002000:00100000:3.0:1788574234.735673:0:8414:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff9c84c1be3480 x1875455668990208/t4294967306(0) o4->659467ff-94af-418e-92fe-11e4323a48aa@192.168.204.51@tcp:385/0 lens 504/448 e 0 to 0 dl 1788574245 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788574234.735683:0:8414:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c84c1be3480 with x1875455668990208 ext(0->12) 00010000:00010000:3.0:1788574234.735691:0:8414:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003fa0120b/0x5bf8706fdac8c9a9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6970 expref: 9 pid: 13791 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574234.735706:0:8414:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003fa0120b/0x5bf8706fdac8c9a9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6970 expref: 9 pid: 13791 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788574234.735728:0:8414:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9c84c1be3480 00000100:00100000:0.0:1788574234.742001:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574234.742261:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668990336 00000100:00100000:1.0:1788574234.742273:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668990336 00010000:00010000:1.0:1788574234.742318:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003fa0120b/0x5bf8706fdac8c9a9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6970 expref: 9 pid: 13791 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574234.742366:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 83 00000100:00100000:1.0:1788574234.742376:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:659467ff-94af-418e-92fe-11e4323a48aa+9:2396:x1875455668990336:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788574234.742393:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788574234.742422:0:6479:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788574234.742426:0:6479:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788574233 00002000:00010000:1.0:1788574234.742429:0:6479:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1788574234 00002000:00010000:1.0:1788574234.742431:0:6479:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1788574233 00002000:00010000:1.0:1788574234.742433:0:6479:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1788574234.742439:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003fa0120b/0x5bf8706fdac8c9a9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6970 expref: 9 pid: 13791 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574234.742453:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003fa0120b/0x5bf8706fdac8c9a9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6970 expref: 9 pid: 13791 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574234.742477:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003fa0120b/0x5bf8706fdac8c9a9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6970 expref: 9 pid: 13791 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574234.742494:0:6479:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788574234.742499:0:6479:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788574234.742513:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e8813cf2/0x5bf8706fdac8c9f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574234.742523:0:6479:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e8813cf2/0x5bf8706fdac8c9f6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574234.742557:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788574234.742620:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:659467ff-94af-418e-92fe-11e4323a48aa+8:2396:x1875455668990336:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 245us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574234.742627:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 83 00010000:00010000:3.0:1788574234.742699:0:8409:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e8813cf2/0x5bf8706fdac8c9f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574234.742709:0:8409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e8813cf2/0x5bf8706fdac8c9f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574234.742728:0:8409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8813cf2/0x5bf8706fdac8c9f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574234.742736:0:8409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e8813cf2/0x5bf8706fdac8c9f6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574234.742743:0:8409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e8813cf2/0x5bf8706fdac8c9f6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574234.742749:0:8409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c84c2617000 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:3.0:1788574234.742754:0:8409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8813cf2/0x5bf8706fdac8c9f6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574234.742762:0:8409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8813cf2/0x5bf8706fdac8c9f6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574234.742774:0:8409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e8813cf2/0x5bf8706fdac8c9f6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574234.742795:0:8409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e8813cf2/0x5bf8706fdac8c9f6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574234.742845:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:659467ff-94af-418e-92fe-11e4323a48aa+7:2396:x1875455668990080:12345-192.168.204.51@tcp:1:lfs.0 Request processed in 13663us (13867us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574234.742852:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 57 00000100:00100000:1.0:1788574234.746897:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574234.747184:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668990592 00000100:00100000:3.0:1788574234.747225:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668990592 00000100:00100000:3.0:1788574234.747335:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 38 00000100:00100000:3.0:1788574234.747347:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85d01f7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:659467ff-94af-418e-92fe-11e4323a48aa+27:12227:x1875455668990592:12345-192.168.204.51@tcp:35:lfs.0 00000004:00010000:3.0:1788574234.747441:0:6495:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8c9e8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d698c expref: 27 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788574234.747630:0:6495:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:3.0:1788574234.747665:0:6495:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:3.0:1788574234.748023:0:6495:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:3.0:1788574234.748078:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617200/0x5bf8706fdac8c9fd lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574234.748094:0:6495:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c994 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6962 expref: 31 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574234.748105:0:6495:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617200/0x5bf8706fdac8c9fd lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574234.748140:0:6495:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c994 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6962 expref: 31 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574234.748176:0:6495:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c994 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6962 expref: 31 pid: 7439 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574234.748251:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3768380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6495:1875455681646592:192.168.204.51@tcp:104: 00000100:00100000:3.0:1788574234.748342:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c253a300 going to sleep for 11 seconds 00000100:00100000:3.0:1788574234.758156:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3768380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6495:1875455681646592:192.168.204.51@tcp:104: 00010000:00010000:3.0:1788574234.758225:0:6495:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617200/0x5bf8706fdac8c9fd lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574234.761561:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574234.761658:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668990720 00000100:00100000:2.0:1788574234.761672:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668990720 00010000:00010000:2.0:1788574234.761716:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c994 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6962 expref: 32 pid: 7439 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574234.761775:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 84 00000100:00100000:2.0:1788574234.761786:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c26bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:659467ff-94af-418e-92fe-11e4323a48aa+32:2394:x1875455668990720:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788574234.761803:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788574234.761810:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c994 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6962 expref: 32 pid: 7439 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574234.761825:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c994 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6962 expref: 32 pid: 7439 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574234.761847:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8c994 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6962 expref: 32 pid: 7439 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574234.761863:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c85d07b8000) 00010000:00010000:2.0:1788574234.761869:0:6478:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617200/0x5bf8706fdac8c9fd lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574234.761878:0:6478:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617200/0x5bf8706fdac8c9fd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574234.761896:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617200/0x5bf8706fdac8c9fd lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574234.761928:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788574234.761985:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c26bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:659467ff-94af-418e-92fe-11e4323a48aa+31:2394:x1875455668990720:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 201us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574234.761992:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 84 00010000:00010000:1.0:1788574234.762170:0:6495:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617200/0x5bf8706fdac8c9fd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574234.762178:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617200/0x5bf8706fdac8c9fd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788574234.762331:0:6495:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:1.0:1788574234.762460:0:6495:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:1.0:1788574234.762549:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c26b8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6495:1875455681646720:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788574234.762603:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574234.762626:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c353b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788574234.762691:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681646720 00000100:00100000:0.0:1788574234.762697:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681646720 00000100:00100000:0.0:1788574234.762753:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1788574234.762762:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e57e0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6495:x1875455681646720:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788574234.762849:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e57e0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6495:x1875455681646720:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 88us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574234.762856:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00080000:1.0:1788574234.763176:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788574234.763245:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c26b8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6495:1875455681646720:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788574234.763365:0:6495:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:1.0:1788574234.763432:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c26b8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6495:1875455681646848:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788574234.763515:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574234.763546:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c353b540 going to sleep for 11 seconds 00000100:00100000:2.0:1788574234.763624:0:7533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681646848 00000100:00100000:2.0:1788574234.763635:0:7533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681646848 00000100:00100000:2.0:1788574234.763672:0:7533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1788574234.763679:0:7533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c26b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6495:x1875455681646848:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788574234.763795:0:7533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c26b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6495:x1875455681646848:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 116us (279us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788574234.763802:0:7533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1788574234.763834:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c26b8e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6495:1875455681646848:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788574234.763866:0:6495:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:2.0:1788574234.763895:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617200/0x5bf8706fdac8c9fd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574234.763904:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617200/0x5bf8706fdac8c9fd lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574234.763912:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617200/0x5bf8706fdac8c9fd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574234.763917:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c84c2617200 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:2.0:1788574234.763922:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617200/0x5bf8706fdac8c9fd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574234.763930:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617200/0x5bf8706fdac8c9fd lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574234.763944:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c85d07b8000) 00010000:00010000:2.0:1788574234.763947:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788574234.763953:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617200/0x5bf8706fdac8c9fd lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574234.763959:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617200/0x5bf8706fdac8c9fd lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788574234.764048:0:6495:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788574234.764107:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:2.0:1788574234.764118:0:6495:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 374743927941ns, next at 375743925644ns, rc = 0 00000001:00080000:2.0:1788574234.764124:0:6495:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:2.0:1788574234.764143:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c85d07b8000) 00010000:00010000:2.0:1788574234.764146:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788574234.764152:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8c9e8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d698c expref: 35 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574234.764265:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85d01f7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:659467ff-94af-418e-92fe-11e4323a48aa+34:12227:x1875455668990592:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 16920us (17385us total) trans 4294967433 rc 0/0 00000100:00100000:2.0:1788574234.764274:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 38 00000020:00080000:2.0:1788574234.764278:0:6495:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788574234.772445:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574234.772520:0:11893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668990848 00000100:00100000:0.0:1788574234.772532:0:11893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668990848 00000100:00100000:0.0:1788574234.772592:0:11893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 162 00000100:00100000:0.0:1788574234.772602:0:11893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c26baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:659467ff-94af-418e-92fe-11e4323a48aa+34:12227:x1875455668990848:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:0.0:1788574234.772626:0:11893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574234.772649:0:11893:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8ca04 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6993 expref: -99 pid: 11893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.772707:0:11893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8ca04 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6993 expref: 35 pid: 11893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.772722:0:11893:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8ca04 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6993 expref: 35 pid: 11893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.772741:0:11893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c85d07b8300) 00010000:00010000:0.0:1788574234.772744:0:11893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788574234.772748:0:11893:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d20d7200, rc 0) 00000100:00100000:0.0:1788574234.772808:0:11893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c26baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:659467ff-94af-418e-92fe-11e4323a48aa+35:12227:x1875455668990848:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 208us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574234.772815:0:11893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 162 00000100:00100000:2.0:1788574234.781449:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574234.781547:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668991104 00000100:00100000:0.0:1788574234.781557:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668991104 00000100:00100000:0.0:1788574234.781618:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 39 00000100:00100000:0.0:1788574234.781629:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faff0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:659467ff-94af-418e-92fe-11e4323a48aa+35:12227:x1875455668991104:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:0.0:1788574234.781876:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faff0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:659467ff-94af-418e-92fe-11e4323a48aa+36:12227:x1875455668991104:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 247us (437us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1788574234.781894:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 39 00000100:00100000:2.0:1788574234.895344:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574234.895454:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668991360 00000100:00100000:3.0:1788574234.895464:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668991360 00000100:00100000:3.0:1788574234.895527:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 163 00000100:00100000:3.0:1788574234.895538:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faff2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+36:12237:x1875455668991360:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:3.0:1788574234.895563:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574234.895586:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8ca0b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d699a expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788574234.895691:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1788574234.895794:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8ca0b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d699a expref: 38 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574234.895808:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c85fa28c100) 00010000:00010000:3.0:1788574234.895812:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788574234.895817:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8ca0b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d699a expref: 38 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574234.895850:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c84c2617000, rc 0) 00000100:00100000:3.0:1788574234.895916:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faff2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+37:12237:x1875455668991360:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 379us (581us total) trans 4294967435 rc 301/301 00000100:00100000:3.0:1788574234.895925:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 163 00000100:00100000:3.0:1788574234.902162:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574234.902430:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668991488 00000100:00100000:0.0:1788574234.902441:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668991488 00000100:00100000:0.0:1788574234.902504:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 164 00000100:00100000:0.0:1788574234.902515:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3768380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+37:12237:x1875455668991488:12345-192.168.204.51@tcp:34:lfs.0 00010000:00010000:0.0:1788574234.902593:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8ca19 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.902613:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8ca19 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.902624:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8ca19 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.902635:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e800/0x5bf8706fdac8ca20 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.902643:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e800/0x5bf8706fdac8ca20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.902650:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e800/0x5bf8706fdac8ca20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.902724:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217fa00/0x5bf8706fdac8ca27 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.902749:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217fa00/0x5bf8706fdac8ca27 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.902757:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217fa00/0x5bf8706fdac8ca27 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788574234.902808:0:6494:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217fa00/0x5bf8706fdac8ca27 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.902821:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8ca19 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.902828:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8ca19 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.902835:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8ca19 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.902840:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d6600 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:0.0:1788574234.902845:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8ca19 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.902853:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8ca19 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.902865:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c85d07b8d00) 00010000:00010000:0.0:1788574234.902868:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574234.902873:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8ca19 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.902879:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8ca19 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.902901:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e800/0x5bf8706fdac8ca20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.902908:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e800/0x5bf8706fdac8ca20 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.902914:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e800/0x5bf8706fdac8ca20 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.902919:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c860217e800 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:0.0:1788574234.902922:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e800/0x5bf8706fdac8ca20 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.902929:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e800/0x5bf8706fdac8ca20 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.902937:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c85d07b8b00) 00010000:00010000:0.0:1788574234.902940:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574234.902957:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e800/0x5bf8706fdac8ca20 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.902964:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e800/0x5bf8706fdac8ca20 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.902973:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217fa00/0x5bf8706fdac8ca27 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.902979:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217fa00/0x5bf8706fdac8ca27 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.902985:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217fa00/0x5bf8706fdac8ca27 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.902996:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c860217fa00 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:0.0:1788574234.902999:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217fa00/0x5bf8706fdac8ca27 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.903006:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217fa00/0x5bf8706fdac8ca27 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.903015:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c85d07b8300) 00010000:00010000:0.0:1788574234.903017:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574234.903020:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217fa00/0x5bf8706fdac8ca27 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.903026:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217fa00/0x5bf8706fdac8ca27 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574234.903109:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3768380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+37:12237:x1875455668991488:12345-192.168.204.51@tcp:34:lfs.0 Request processed in 595us (957us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574234.903117:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 164 00000100:00100000:2.0:1788574234.906294:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574234.906515:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668991744 00000100:00100000:0.0:1788574234.906524:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668991744 00000100:00100000:0.0:1788574234.906580:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 40 00000100:00100000:0.0:1788574234.906591:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faff1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:659467ff-94af-418e-92fe-11e4323a48aa+37:12237:x1875455668991744:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:0.0:1788574234.906854:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faff1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:659467ff-94af-418e-92fe-11e4323a48aa+38:12237:x1875455668991744:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 264us (570us total) trans 4294967436 rc 0/0 00000100:00100000:0.0:1788574234.906863:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 40 00000100:00100000:2.0:1788574234.983596:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574234.983708:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668992000 00000100:00100000:1.0:1788574234.983719:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668992000 00000100:00100000:1.0:1788574234.983776:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 165 00000100:00100000:1.0:1788574234.983786:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faff1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+38:12240:x1875455668992000:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:1.0:1788574234.983808:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574234.983840:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2c00/0x5bf8706fdac8ca2e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d69a1 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574234.983931:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8ca35 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574234.984141:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8ca35 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574234.984157:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8ca35 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574234.984169:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8ca3c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574234.984176:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8ca3c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574234.984183:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8ca3c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574234.984333:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8ca43 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574234.984342:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8ca43 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574234.984364:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8ca43 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788574234.984375:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788574234.984468:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8ca35 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574234.984476:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8ca35 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574234.984483:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8ca35 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574234.984489:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85faea2600 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:1.0:1788574234.984493:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8ca35 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574234.984501:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8ca35 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574234.984513:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c85d07b8d00) 00010000:00010000:1.0:1788574234.984516:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788574234.984520:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8ca35 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574234.984526:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8ca35 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574234.984539:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8ca3c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574234.984544:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8ca3c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574234.984557:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8ca3c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574234.984561:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85faea3800 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:1.0:1788574234.984564:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8ca3c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574234.984570:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8ca3c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574234.984578:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c85d07b8b00) 00010000:00010000:1.0:1788574234.984580:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788574234.984582:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8ca3c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574234.984587:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8ca3c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574234.984624:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2c00/0x5bf8706fdac8ca2e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d69a1 expref: 41 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574234.984636:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8ca43 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d69a1 expref: 40 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574234.984644:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c85d07b8300) 00010000:00010000:1.0:1788574234.984646:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788574234.984649:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85faea3e00, rc 0) 00000100:00100000:1.0:1788574234.984716:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faff1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+40:12240:x1875455668992000:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 932us (1132us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1788574234.984731:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 165 00000100:00100000:3.0:1788574234.992260:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574234.992775:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668992128 00000100:00100000:0.0:1788574234.992790:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668992128 00000100:00100000:0.0:1788574234.992871:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 166 00000100:00100000:0.0:1788574234.992901:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3768000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+40:12240:x1875455668992128:12345-192.168.204.51@tcp:54:lfs.0 00010000:00010000:0.0:1788574234.993001:0:7439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217fa00/0x5bf8706fdac8ca51 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.993022:0:7439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217fa00/0x5bf8706fdac8ca51 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.993215:0:7439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217fa00/0x5bf8706fdac8ca51 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.993259:0:7439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217fa00/0x5bf8706fdac8ca51 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.993267:0:7439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217fa00/0x5bf8706fdac8ca51 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.993273:0:7439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217fa00/0x5bf8706fdac8ca51 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.993278:0:7439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c860217fa00 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:0.0:1788574234.993282:0:7439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217fa00/0x5bf8706fdac8ca51 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.993289:0:7439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217fa00/0x5bf8706fdac8ca51 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.993301:0:7439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c85d07b8300) 00010000:00010000:0.0:1788574234.993304:0:7439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788574234.993310:0:7439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217fa00/0x5bf8706fdac8ca51 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574234.993329:0:7439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217fa00/0x5bf8706fdac8ca51 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574234.993450:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3768000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+40:12240:x1875455668992128:12345-192.168.204.51@tcp:54:lfs.0 Request processed in 550us (1205us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574234.993459:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 166 00000100:00100000:2.0:1788574234.999105:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574234.999219:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668992384 00000100:00100000:0.0:1788574234.999230:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668992384 00000100:00100000:0.0:1788574234.999292:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 41 00000100:00100000:0.0:1788574234.999303:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faff2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:659467ff-94af-418e-92fe-11e4323a48aa+40:12240:x1875455668992384:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:0.0:1788574234.999562:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faff2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:659467ff-94af-418e-92fe-11e4323a48aa+41:12240:x1875455668992384:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 259us (466us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1788574234.999570:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 41 00010000:00010000:1.0:1788574235.283414:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574235.467443:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574235.467594:0:11893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668992640 00000100:00100000:1.0:1788574235.467605:0:11893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668992640 00000100:00100000:1.0:1788574235.467670:0:11893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 167 00000100:00100000:1.0:1788574235.467681:0:11893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faff1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:659467ff-94af-418e-92fe-11e4323a48aa+41:12271:x1875455668992640:12345-192.168.204.51@tcp:101:cat.0 00010000:00010000:1.0:1788574235.467708:0:11893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574235.467728:0:11893:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2c00/0x5bf8706fdac8ca58 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d69a8 expref: -99 pid: 11893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574235.467854:0:11893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8ca5f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574235.467872:0:11893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8ca5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574235.467886:0:11893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8ca5f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788574235.467898:0:11893:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788574235.468030:0:11893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2c00/0x5bf8706fdac8ca58 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d69a8 expref: 44 pid: 11893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574235.468051:0:11893:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8ca5f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d69a8 expref: 43 pid: 11893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574235.468060:0:11893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c85d07b8300) 00010000:00010000:1.0:1788574235.468063:0:11893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788574235.468082:0:11893:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85faea3800, rc 0) 00000100:00100000:1.0:1788574235.468155:0:11893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faff1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:659467ff-94af-418e-92fe-11e4323a48aa+43:12271:x1875455668992640:12345-192.168.204.51@tcp:101:cat.0 Request processed in 475us (724us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1788574235.468509:0:11893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 167 00000100:00100000:3.0:1788574235.481031:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574235.481228:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668993024 00000100:00100000:0.0:1788574235.481238:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668993024 00000100:00100000:0.0:1788574235.481310:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 42 00000100:00100000:0.0:1788574235.481322:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3769c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:659467ff-94af-418e-92fe-11e4323a48aa+43:12271:x1875455668993024:12345-192.168.204.51@tcp:35:cat.0 00000100:00100000:0.0:1788574235.481605:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3769c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:659467ff-94af-418e-92fe-11e4323a48aa+44:12271:x1875455668993024:12345-192.168.204.51@tcp:35:cat.0 Request processed in 284us (584us total) trans 4294967440 rc 0/0 00000100:00100000:0.0:1788574235.481613:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 42 00000100:00100000:2.0:1788574235.482889:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574235.482971:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668992768 00000100:00100000:1.0:1788574235.482979:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668992768 00000100:00100000:1.0:1788574235.483030:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 12 00000100:00100000:1.0:1788574235.483038:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e0bdd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:659467ff-94af-418e-92fe-11e4323a48aa+44:2393:x1875455668992768:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788574235.483054:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574235.483078:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8ca5f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d69a8 expref: 44 pid: 11893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574235.483097:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c85d07b8300) 00010000:00010000:1.0:1788574235.483102:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788574235.483152:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e0bdd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:659467ff-94af-418e-92fe-11e4323a48aa+43:2393:x1875455668992768:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 113us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574235.483158:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 12 00000100:00100000:1.0:1788574235.599421:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574235.599698:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668993280 00000100:00100000:0.0:1788574235.599710:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668993280 00000100:00100000:0.0:1788574235.599778:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 168 00000100:00100000:0.0:1788574235.599789:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c26bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+43:12277:x1875455668993280:12345-192.168.204.51@tcp:101:dd.0 00010000:00010000:0.0:1788574235.599816:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574235.599820:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788574235.599862:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8c9c5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d697e expref: 43 pid: 11893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574235.599907:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c85d07b8d00) 00010000:00010000:0.0:1788574235.599912:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788574235.599931:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217fa00/0x5bf8706fdac8ca6d lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d69af expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574235.600053:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e800/0x5bf8706fdac8ca74 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574235.600067:0:6492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8ca43 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d69a1 expref: 43 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574235.600075:0:6492:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e800/0x5bf8706fdac8ca74 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574235.600107:0:6492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8ca43 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d69a1 expref: 43 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574235.600120:0:6492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8ca43 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d69a1 expref: 43 pid: 6492 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574235.600132:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6492:1875455681646976:192.168.204.51@tcp:104: 00000100:00100000:0.0:1788574235.600576:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85fafee6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788574235.603778:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574235.603884:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6492:1875455681646976:192.168.204.51@tcp:104: 00010000:00010000:1.0:1788574235.603915:0:6492:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e800/0x5bf8706fdac8ca74 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574235.604003:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668993408 00000100:00100000:2.0:1788574235.604010:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668993408 00010000:00010000:2.0:1788574235.604045:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8ca43 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d69a1 expref: 44 pid: 6492 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574235.604094:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 85 00000100:00100000:2.0:1788574235.604103:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3769180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:659467ff-94af-418e-92fe-11e4323a48aa+44:2393:x1875455668993408:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788574235.604135:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788574235.604143:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8ca43 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d69a1 expref: 44 pid: 6492 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574235.604153:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8ca43 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d69a1 expref: 44 pid: 6492 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574235.604186:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8ca43 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d69a1 expref: 44 pid: 6492 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574235.604243:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c85d07b8300) 00010000:00010000:2.0:1788574235.604248:0:6478:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e800/0x5bf8706fdac8ca74 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574235.604257:0:6478:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e800/0x5bf8706fdac8ca74 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574235.604264:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e800/0x5bf8706fdac8ca74 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574235.604285:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788574235.604344:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3769180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:659467ff-94af-418e-92fe-11e4323a48aa+43:2393:x1875455668993408:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 241us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574235.604352:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 85 00010000:00010000:1.0:1788574235.604711:0:6492:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e800/0x5bf8706fdac8ca74 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574235.604718:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e800/0x5bf8706fdac8ca74 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788574235.604745:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788574235.604886:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217fa00/0x5bf8706fdac8ca6d lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d69af expref: 44 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574235.604903:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e800/0x5bf8706fdac8ca74 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d69af expref: 43 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574235.604910:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c85d07b8300) 00010000:00010000:1.0:1788574235.604913:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788574235.604915:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c860217e800, rc 0) 00000100:00100000:1.0:1788574235.604960:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c26bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+43:12277:x1875455668993280:12345-192.168.204.51@tcp:101:dd.0 Request processed in 5173us (5551us total) trans 4294967441 rc 0/0 00000100:00100000:1.0:1788574235.604967:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 168 00000100:00100000:3.0:1788574235.612162:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574235.612502:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668993536 00000100:00100000:0.0:1788574235.612517:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668993536 00000100:00100000:0.0:1788574235.612583:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 169 00000100:00100000:0.0:1788574235.612596:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3769880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+43:12277:x1875455668993536:12345-192.168.204.51@tcp:101:dd.0 00010000:00010000:0.0:1788574235.612627:0:7439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574235.612684:0:7439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8ca82 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d69b6 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574235.612725:0:7439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152e600/0x5bf8706fdac8ca89 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574235.612744:0:7439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152e600/0x5bf8706fdac8ca89 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574235.612759:0:7439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152e600/0x5bf8706fdac8ca89 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574235.613746:0:7439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8ca82 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d69b6 expref: 45 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574235.613781:0:7439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152e600/0x5bf8706fdac8ca89 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d69b6 expref: 44 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574235.613791:0:7439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c85d07b8300) 00010000:00010000:0.0:1788574235.613795:0:7439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788574235.613798:0:7439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85c152e600, rc 0) 00000100:00100000:0.0:1788574235.613872:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3769880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+44:12277:x1875455668993536:12345-192.168.204.51@tcp:101:dd.0 Request processed in 1273us (1716us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574235.613881:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 169 00000100:00100000:2.0:1788574235.620041:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574235.620405:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668993792 00000100:00100000:3.0:1788574235.620418:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668993792 00000100:00100000:3.0:1788574235.620480:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 170 00000100:00100000:3.0:1788574235.620491:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c365b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+44:12277:x1875455668993792:12345-192.168.204.51@tcp:36:dd.0 00010000:00010000:3.0:1788574235.620919:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8ca90 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574235.620948:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8ca90 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574235.620960:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8ca90 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788574235.621011:0:6493:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:3.0:1788574235.621035:0:6493:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009072ee5e reply state 00000000c0457465 transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8ca90 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574235.621048:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8ca90 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574235.621073:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c85d07b8300) 00010000:00010000:3.0:1788574235.621077:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788574235.621081:0:6493:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788574235.621430:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c365b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+47:12277:x1875455668993792:12345-192.168.204.51@tcp:36:dd.0 Request processed in 939us (1399us total) trans 4294967443 rc 0/0 00000100:00100000:3.0:1788574235.621439:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 170 00000020:00080000:3.0:1788574235.621445:0:6493:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788574235.795579:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788574235.795601:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c365b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681647104:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788574235.795875:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574235.796015:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681647104 00000100:00100000:1.0:1788574235.796031:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681647104 00000100:00100000:1.0:1788574235.796112:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788574235.796124:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3658380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681647104:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788574235.796175:0:14401:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788574235.796268:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3658380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681647104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 148us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574235.796276:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00080000:2.0:1788574235.796627:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788574235.796656:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c2335500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681647232:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788574235.796694:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574235.796772:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c365b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681647104:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788574235.797037:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681647232 00000100:00100000:3.0:1788574235.797043:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681647232 00000100:00100000:3.0:1788574235.797094:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788574235.797102:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3595500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681647232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788574235.797117:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788574235.797171:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3595500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681647232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574235.797177:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788574235.797236:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c2335500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681647232:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788574235.798743:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681647360:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788574235.798826:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574235.798894:0:7533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681647360 00000100:00100000:1.0:1788574235.798901:0:7533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681647360 00000100:00100000:1.0:1788574235.798944:0:7533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1788574235.798967:0:7533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c26b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681647360:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788574235.798997:0:7533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788574235.799054:0:7533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c26b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681647360:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574235.799060:0:7533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1788574235.799098:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681647360:0@lo:41:osp-pre-1-0.0 00000100:00080000:2.0:1788574235.799734:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788574236.133006:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574236.133134:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668993920 00000100:00100000:0.0:1788574236.133161:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668993920 00000100:00080000:2.0:1788574236.133293:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788574236.133293:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 171 00000100:00100000:0.0:1788574236.133310:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c2335500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+47:12291:x1875455668993920:12345-192.168.204.51@tcp:101:stat.0 00010000:00010000:0.0:1788574236.133337:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574236.133382:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8ca97 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d69bd expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574236.133465:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f600/0x5bf8706fdac8ca9e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574236.133480:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f600/0x5bf8706fdac8ca9e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574236.133493:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f600/0x5bf8706fdac8ca9e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574236.133503:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152e000/0x5bf8706fdac8caa5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574236.133511:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152e000/0x5bf8706fdac8caa5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574236.133517:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152e000/0x5bf8706fdac8caa5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574236.133589:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152ee00/0x5bf8706fdac8caac lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574236.133600:0:6492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e800/0x5bf8706fdac8ca74 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d69af expref: 48 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574236.133609:0:6492:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152ee00/0x5bf8706fdac8caac lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574236.133656:0:6492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e800/0x5bf8706fdac8ca74 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d69af expref: 48 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574236.133682:0:6492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e800/0x5bf8706fdac8ca74 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d69af expref: 48 pid: 6492 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574236.133696:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be3100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6492:1875455681647488:192.168.204.51@tcp:104: 00000100:00100000:0.0:1788574236.133814:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85fafee480 going to sleep for 11 seconds 00000100:00100000:0.0:1788574236.136878:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574236.137140:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be3100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6492:1875455681647488:192.168.204.51@tcp:104: 00010000:00010000:1.0:1788574236.137179:0:6492:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152ee00/0x5bf8706fdac8caac lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574236.140334:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668994176 00000100:00100000:2.0:1788574236.140355:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668994176 00000100:00100000:2.0:1788574236.140477:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 43 00000100:00100000:2.0:1788574236.140490:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:659467ff-94af-418e-92fe-11e4323a48aa+49:6161:x1875455668994176:12345-192.168.204.51@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788574236.142694:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:659467ff-94af-418e-92fe-11e4323a48aa+50:6161:x1875455668994176:12345-192.168.204.51@tcp:35:ldlm_bl.0 Request processed in 2192us (5815us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1788574236.142712:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 43 00000100:00100000:3.0:1788574236.146275:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574236.146880:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668994304 00000100:00100000:1.0:1788574236.146895:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668994304 00010000:00010000:1.0:1788574236.147086:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e800/0x5bf8706fdac8ca74 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d69af expref: 50 pid: 6492 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574236.147141:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 86 00000100:00100000:1.0:1788574236.147153:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c2335880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:659467ff-94af-418e-92fe-11e4323a48aa+50:2393:x1875455668994304:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788574236.147173:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574236.147181:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e800/0x5bf8706fdac8ca74 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d69af expref: 50 pid: 6492 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574236.147225:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e800/0x5bf8706fdac8ca74 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d69af expref: 50 pid: 6492 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574236.147257:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e800/0x5bf8706fdac8ca74 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d69af expref: 50 pid: 6492 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574236.147306:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c85d07b8300) 00010000:00010000:1.0:1788574236.147312:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152ee00/0x5bf8706fdac8caac lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574236.147323:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152ee00/0x5bf8706fdac8caac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574236.147333:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152ee00/0x5bf8706fdac8caac lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574236.147387:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788574236.147472:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c2335880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:659467ff-94af-418e-92fe-11e4323a48aa+49:2393:x1875455668994304:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 320us (1211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574236.147480:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 86 00010000:00010000:0.0:1788574236.147773:0:6492:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152ee00/0x5bf8706fdac8caac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574236.147783:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152ee00/0x5bf8706fdac8caac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788574236.147989:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788574236.147996:0:6492:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788574236.148033:0:6492:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152ee00/0x5bf8706fdac8caac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574236.148116:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152ee00/0x5bf8706fdac8caac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574236.148127:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f600/0x5bf8706fdac8ca9e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574236.148135:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f600/0x5bf8706fdac8ca9e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574236.148142:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f600/0x5bf8706fdac8ca9e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574236.148149:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85c152f600 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:0.0:1788574236.148164:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f600/0x5bf8706fdac8ca9e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574236.148174:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f600/0x5bf8706fdac8ca9e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574236.148186:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c85d07b8d00) 00010000:00010000:0.0:1788574236.148282:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574236.148287:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f600/0x5bf8706fdac8ca9e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574236.148294:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f600/0x5bf8706fdac8ca9e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574236.148308:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152e000/0x5bf8706fdac8caa5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574236.148314:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152e000/0x5bf8706fdac8caa5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574236.148320:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152e000/0x5bf8706fdac8caa5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574236.148325:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85c152e000 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:0.0:1788574236.148328:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152e000/0x5bf8706fdac8caa5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574236.148334:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152e000/0x5bf8706fdac8caa5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574236.148343:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c85d07b8b00) 00010000:00010000:0.0:1788574236.148345:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574236.148355:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152e000/0x5bf8706fdac8caa5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574236.148361:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152e000/0x5bf8706fdac8caa5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574236.148417:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8ca97 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d69bd expref: 49 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574236.148435:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152ee00/0x5bf8706fdac8caac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d69bd expref: 48 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574236.148442:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c85d07b8300) 00010000:00010000:0.0:1788574236.148445:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788574236.148448:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85c152ee00, rc 0) 00000100:00100000:0.0:1788574236.151097:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c2335500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+48:12291:x1875455668993920:12345-192.168.204.51@tcp:101:stat.0 Request processed in 15195us (15646us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574236.151119:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 171 00000100:00100000:3.0:1788574236.234252:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574236.234299:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574236.234417:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574236.234470:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574236.234506:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668994944 00000100:00100000:3.0:1788574236.234519:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668994944 00000100:00100000:1.0:1788574236.234591:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668994560 00000100:00100000:1.0:1788574236.234597:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668994560 00000100:00100000:1.0:1788574236.234675:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 344 00000100:00100000:1.0:1788574236.234687:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85d10dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+5:2394:x1875455668994560:12345-192.168.204.51@tcp:400:kworker.0 00000100:00080000:3.0:1788574236.234702:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788574236.234709:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788574236.234799:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85d10dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+5:2394:x1875455668994560:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 114us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574236.234808:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 344 00000100:00100000:0.0:1788574236.235716:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668994432 00000100:00100000:0.0:1788574236.235729:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668994432 00000100:00100000:2.0:1788574236.237419:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668994688 00000100:00100000:2.0:1788574236.237440:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668994688 00000100:00100000:3.0:1788574236.240176:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574236.240504:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574236.240551:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574236.240592:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668994816 00000100:00100000:3.0:1788574236.240605:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668994816 00000100:00100000:1.0:1788574236.242398:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668995072 00000100:00100000:1.0:1788574236.242416:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668995072 00000100:00100000:3.0:1788574236.244589:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 133 00000100:00100000:3.0:1788574236.244608:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3d9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:659467ff-94af-418e-92fe-11e4323a48aa+7:2394:x1875455668994816:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788574236.244620:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668995328 00000100:00100000:1.0:1788574236.244704:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668995328 00000100:00100000:3.0:1788574236.244723:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3d9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:659467ff-94af-418e-92fe-11e4323a48aa+7:2394:x1875455668994816:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 119us (4561us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574236.244732:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 133 00000100:00100000:1.0:1788574236.244747:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 345 00000100:00100000:1.0:1788574236.244755:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85d10dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2394:x1875455668994944:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788574236.244822:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85d10dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2394:x1875455668994944:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 67us (10405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574236.244830:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 345 00000100:00100000:1.0:1788574236.244850:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 172 00000100:00100000:1.0:1788574236.244857:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85d10d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+48:12297:x1875455668995328:12345-192.168.204.51@tcp:36:truncate.0 00010000:00010000:1.0:1788574236.244931:0:7439:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788574236.245497:0:8815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 134 00000100:00100000:2.0:1788574236.245510:0:8815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85d10dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:659467ff-94af-418e-92fe-11e4323a48aa+6:2394:x1875455668994688:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1788574236.245555:0:8815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85d10dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:659467ff-94af-418e-92fe-11e4323a48aa+6:2394:x1875455668994688:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 49us (11256us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574236.245562:0:8815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 134 00000100:00080000:2.0:1788574236.245619:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788574236.245627:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788574236.245630:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788574236.245820:0:7439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152ee00/0x5bf8706fdac8caac lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d69bd expref: 48 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574236.245848:0:7439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c85d07b8300) 00010000:00010000:1.0:1788574236.245856:0:7439:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574236.247126:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 394 00000100:00100000:0.0:1788574236.247153:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5675450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+13:2394:x1875455668994432:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1788574236.247261:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5675450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+13:2394:x1875455668994432:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 121us (13077us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574236.247270:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 394 00000100:00100000:1.0:1788574236.251467:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 346 00000100:00100000:1.0:1788574236.251505:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3d98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2394:x1875455668995072:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788574236.251627:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3d98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2394:x1875455668995072:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 144us (11122us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574236.251648:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 346 00010000:00010000:0.0:1788574236.253540:0:7439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8cab3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574236.253575:0:7439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8cab3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574236.253614:0:7439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8cab3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788574236.253710:0:7439:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:0.0:1788574236.253743:0:7439:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000248199f6 reply state 00000000204c1663 transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8cab3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574236.253760:0:7439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8cab3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574236.253769:0:7439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c85d07b8300) 00010000:00010000:0.0:1788574236.253772:0:7439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788574236.253777:0:7439:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788574236.253954:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85d10d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+50:12297:x1875455668995328:12345-192.168.204.51@tcp:36:truncate.0 Request processed in 9090us (13395us total) trans 4294967446 rc 0/0 00000100:00100000:0.0:1788574236.253965:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 172 00000020:00080000:0.0:1788574236.253972:0:7439:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788574236.311512:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574236.571322:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574236.572068:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668995456 00000100:00100000:2.0:1788574236.572084:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668995456 00000100:00100000:2.0:1788574236.572177:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 173 00000100:00100000:2.0:1788574236.572212:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c37a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+50:12311:x1875455668995456:12345-192.168.204.51@tcp:101:stat.0 00010000:00010000:2.0:1788574236.572275:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574236.572306:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ec00/0x5bf8706fdac8caba lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d69c4 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574236.572420:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fa00/0x5bf8706fdac8cac1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574236.572441:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fa00/0x5bf8706fdac8cac1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574236.572454:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fa00/0x5bf8706fdac8cac1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574236.572466:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ee00/0x5bf8706fdac8cac8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574236.572474:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ee00/0x5bf8706fdac8cac8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574236.572481:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ee00/0x5bf8706fdac8cac8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574236.572596:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8cacf lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574236.572608:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8cacf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574236.572615:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8cacf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788574236.572691:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1788574236.572704:0:6493:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788574236.572736:0:6493:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8cacf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574236.572754:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8cacf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574236.572765:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fa00/0x5bf8706fdac8cac1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574236.572773:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fa00/0x5bf8706fdac8cac1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574236.572782:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fa00/0x5bf8706fdac8cac1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574236.572788:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32fa00 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:2.0:1788574236.572793:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fa00/0x5bf8706fdac8cac1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574236.572803:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fa00/0x5bf8706fdac8cac1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574236.572818:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c85d07b8d00) 00010000:00010000:2.0:1788574236.572822:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788574236.572828:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fa00/0x5bf8706fdac8cac1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574236.572835:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fa00/0x5bf8706fdac8cac1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574236.572862:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ee00/0x5bf8706fdac8cac8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574236.572880:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ee00/0x5bf8706fdac8cac8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574236.572887:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ee00/0x5bf8706fdac8cac8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574236.572892:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32ee00 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:2.0:1788574236.572896:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ee00/0x5bf8706fdac8cac8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574236.572902:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ee00/0x5bf8706fdac8cac8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574236.573273:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c85d07b8b00) 00010000:00010000:2.0:1788574236.573278:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788574236.573283:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ee00/0x5bf8706fdac8cac8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574236.573290:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ee00/0x5bf8706fdac8cac8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574236.573334:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ec00/0x5bf8706fdac8caba lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d69c4 expref: 52 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574236.573351:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8cacf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d69c4 expref: 51 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574236.573359:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c85d07b8300) 00010000:00010000:2.0:1788574236.573374:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788574236.573385:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85fa32fe00, rc 0) 00000100:00100000:2.0:1788574236.573487:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c37a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+51:12311:x1875455668995456:12345-192.168.204.51@tcp:101:stat.0 Request processed in 1298us (2183us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574236.573497:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 173 00000100:00100000:2.0:1788574236.702866:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574236.702988:0:11893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668995712 00000100:00100000:3.0:1788574236.703001:0:11893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668995712 00000100:00100000:3.0:1788574236.703154:0:11893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 174 00000100:00100000:3.0:1788574236.703170:0:11893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3594700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:659467ff-94af-418e-92fe-11e4323a48aa+51:12321:x1875455668995712:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:3.0:1788574236.703523:0:11893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574236.703556:0:11893:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616000/0x5bf8706fdac8cad6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d69cb expref: -99 pid: 11893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788574236.703803:0:11893:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1788574236.704018:0:11893:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616000/0x5bf8706fdac8cad6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d69cb expref: 53 pid: 11893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.704327:0:11893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c85fa28c100) 00010000:00010000:3.0:1788574236.704332:0:11893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788574236.704338:0:11893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616000/0x5bf8706fdac8cad6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d69cb expref: 53 pid: 11893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.704455:0:11893:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c84c2616000, rc 0) 00000100:00100000:3.0:1788574236.704606:0:11893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3594700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:659467ff-94af-418e-92fe-11e4323a48aa+52:12321:x1875455668995712:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 1438us (1756us total) trans 4294967447 rc 301/301 00000100:00100000:3.0:1788574236.704616:0:11893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 174 00000001:00080000:1.0:1788574236.710615:0:6471:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967447 is committed 00010000:00010000:3.0:1788574236.710789:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c947 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.710814:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c947 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.710823:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c947 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.710830:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d7e00 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:3.0:1788574236.710836:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c947 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.710845:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c947 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.710869:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9c85d07b8800) 00010000:00010000:3.0:1788574236.710873:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574236.710879:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c947 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.710887:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8c947 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.710916:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8c94e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.710957:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8c94e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.710963:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8c94e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.710969:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d6400 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:3.0:1788574236.710972:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8c94e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.710978:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8c94e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.710989:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c85d07b8d00) 00010000:00010000:3.0:1788574236.710991:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574236.710995:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8c94e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.711001:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8c94e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.711023:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7c00/0x5bf8706fdac8c98d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.711030:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7c00/0x5bf8706fdac8c98d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.711037:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7c00/0x5bf8706fdac8c98d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.711042:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d7c00 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:3.0:1788574236.711051:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7c00/0x5bf8706fdac8c98d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.711058:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7c00/0x5bf8706fdac8c98d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.711067:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c85d07b8b00) 00010000:00010000:3.0:1788574236.711069:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574236.711072:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7c00/0x5bf8706fdac8c98d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.711077:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7c00/0x5bf8706fdac8c98d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.711094:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8ca90 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.711100:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8ca90 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.711107:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8ca90 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.711113:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c84c2617000 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:3.0:1788574236.711116:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8ca90 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.711121:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8ca90 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.711130:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c85d07b8300) 00010000:00010000:3.0:1788574236.711132:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574236.711142:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8ca90 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.711148:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8ca90 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.711162:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8cab3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.711168:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8cab3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.711174:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8cab3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.711179:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85c152f400 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:3.0:1788574236.711182:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8cab3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.711214:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8cab3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.711224:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c85d07b8300) 00010000:00010000:3.0:1788574236.711227:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574236.711230:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8cab3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.711236:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8cab3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788574236.711522:0:6471:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:1.0:1788574236.711560:0:6471:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c84c353b6c0 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:1.0:1788574236.711565:0:6471:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c85fae5de00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c84c353bd80 00000020:00080000:1.0:1788574236.711568:0:6471:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c85fae5d300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c84c2361200 00000020:00080000:3.0:1788574236.711963:0:6524:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:3.0:1788574236.712082:0:6524:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:1.0:1788574236.713522:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788574236.713555:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681647616:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788574236.713678:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574236.714068:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681647616 00000100:00100000:2.0:1788574236.714079:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681647616 00000100:00100000:2.0:1788574236.714178:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788574236.714221:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c26bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3619:x1875455681647616:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788574236.714260:0:8409:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:4 count 1 00000100:00100000:3.0:1788574236.714294:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00002000:00010000:2.0:1788574236.714307:0:8409:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a9b7a19, atime: 0x6a9b7a1a, ctime: 0x6a9b7a19, blocks: 0x8 00010000:00010000:2.0:1788574236.714317:0:8409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000728a795d/0x5bf8706fdac8cae4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574236.714338:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=376s v=(0 0) 00010000:00010000:2.0:1788574236.714343:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574236.714351:0:8409:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000728a795d/0x5bf8706fdac8cae4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574236.714373:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668995968 00000100:00100000:3.0:1788574236.714377:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668995968 00010000:00010000:2.0:1788574236.714384:0:8409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000728a795d/0x5bf8706fdac8cae4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574236.714396:0:8409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000728a795d/0x5bf8706fdac8cae4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574236.714404:0:8409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000728a795d/0x5bf8706fdac8cae4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574236.714411:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 44 00000100:00100000:3.0:1788574236.714418:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85d01f4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:659467ff-94af-418e-92fe-11e4323a48aa+17:12321:x1875455668995968:12345-192.168.204.51@tcp:35:lfs.0 00010000:00010000:2.0:1788574236.714451:0:8409:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788574236.714669:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c26bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3619:x1875455681647616:12345-0@lo:6:osp-syn-1-0.0 Request processed in 480us (999us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788574236.714686:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00010000:2.0:1788574236.714713:0:7444:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788574236.714721:0:7444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000728a795d/0x5bf8706fdac8cae4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574236.714730:0:7444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32ec00 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:2.0:1788574236.714736:0:7444:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000728a795d/0x5bf8706fdac8cae4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574236.714747:0:7444:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000728a795d/0x5bf8706fdac8cae4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574236.714767:0:7444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000728a795d/0x5bf8706fdac8cae4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574236.714775:0:7444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000728a795d/0x5bf8706fdac8cae4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574236.714800:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574236.714802:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574236.714803:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788574236.714841:0:3619:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c84c1be0a80/2, rc 0, transno 4294967308 00000100:00100000:2.0:1788574236.714848:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681647616:0@lo:6:osp-syn-1-0.0 00000100:00080000:0.0:1788574236.715075:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788574236.717077:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85d01f4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:659467ff-94af-418e-92fe-11e4323a48aa+18:12321:x1875455668995968:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 2643us (2769us total) trans 4294967448 rc 0/0 00000100:00100000:3.0:1788574236.717105:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 44 00000100:00100000:1.0:1788574236.816349:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574236.816891:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668996224 00000100:00100000:0.0:1788574236.816976:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668996224 00000100:00100000:0.0:1788574236.817079:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 175 00000100:00100000:0.0:1788574236.817093:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa0e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+18:12327:x1875455668996224:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:0.0:1788574236.817130:0:7439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574236.817161:0:7439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152e000/0x5bf8706fdac8caeb lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d69d2 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574236.817366:0:7439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f600/0x5bf8706fdac8caf2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574236.817413:0:7439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8cacf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d69c4 expref: 19 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574236.817423:0:7439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f600/0x5bf8706fdac8caf2 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574236.817478:0:7439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8cacf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d69c4 expref: 19 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574236.817980:0:7439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8cacf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d69c4 expref: 19 pid: 6493 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574236.818002:0:7439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be0000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7439:1875455681647744:192.168.204.51@tcp:104: 00000100:00100000:0.0:1788574236.818414:0:7439:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85fafee480 going to sleep for 11 seconds 00000100:00100000:0.0:1788574236.821470:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fa0e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681647872:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788574236.821596:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574236.821836:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681647872 00000100:00100000:1.0:1788574236.821846:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681647872 00000100:00100000:1.0:1788574236.821944:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788574236.821955:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681647872:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788574236.822003:0:14401:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923525632 avail 3692003328 00000100:00080000:2.0:1788574236.822329:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788574236.822554:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681647872:12345-0@lo:13:osp-pre-1-1.0 Request processed in 600us (958us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574236.822565:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788574236.822801:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fa0e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681647872:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788574236.822835:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788574236.822844:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fa0e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681648000:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788574236.822883:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574236.823760:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681648000 00000100:00100000:1.0:1788574236.823771:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681648000 00000100:00100000:1.0:1788574236.823835:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788574236.823854:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3617:x1875455681648000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788574236.823882:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788574236.823967:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3617:x1875455681648000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (1082us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574236.823974:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788574236.824399:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fa0e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681648000:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788574236.825393:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69505170-06bc-41d1-9626-ab1a3c7f32a0:3619:1875455681648128:0@lo:400:kworker.0 00000100:00100000:2.0:1788574236.825473:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574236.825888:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574236.825950:0:7439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be0000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7439:1875455681647744:192.168.204.51@tcp:104: 00010000:00010000:3.0:1788574236.825980:0:7439:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f600/0x5bf8706fdac8caf2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574236.826027:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668996352 00000100:00100000:3.0:1788574236.826034:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668996352 00010000:00010000:3.0:1788574236.826247:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8cacf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d69c4 expref: 20 pid: 6493 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574236.826285:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 87 00000100:00100000:3.0:1788574236.826295:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c37aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:659467ff-94af-418e-92fe-11e4323a48aa+20:2393:x1875455668996352:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788574236.826312:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574236.826321:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8cacf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d69c4 expref: 20 pid: 6493 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.826336:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8cacf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d69c4 expref: 20 pid: 6493 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.826374:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8cacf lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d69c4 expref: 20 pid: 6493 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.826413:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c85d07b8300) 00010000:00010000:3.0:1788574236.826419:0:6478:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f600/0x5bf8706fdac8caf2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.826430:0:6478:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f600/0x5bf8706fdac8caf2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.826438:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f600/0x5bf8706fdac8caf2 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.826462:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788574236.826593:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681648128 00000100:00100000:1.0:1788574236.826600:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681648128 00000100:00100000:1.0:1788574236.826647:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:1.0:1788574236.826656:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5677050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:3619:x1875455681648128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574236.826747:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c37aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:659467ff-94af-418e-92fe-11e4323a48aa+19:2393:x1875455668996352:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 453us (862us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574236.826756:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 87 00010000:00010000:3.0:1788574236.826793:0:7439:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f600/0x5bf8706fdac8caf2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.826802:0:7439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f600/0x5bf8706fdac8caf2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788574236.826825:0:7439:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:3.0:1788574236.827008:0:7439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152e000/0x5bf8706fdac8caeb lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d69d2 expref: 20 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.827030:0:7439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f600/0x5bf8706fdac8caf2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d69d2 expref: 19 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.827060:0:7439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c85d07b8300) 00010000:00010000:3.0:1788574236.827071:0:7439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788574236.827075:0:7439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85c152f600, rc 0) 00000100:00100000:2.0:1788574236.827790:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788574236.827808:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875455681648256:0@lo:400:kworker.0 00000100:00100000:1.0:1788574236.829505:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5677050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:3619:x1875455681648128:12345-0@lo:400:kworker.0 Request processed in 2828us (4010us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574236.829525:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:1.0:1788574236.829676:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3620:1875455681648768:0@lo:400:kworker.0 00000100:00100000:1.0:1788574236.829726:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574236.829767:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3620:1875455681649280:0@lo:400:kworker.0 00000100:00100000:1.0:1788574236.829820:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574236.829863:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788574236.829871:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c35fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681648640:0@lo:400:kworker.0 00000100:00100000:1.0:1788574236.829914:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574236.829938:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681649152:0@lo:400:kworker.0 00000100:00100000:1.0:1788574236.829968:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574236.830010:0:13791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681649152 00000100:00100000:1.0:1788574236.830019:0:13791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681649152 00000100:00100000:1.0:1788574236.830978:0:13791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788574236.830994:0:13791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa0e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681649152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574236.831286:0:13791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa0e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681649152:12345-0@lo:400:kworker.0 Request processed in 296us (1315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574236.831296:0:13791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788574236.831375:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681649152:0@lo:400:kworker.0 00000100:00100000:1.0:1788574236.831415:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681648640 00000100:00100000:1.0:1788574236.831421:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681648640 00000100:00100000:1.0:1788574236.831455:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1788574236.831462:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa0e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681648640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574236.831522:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa0e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681648640:12345-0@lo:400:kworker.0 Request processed in 60us (1616us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574236.831528:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1788574236.831555:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c35fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681648640:0@lo:400:kworker.0 00000100:00100000:1.0:1788574236.831581:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681648768 00000100:00100000:1.0:1788574236.831586:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681648768 00000100:00080000:1.0:1788574236.831612:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788574236.831777:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681649280 00000100:00100000:1.0:1788574236.831797:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681649280 00000100:00080000:1.0:1788574236.831812:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788574236.831969:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1788574236.831980:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa0e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875455681648768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574236.832027:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa0e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875455681648768:12345-0@lo:400:kworker.0 Request processed in 50us (2302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574236.832033:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1788574236.832162:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1788574236.832170:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa0e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875455681649280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574236.832232:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa0e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875455681649280:12345-0@lo:400:kworker.0 Request processed in 63us (2410us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574236.832240:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1788574236.832277:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3620:1875455681648768:0@lo:400:kworker.0 00000100:00100000:1.0:1788574236.832290:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3620:1875455681649280:0@lo:400:kworker.0 00000100:00100000:1.0:1788574236.832398:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681648384:0@lo:400:kworker.0 00000100:00100000:1.0:1788574236.832442:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574236.832469:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3727800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1875455681648896:0@lo:400:kworker.0 00000100:00100000:1.0:1788574236.832508:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574236.832526:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1875455681649408:0@lo:400:kworker.0 00000100:00100000:1.0:1788574236.832551:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574236.832570:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788574236.832578:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c35faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875455681648512:0@lo:400:kworker.0 00000100:00100000:1.0:1788574236.832600:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574236.832616:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681649024:0@lo:400:kworker.0 00000100:00100000:0.0:1788574236.832813:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681648896 00000100:00100000:0.0:1788574236.832819:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681648896 00000100:00100000:0.0:1788574236.832865:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681649408 00000100:00100000:0.0:1788574236.832868:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681649408 00000100:00100000:0.0:1788574236.832882:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681648512 00000100:00100000:0.0:1788574236.832885:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681648512 00000100:00100000:0.0:1788574236.832898:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1788574236.832930:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c35fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875455681648896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574236.832974:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c35fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875455681648896:12345-0@lo:400:kworker.0 Request processed in 47us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574236.832980:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1788574236.832994:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1788574236.832999:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8334380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875455681649408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574236.833026:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8334380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875455681649408:12345-0@lo:400:kworker.0 Request processed in 26us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574236.833032:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1788574236.833293:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:0.0:1788574236.833302:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8336680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875455681648512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574236.833334:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8336680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875455681648512:12345-0@lo:400:kworker.0 Request processed in 34us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574236.833340:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00080000:0.0:1788574236.833367:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788574236.833381:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681648384 00000100:00100000:0.0:1788574236.833386:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681648384 00000100:00100000:0.0:1788574236.833413:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1788574236.833421:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c335ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681648384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574236.833455:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c335ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681648384:12345-0@lo:400:kworker.0 Request processed in 36us (1014us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574236.833462:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1788574236.833826:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574236.833993:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681648384:0@lo:400:kworker.0 00010000:00080000:1.0:1788574236.834012:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3727800 x1875455681648896/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574236.834023:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3727800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1875455681648896:0@lo:400:kworker.0 00010000:00080000:1.0:1788574236.834218:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3c0ad80 x1875455681649408/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574236.834231:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1875455681649408:0@lo:400:kworker.0 00000100:00100000:1.0:1788574236.834266:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c35faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875455681648512:0@lo:400:kworker.0 00000100:00100000:0.0:1788574236.834431:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681649024 00000100:00100000:0.0:1788574236.834439:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681649024 00000100:00100000:0.0:1788574236.834496:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788574236.834504:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8337100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681649024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574236.834569:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8337100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681649024:12345-0@lo:400:kworker.0 Request processed in 66us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574236.834576:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788574236.834767:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681649024:0@lo:400:kworker.0 00000100:00100000:3.0:1788574236.835249:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa0e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+19:12327:x1875455668996224:12345-192.168.204.51@tcp:101:bash.0 Request processed in 18154us (18911us total) trans 4294967449 rc 0/0 00000100:00100000:3.0:1788574236.835260:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 175 00000100:00100000:3.0:1788574236.838732:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574236.839062:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668996608 00000100:00100000:0.0:1788574236.839077:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668996608 00000100:00100000:0.0:1788574236.839160:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 176 00000100:00100000:0.0:1788574236.839172:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faff0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+19:12327:x1875455668996608:12345-192.168.204.51@tcp:36:bash.0 00010000:00010000:0.0:1788574236.839589:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152ee00/0x5bf8706fdac8cb00 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574236.839614:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152ee00/0x5bf8706fdac8cb00 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574236.839639:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152ee00/0x5bf8706fdac8cb00 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788574236.839693:0:6492:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:0.0:1788574236.839719:0:6492:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000044ac307a reply state 0000000095eee247 transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152ee00/0x5bf8706fdac8cb00 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574236.839733:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152ee00/0x5bf8706fdac8cb00 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574236.839742:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c85d07b8300) 00010000:00010000:0.0:1788574236.839745:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788574236.839750:0:6492:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788574236.839898:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faff0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+22:12327:x1875455668996608:12345-192.168.204.51@tcp:36:bash.0 Request processed in 726us (1179us total) trans 4294967451 rc 0/0 00000100:00100000:0.0:1788574236.839917:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 176 00000020:00080000:0.0:1788574236.839924:0:6492:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788574236.841895:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574236.841987:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69505170-06bc-41d1-9626-ab1a3c7f32a0:3619:1875455681648128:0@lo:400:kworker.0 00000100:00100000:0.0:1788574236.842070:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681648256 00000100:00100000:0.0:1788574236.842079:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681648256 00000100:00100000:0.0:1788574236.842150:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1788574236.842161:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faff1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875455681648256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574236.842264:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faff1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875455681648256:12345-0@lo:400:kworker.0 Request processed in 104us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574236.842272:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1788574236.842543:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875455681648256:0@lo:400:kworker.0 00000100:00100000:0.0:1788574236.848331:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574236.848442:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668996736 00000100:00100000:3.0:1788574236.848455:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668996736 00000100:00100000:3.0:1788574236.848534:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 177 00000100:00100000:3.0:1788574236.848544:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+22:12327:x1875455668996736:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:3.0:1788574236.848574:0:7439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574236.848601:0:7439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8cb07 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d69d9 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.848896:0:7439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616000/0x5bf8706fdac8cb0e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.848925:0:7439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f600/0x5bf8706fdac8caf2 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d69d2 expref: 23 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.848935:0:7439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616000/0x5bf8706fdac8cb0e lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.848978:0:7439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f600/0x5bf8706fdac8caf2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d69d2 expref: 23 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.849017:0:7439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f600/0x5bf8706fdac8caf2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d69d2 expref: 23 pid: 7439 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574236.849033:0:7439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faff2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7439:1875455681649536:192.168.204.51@tcp:104: 00000100:00100000:0.0:1788574236.854151:0:7439:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c253a240 going to sleep for 11 seconds 00000100:00100000:0.0:1788574236.854232:0:7439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faff2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7439:1875455681649536:192.168.204.51@tcp:104: 00010000:00010000:0.0:1788574236.854271:0:7439:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616000/0x5bf8706fdac8cb0e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574236.856623:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574236.856873:0:7433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668996864 00000100:00100000:2.0:1788574236.856886:0:7433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668996864 00010000:00010000:2.0:1788574236.856952:0:7433:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f600/0x5bf8706fdac8caf2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d69d2 expref: 24 pid: 7439 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574236.857009:0:7433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 88 00000100:00100000:2.0:1788574236.857021:0:7433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c09880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:659467ff-94af-418e-92fe-11e4323a48aa+24:2393:x1875455668996864:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788574236.857053:0:7433:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788574236.857063:0:7433:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f600/0x5bf8706fdac8caf2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d69d2 expref: 24 pid: 7439 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574236.857079:0:7433:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f600/0x5bf8706fdac8caf2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d69d2 expref: 24 pid: 7439 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574236.857111:0:7433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f600/0x5bf8706fdac8caf2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d69d2 expref: 24 pid: 7439 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574236.857132:0:7433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c85d07b8300) 00010000:00010000:2.0:1788574236.857138:0:7433:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616000/0x5bf8706fdac8cb0e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574236.857172:0:7433:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616000/0x5bf8706fdac8cb0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574236.857181:0:7433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616000/0x5bf8706fdac8cb0e lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574236.857263:0:7433:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788574236.857335:0:7433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c09880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:659467ff-94af-418e-92fe-11e4323a48aa+23:2393:x1875455668996864:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 316us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574236.857344:0:7433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 88 00010000:00010000:0.0:1788574236.857843:0:7439:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616000/0x5bf8706fdac8cb0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574236.857854:0:7439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616000/0x5bf8706fdac8cb0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788574236.857941:0:7439:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788574236.857947:0:7439:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788574236.857976:0:7439:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616000/0x5bf8706fdac8cb0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574236.858017:0:7439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8cb07 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d69d9 expref: 23 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574236.858050:0:7439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616000/0x5bf8706fdac8cb0e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d69d9 expref: 22 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574236.858078:0:7439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c85d07b8300) 00010000:00010000:0.0:1788574236.858082:0:7439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788574236.858086:0:7439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c84c2616000, rc 0) 00000100:00100000:0.0:1788574236.858151:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+22:12327:x1875455668996736:12345-192.168.204.51@tcp:101:bash.0 Request processed in 9607us (9835us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574236.858160:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 177 00000100:00100000:0.0:1788574236.863628:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574236.863729:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668997120 00000100:00100000:2.0:1788574236.863742:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668997120 00000100:00100000:2.0:1788574236.863815:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 45 00000100:00100000:2.0:1788574236.863826:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:659467ff-94af-418e-92fe-11e4323a48aa+22:12327:x1875455668997120:12345-192.168.204.51@tcp:35:bash.0 00000100:00100000:2.0:1788574236.864181:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:659467ff-94af-418e-92fe-11e4323a48aa+23:12327:x1875455668997120:12345-192.168.204.51@tcp:35:bash.0 Request processed in 356us (567us total) trans 4294967452 rc 0/0 00000100:00100000:2.0:1788574236.864227:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 45 00000100:00100000:2.0:1788574236.959502:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574236.959711:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668997376 00000100:00100000:1.0:1788574236.959726:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668997376 00000100:00100000:1.0:1788574236.959810:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 178 00000100:00100000:1.0:1788574236.959823:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3597b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+23:12337:x1875455668997376:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:1.0:1788574236.959872:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574236.959911:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8cb15 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d69e0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788574236.960071:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1788574236.960253:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8cb15 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d69e0 expref: 25 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574236.960301:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c85fa28c100) 00010000:00010000:1.0:1788574236.960305:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788574236.960314:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8cb15 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d69e0 expref: 25 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574236.960332:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85faea2000, rc 0) 00000100:00100000:1.0:1788574236.960439:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3597b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+24:12337:x1875455668997376:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 619us (966us total) trans 4294967453 rc 301/301 00000100:00100000:1.0:1788574236.960448:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 178 00000100:00100000:0.0:1788574236.965850:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574236.966245:0:11893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668997504 00000100:00100000:3.0:1788574236.966259:0:11893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668997504 00000100:00100000:3.0:1788574236.966344:0:11893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 179 00000100:00100000:3.0:1788574236.966376:0:11893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:659467ff-94af-418e-92fe-11e4323a48aa+24:12337:x1875455668997504:12345-192.168.204.51@tcp:34:lfs.0 00010000:00010000:3.0:1788574236.966517:0:11893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8cb23 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.966543:0:11893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8cb23 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.966562:0:11893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8cb23 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.966585:0:11893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8cb2a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.966592:0:11893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8cb2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.966599:0:11893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8cb2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.966727:0:11893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617200/0x5bf8706fdac8cb31 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.966767:0:11893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617200/0x5bf8706fdac8cb31 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.966775:0:11893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617200/0x5bf8706fdac8cb31 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788574236.966863:0:11893:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617200/0x5bf8706fdac8cb31 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.966881:0:11893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8cb23 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.966889:0:11893:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8cb23 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.966896:0:11893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8cb23 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.966913:0:11893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c84c2617000 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:3.0:1788574236.966918:0:11893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8cb23 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.966928:0:11893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8cb23 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.966945:0:11893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c85d07b8d00) 00010000:00010000:3.0:1788574236.966948:0:11893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574236.966956:0:11893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8cb23 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.966963:0:11893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8cb23 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.966989:0:11893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8cb2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.966996:0:11893:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8cb2a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.967002:0:11893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8cb2a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.967007:0:11893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c84c2617400 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:3.0:1788574236.967010:0:11893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8cb2a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.967017:0:11893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8cb2a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.967025:0:11893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c85fa28cf00) 00010000:00010000:3.0:1788574236.967028:0:11893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574236.967031:0:11893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8cb2a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.967037:0:11893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8cb2a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.967055:0:11893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617200/0x5bf8706fdac8cb31 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.967062:0:11893:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617200/0x5bf8706fdac8cb31 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.967068:0:11893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617200/0x5bf8706fdac8cb31 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.967080:0:11893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c84c2617200 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:3.0:1788574236.967084:0:11893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617200/0x5bf8706fdac8cb31 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.967091:0:11893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617200/0x5bf8706fdac8cb31 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.967100:0:11893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c85d07b8300) 00010000:00010000:3.0:1788574236.967103:0:11893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574236.967107:0:11893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617200/0x5bf8706fdac8cb31 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574236.967113:0:11893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617200/0x5bf8706fdac8cb31 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574236.967274:0:11893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:659467ff-94af-418e-92fe-11e4323a48aa+24:12337:x1875455668997504:12345-192.168.204.51@tcp:34:lfs.0 Request processed in 918us (1448us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574236.967284:0:11893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 179 00000100:00100000:2.0:1788574236.971749:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574236.971874:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668997760 00000100:00100000:1.0:1788574236.971889:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668997760 00000100:00100000:1.0:1788574236.971981:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 46 00000100:00100000:1.0:1788574236.971996:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3597800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:659467ff-94af-418e-92fe-11e4323a48aa+24:12337:x1875455668997760:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:1.0:1788574236.972382:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3597800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:659467ff-94af-418e-92fe-11e4323a48aa+25:12337:x1875455668997760:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 389us (649us total) trans 4294967454 rc 0/0 00000100:00100000:1.0:1788574236.972392:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 46 00000100:00100000:2.0:1788574237.038328:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574237.038728:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668998016 00000100:00100000:0.0:1788574237.038742:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668998016 00000100:00100000:0.0:1788574237.038828:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 180 00000100:00100000:0.0:1788574237.038840:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3595880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+25:12340:x1875455668998016:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:0.0:1788574237.038874:0:7439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574237.038914:0:7439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f600/0x5bf8706fdac8cb38 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d69e7 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.039796:0:7439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152e000/0x5bf8706fdac8cb3f lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.039823:0:7439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152e000/0x5bf8706fdac8cb3f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.039844:0:7439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152e000/0x5bf8706fdac8cb3f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.039865:0:7439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8cb46 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.039887:0:7439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8cb46 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.039894:0:7439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8cb46 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.040812:0:7439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7c00/0x5bf8706fdac8cb4d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.040834:0:7439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7c00/0x5bf8706fdac8cb4d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.041176:0:7439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7c00/0x5bf8706fdac8cb4d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788574237.041226:0:7439:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788574237.041371:0:7439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152e000/0x5bf8706fdac8cb3f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.041380:0:7439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152e000/0x5bf8706fdac8cb3f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.041388:0:7439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152e000/0x5bf8706fdac8cb3f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.041395:0:7439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85c152e000 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:0.0:1788574237.041401:0:7439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152e000/0x5bf8706fdac8cb3f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.041411:0:7439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152e000/0x5bf8706fdac8cb3f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.041445:0:7439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c85d07b8d00) 00010000:00010000:0.0:1788574237.041449:0:7439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574237.041456:0:7439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152e000/0x5bf8706fdac8cb3f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.041463:0:7439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152e000/0x5bf8706fdac8cb3f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.041724:0:7439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8cb46 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.041733:0:7439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8cb46 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.041739:0:7439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8cb46 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.041745:0:7439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85c152f400 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:0.0:1788574237.041748:0:7439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8cb46 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.041754:0:7439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8cb46 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.041764:0:7439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c85c6b83500) 00010000:00010000:0.0:1788574237.041767:0:7439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574237.041770:0:7439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8cb46 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.041776:0:7439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8cb46 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.041872:0:7439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f600/0x5bf8706fdac8cb38 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d69e7 expref: 28 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.041890:0:7439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7c00/0x5bf8706fdac8cb4d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d69e7 expref: 27 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.041898:0:7439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c85d07b8300) 00010000:00010000:0.0:1788574237.041901:0:7439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788574237.041913:0:7439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d20d7c00, rc 0) 00000100:00100000:0.0:1788574237.042048:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3595880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+27:12340:x1875455668998016:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 3208us (3731us total) trans 4294967455 rc 0/0 00000100:00100000:0.0:1788574237.042059:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 180 00000100:00100000:0.0:1788574237.048169:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574237.048263:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574237.048461:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668998272 00000100:00100000:3.0:1788574237.048476:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668998272 00000100:00100000:3.0:1788574237.048583:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 13 00000100:00100000:3.0:1788574237.048596:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3722d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:659467ff-94af-418e-92fe-11e4323a48aa+27:2395:x1875455668998272:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788574237.048749:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574237.048789:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7c00/0x5bf8706fdac8cb4d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d69e7 expref: 27 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.048815:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c85d07b8300) 00010000:00010000:3.0:1788574237.048821:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788574237.048915:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3722d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:659467ff-94af-418e-92fe-11e4323a48aa+26:2395:x1875455668998272:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 320us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574237.048924:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 13 00000100:00100000:1.0:1788574237.049018:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668998144 00000100:00100000:1.0:1788574237.049024:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668998144 00000100:00100000:1.0:1788574237.049070:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 181 00000100:00100000:1.0:1788574237.049088:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+26:12340:x1875455668998144:12345-192.168.204.51@tcp:54:lfs.0 00010000:00010000:1.0:1788574237.049171:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8cb5b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.049220:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8cb5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.049247:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8cb5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.049298:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8cb5b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.049306:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8cb5b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.049314:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8cb5b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.049319:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85faea2000 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:1.0:1788574237.049325:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8cb5b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.049335:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8cb5b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.049343:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c85d07b8300) 00010000:00010000:1.0:1788574237.049347:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788574237.050802:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8cb5b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.050830:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8cb5b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574237.050939:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+26:12340:x1875455668998144:12345-192.168.204.51@tcp:54:lfs.0 Request processed in 1855us (2781us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574237.050948:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 181 00000100:00100000:0.0:1788574237.058445:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574237.058541:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668998528 00000100:00100000:1.0:1788574237.058576:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668998528 00000100:00100000:1.0:1788574237.058663:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 47 00000100:00100000:1.0:1788574237.058676:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3723b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:659467ff-94af-418e-92fe-11e4323a48aa+26:12340:x1875455668998528:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:1.0:1788574237.059000:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3723b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:659467ff-94af-418e-92fe-11e4323a48aa+27:12340:x1875455668998528:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 326us (571us total) trans 4294967456 rc 0/0 00000100:00100000:1.0:1788574237.059009:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 47 00000100:00100000:2.0:1788574237.239393:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574237.239730:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668998784 00000100:00100000:0.0:1788574237.239746:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668998784 00000100:00100000:0.0:1788574237.239835:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 182 00000100:00100000:0.0:1788574237.239848:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3597480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+27:12358:x1875455668998784:12345-192.168.204.51@tcp:101:cat.0 00010000:00010000:0.0:1788574237.239886:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574237.239918:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8cb62 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d69ee expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.240068:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8cb69 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.240090:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8cb69 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.240125:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8cb69 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788574237.240143:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788574237.240343:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8cb62 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d69ee expref: 30 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.240392:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8cb69 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d69ee expref: 29 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.240402:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c85d07b8300) 00010000:00010000:0.0:1788574237.240405:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788574237.240409:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d20d7e00, rc 0) 00000100:00100000:0.0:1788574237.240507:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3597480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+29:12358:x1875455668998784:12345-192.168.204.51@tcp:101:cat.0 Request processed in 661us (1130us total) trans 4294967457 rc 0/0 00000100:00100000:0.0:1788574237.240515:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 182 00000100:00100000:2.0:1788574237.291841:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574237.291968:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668998912 00000100:00100000:0.0:1788574237.291982:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668998912 00000100:00100000:0.0:1788574237.292067:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 183 00000100:00100000:0.0:1788574237.292079:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3596680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+29:12359:x1875455668998912:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:0.0:1788574237.292113:0:7439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574237.292141:0:7439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8cb77 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d69f5 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.292297:0:7439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8cb7e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.292343:0:7439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8cb7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.292370:0:7439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8cb7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788574237.292433:0:7439:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1788574237.292438:0:7439:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788574237.292466:0:7439:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8cb7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.292502:0:7439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8cb77 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d69f5 expref: 31 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.292525:0:7439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8cb7e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d69f5 expref: 30 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.292536:0:7439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c85d07b8d00) 00010000:00010000:0.0:1788574237.292540:0:7439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788574237.292544:0:7439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d20d6600, rc 0) 00000100:00100000:0.0:1788574237.292634:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3596680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+30:12359:x1875455668998912:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 558us (812us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574237.292643:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 183 00000100:00100000:2.0:1788574237.299962:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574237.300517:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668999296 00000100:00100000:1.0:1788574237.300532:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668999296 00000100:00100000:1.0:1788574237.300615:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 48 00000100:00100000:1.0:1788574237.300627:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3594000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:659467ff-94af-418e-92fe-11e4323a48aa+30:12359:x1875455668999296:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:1.0:1788574237.301053:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3594000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:659467ff-94af-418e-92fe-11e4323a48aa+31:12359:x1875455668999296:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 426us (1104us total) trans 4294967458 rc 0/0 00000100:00100000:1.0:1788574237.301063:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 48 00000100:00100000:2.0:1788574237.306365:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574237.307779:0:7433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668999424 00000100:00100000:1.0:1788574237.307800:0:7433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668999424 00000100:00100000:1.0:1788574237.307917:0:7433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 14 00000100:00100000:1.0:1788574237.307929:0:7433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3596300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:659467ff-94af-418e-92fe-11e4323a48aa+31:12359:x1875455668999424:12345-192.168.204.51@tcp:103:lfs.0 00010000:00010000:1.0:1788574237.307950:0:7433:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788574237.307985:0:7433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616000/0x5bf8706fdac8cb0e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d69d9 expref: 31 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.308015:0:7433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8cb69 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d69ee expref: 30 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.308029:0:7433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8ca04 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6993 expref: 29 pid: 11893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.308128:0:7433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c85d07b8300) 00010000:00010000:1.0:1788574237.308135:0:7433:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788574237.308396:0:7433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3596300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:659467ff-94af-418e-92fe-11e4323a48aa+28:12359:x1875455668999424:12345-192.168.204.51@tcp:103:lfs.0 Request processed in 467us (2057us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574237.308405:0:7433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 14 00000100:00100000:2.0:1788574237.311768:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574237.311875:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668999552 00000100:00100000:1.0:1788574237.311890:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668999552 00000100:00100000:1.0:1788574237.312032:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 184 00000100:00100000:1.0:1788574237.312064:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c365b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+28:12359:x1875455668999552:12345-192.168.204.51@tcp:58:lfs.0 00010000:00010000:1.0:1788574237.312579:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8cb85 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.312608:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8cb85 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.312624:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8cb85 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788574237.312776:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:1.0:1788574237.312902:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c365b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+28:12359:x1875455668999552:12345-192.168.204.51@tcp:58:lfs.0 Request processed in 839us (1156us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574237.312913:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 184 00010000:00010000:1.0:1788574237.331741:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574237.349428:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574237.349797:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668999680 00000100:00100000:1.0:1788574237.349813:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668999680 00000100:00100000:1.0:1788574237.349905:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 185 00000100:00100000:1.0:1788574237.349918:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de938380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+28:12361:x1875455668999680:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:1.0:1788574237.349967:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574237.349998:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8cb8c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d69fc expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.350122:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8cb93 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.350141:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8cb93 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.350156:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8cb93 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.350176:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8cb9a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.350183:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8cb9a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.351789:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8cb9a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.351947:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8cba1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.351964:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8cba1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.351972:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8cba1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788574237.352042:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788574237.352065:0:6494:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788574237.352097:0:6494:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8cba1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.352115:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8cba1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.352124:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8cb93 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.352130:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8cb93 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.352138:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8cb93 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.352143:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85faea2600 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:1.0:1788574237.352149:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8cb93 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.352156:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8cb93 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.352171:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c85d07b8d00) 00010000:00010000:1.0:1788574237.352175:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788574237.352181:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8cb93 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.352206:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8cb93 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.352224:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8cb9a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.352926:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8cb9a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.352933:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8cb9a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.352938:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85faea3800 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:1.0:1788574237.352942:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8cb9a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.352950:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8cb9a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.352961:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c84c34f0800) 00010000:00010000:1.0:1788574237.352964:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788574237.352967:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8cb9a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.352973:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8cb9a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.353041:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8cb8c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d69fc expref: 30 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.353057:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8cba1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d69fc expref: 29 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.353068:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c85d07b8300) 00010000:00010000:1.0:1788574237.353071:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788574237.353081:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85faea3e00, rc 0) 00000100:00100000:0.0:1788574237.354249:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de938380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+29:12361:x1875455668999680:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 4309us (4814us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574237.354265:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 185 00000040:00080000:3.0:1788574237.524427:0:13764:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788574237.524453:0:13764:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788574237.524489:0:13764:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1788574237.524500:0:13764:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788574237.525139:0:13764:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faff2d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13764:1875455681649664:192.168.204.51@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788574237.525452:0:13764:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c253a840 going to sleep for 11 seconds 00000100:00100000:3.0:1788574237.547177:0:13764:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faff2d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13764:1875455681649664:192.168.204.51@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788574237.568181:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574237.569089:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668999808 00000100:00100000:0.0:1788574237.569127:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668999808 00000100:00100000:0.0:1788574237.569239:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 186 00000100:00100000:0.0:1788574237.569251:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+29:12372:x1875455668999808:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788574237.569304:0:7439:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788574237.569516:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+29:12372:x1875455668999808:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 Request processed in 266us (1354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574237.569525:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 186 00000100:00100000:0.0:1788574237.589711:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574237.589917:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455668999936 00000100:00100000:1.0:1788574237.589932:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455668999936 00000100:00100000:1.0:1788574237.590027:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 187 00000100:00100000:1.0:1788574237.590040:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de939c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+29:12372:x1875455668999936:12345-192.168.204.51@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788574237.590150:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8cba8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.590175:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8cba8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.590212:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8cba8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.590398:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8cbaf lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.590425:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8cbaf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.590439:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8cbaf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.590477:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8cbb6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.590485:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8cbb6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.590492:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8cbb6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788574237.590550:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788574237.590576:0:6493:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788574237.590596:0:6493:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8cbb6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.590611:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8cba8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.590618:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8cba8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.590625:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8cba8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.590630:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85faea2200 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:1.0:1788574237.590635:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8cba8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.590643:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8cba8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.590656:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c85c90c8800) 00010000:00010000:1.0:1788574237.590659:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788574237.590664:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8cba8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.590670:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8cba8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.590690:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8cbaf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.590696:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8cbaf lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.590712:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8cbaf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.590717:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85faea3800 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:1.0:1788574237.590719:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8cbaf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.590724:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8cbaf lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.590731:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff9c84c34f0800) 00010000:00010000:1.0:1788574237.590734:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788574237.590737:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8cbaf lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.590742:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8cbaf lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.590758:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8cbb6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.590764:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8cbb6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.590769:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8cbb6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.590774:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85faea2600 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:1.0:1788574237.590776:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8cbb6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.590790:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8cbb6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.590797:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c85d07b8300) 00010000:00010000:1.0:1788574237.590799:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788574237.590802:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8cbb6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.590806:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8cbb6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574237.590915:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de939c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+29:12372:x1875455668999936:12345-192.168.204.51@tcp:34:lhsmtool_posix.0 Request processed in 875us (1220us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574237.590925:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 187 00000100:00100000:0.0:1788574237.600709:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574237.601263:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669000192 00000100:00100000:3.0:1788574237.601277:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669000192 00000100:00100000:3.0:1788574237.601423:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 188 00000100:00100000:3.0:1788574237.601436:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de939180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+29:12372:x1875455669000192:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788574237.601465:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574237.601492:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617200/0x5bf8706fdac8cbbd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6a03 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.601672:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8cbc4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.601692:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8cbc4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.601708:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8cbc4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788574237.601722:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788574237.601875:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8cbc4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.601885:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8cbc4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.601891:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8cbc4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.601897:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c84c2617400 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:3.0:1788574237.601902:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8cbc4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.601912:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8cbc4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.605455:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c85d07b8300) 00010000:00010000:3.0:1788574237.605477:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788574237.605496:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8cbc4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.605511:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8cbc4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.605632:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617200/0x5bf8706fdac8cbbd lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a03 expref: 31 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.605647:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c85c90c8800) 00010000:00010000:3.0:1788574237.605649:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788574237.605653:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617200/0x5bf8706fdac8cbbd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a03 expref: 31 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.605708:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c84c2617200, rc 0) 00000100:00100000:3.0:1788574237.605839:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de939180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+30:12372:x1875455669000192:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 4392us (5135us total) trans 4294967459 rc 301/301 00000100:00100000:3.0:1788574237.605851:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 188 00000100:00100000:1.0:1788574237.614174:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574237.614329:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669000320 00000100:00100000:0.0:1788574237.614352:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669000320 00000100:00100000:0.0:1788574237.614431:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 189 00000100:00100000:0.0:1788574237.614968:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8335f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+30:12372:x1875455669000320:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788574237.615027:0:6492:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788574237.615185:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8335f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+30:12372:x1875455669000320:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 Request processed in 226us (1025us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574237.615230:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 189 00000100:00100000:1.0:1788574237.619410:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574237.619900:0:11893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669000576 00000100:00100000:0.0:1788574237.619917:0:11893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669000576 00000100:00100000:0.0:1788574237.620008:0:11893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 190 00000100:00100000:0.0:1788574237.620022:0:11893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8337b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:659467ff-94af-418e-92fe-11e4323a48aa+30:12372:x1875455669000576:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788574237.620052:0:11893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574237.620057:0:11893:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788574237.620098:0:11893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8cb7e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d69f5 expref: 30 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.620140:0:11893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c85d07b8d00) 00010000:00010000:0.0:1788574237.620148:0:11893:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788574237.620172:0:11893:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8cbd2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6a0a expref: -99 pid: 11893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788574237.623712:0:11893:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:0.0:1788574237.624279:0:11893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8cbd9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.624316:0:11893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8cbd9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.624334:0:11893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8cbd9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.624444:0:11893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8cbd2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a0a expref: 32 pid: 11893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.624479:0:11893:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8cbd9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a0a expref: 31 pid: 11893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.624500:0:11893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9c85c6b83500) 00010000:00010000:0.0:1788574237.624504:0:11893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788574237.624509:0:11893:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d20d7e00, rc 0) 00000100:00100000:0.0:1788574237.624636:0:11893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8337b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:659467ff-94af-418e-92fe-11e4323a48aa+31:12372:x1875455669000576:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 4617us (5243us total) trans 4294967460 rc 0/0 00000100:00100000:0.0:1788574237.624649:0:11893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 190 00000100:00100000:3.0:1788574237.630760:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574237.632970:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669000832 00000100:00100000:1.0:1788574237.632996:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669000832 00000100:00100000:1.0:1788574237.633125:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 191 00000100:00100000:1.0:1788574237.633141:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faff2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+31:12372:x1875455669000832:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788574237.633292:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574237.633368:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8cbd9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a0a expref: 31 pid: 11893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.633398:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9c85c6b83500) 00010000:00010000:1.0:1788574237.633414:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788574237.633458:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8cbe7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.633495:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8cbe7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.633508:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8cbe7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.633526:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8cbee lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xed77d87a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.633533:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8cbee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xed77d87a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.633540:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8cbee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xed77d87a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.633746:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8cbe7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.633755:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8cbe7 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.633764:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8cbe7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.633770:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85faea3800 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:1.0:1788574237.633776:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8cbe7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.633787:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8cbe7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.633797:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c85d07b8d00) 00010000:00010000:1.0:1788574237.633807:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788574237.633812:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8cbe7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.633820:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8cbe7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.633833:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8cbee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xed77d87a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.633840:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8cbee lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xed77d87a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.633846:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8cbee lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xed77d87a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.633852:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85faea2200 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:1.0:1788574237.633855:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8cbee lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xed77d87a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.633861:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8cbee lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xed77d87a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.633868:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xed77d87a (ffff9c84c34f0800) 00010000:00010000:1.0:1788574237.633871:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788574237.633873:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8cbee lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xed77d87a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.633879:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8cbee lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xed77d87a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574237.634035:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faff2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+30:12372:x1875455669000832:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 Request processed in 895us (3288us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788574237.634052:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 191 00000100:00100000:1.0:1788574237.644461:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574237.645479:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669000960 00000100:00100000:3.0:1788574237.645506:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669000960 00000100:00100000:3.0:1788574237.645630:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 192 00000100:00100000:3.0:1788574237.645645:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+30:12372:x1875455669000960:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788574237.645685:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574237.645728:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8cbf5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6a11 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.645795:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617200/0x5bf8706fdac8cbfc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.645817:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617200/0x5bf8706fdac8cbfc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.645836:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617200/0x5bf8706fdac8cbfc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.646039:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8cbf5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a11 expref: 32 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.646066:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617200/0x5bf8706fdac8cbfc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a11 expref: 31 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.646091:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9c85fa28cf00) 00010000:00010000:3.0:1788574237.646095:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788574237.646100:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c84c2617200, rc 0) 00000100:00100000:3.0:1788574237.646253:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+31:12372:x1875455669000960:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 611us (1819us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574237.646263:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 192 00000100:00100000:3.0:1788574237.668572:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574237.669495:0:11893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669001216 00000100:00100000:1.0:1788574237.669514:0:11893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669001216 00000100:00100000:1.0:1788574237.669609:0:11893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 193 00000100:00100000:1.0:1788574237.669622:0:11893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3769c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:659467ff-94af-418e-92fe-11e4323a48aa+31:12372:x1875455669001216:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788574237.669763:0:11893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8cc03 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.669793:0:11893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8cc03 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.669808:0:11893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8cc03 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788574237.673119:0:11893:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:1.0:1788574237.673151:0:11893:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 377652960280ns, next at 378652954840ns, rc = 0 00000004:00010000:1.0:1788574237.676050:0:11893:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007269c9a7 reply state 00000000b5afccef transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8cc03 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.676092:0:11893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8cc03 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.676104:0:11893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9c85fa28cf00) 00010000:00010000:1.0:1788574237.676108:0:11893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1788574237.676114:0:11893:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788574237.677088:0:11893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3769c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:659467ff-94af-418e-92fe-11e4323a48aa+33:12372:x1875455669001216:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 Request processed in 7457us (8522us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1788574237.677104:0:11893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 193 00000100:00100000:1.0:1788574237.682002:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574237.692070:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669001344 00000100:00100000:3.0:1788574237.692108:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669001344 00000100:00100000:1.0:1788574237.692946:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 194 00000100:00100000:1.0:1788574237.692961:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c35faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+33:12372:x1875455669001344:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788574237.692995:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574237.693024:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8cc0a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6a18 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.693115:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8cc0a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a18 expref: 34 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.693133:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8cc0a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a18 expref: 34 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.693156:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9c85fa28cf00) 00010000:00010000:1.0:1788574237.693159:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788574237.693164:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85faea3800, rc 0) 00000100:00100000:1.0:1788574237.693425:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c35faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+34:12372:x1875455669001344:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 466us (11439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574237.693433:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 194 00000100:00100000:2.0:1788574237.697377:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574237.698495:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669001472 00000100:00100000:1.0:1788574237.698514:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669001472 00000100:00100000:1.0:1788574237.698619:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 59 00000100:00100000:1.0:1788574237.698632:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:659467ff-94af-418e-92fe-11e4323a48aa+6:2394:x1875455669001472:12345-192.168.204.51@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788574237.699011:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:659467ff-94af-418e-92fe-11e4323a48aa+7:2394:x1875455669001472:12345-192.168.204.51@tcp:2:lhsmtool_posix.0 Request processed in 380us (1647us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1788574237.699021:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 59 00000100:00100000:3.0:1788574237.713464:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574237.713724:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669001728 00000100:00100000:0.0:1788574237.713738:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669001728 00000100:00100000:0.0:1788574237.713823:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 49 00000100:00100000:0.0:1788574237.713846:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2bdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:659467ff-94af-418e-92fe-11e4323a48aa+34:12372:x1875455669001728:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788574237.714230:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2bdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:659467ff-94af-418e-92fe-11e4323a48aa+35:12372:x1875455669001728:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 Request processed in 386us (783us total) trans 4294967462 rc 0/0 00000100:00100000:0.0:1788574237.714239:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 49 00000100:00100000:0.0:1788574237.750816:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574237.751254:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669001984 00000100:00100000:2.0:1788574237.751268:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669001984 00000100:00100000:2.0:1788574237.751364:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 195 00000100:00100000:2.0:1788574237.751380:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+35:12372:x1875455669001984:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788574237.751541:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+35:12372:x1875455669001984:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 Request processed in 166us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574237.751549:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 195 00000100:00100000:2.0:1788574237.760824:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574237.760924:0:11893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669002112 00000100:00100000:1.0:1788574237.760938:0:11893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669002112 00000100:00100000:1.0:1788574237.761020:0:11893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 196 00000100:00100000:1.0:1788574237.761031:0:11893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:659467ff-94af-418e-92fe-11e4323a48aa+35:12372:x1875455669002112:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788574237.761059:0:11893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574237.761088:0:11893:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2c00/0x5bf8706fdac8cc11 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6a1f expref: -99 pid: 11893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.761205:0:11893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8cc18 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.761224:0:11893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8cc18 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.761239:0:11893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8cc18 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788574237.761302:0:11893:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788574237.761351:0:11893:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8cc18 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.761387:0:11893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2c00/0x5bf8706fdac8cc11 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a1f expref: 37 pid: 11893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.761408:0:11893:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8cc18 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a1f expref: 36 pid: 11893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.761418:0:11893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9c85fa28cf00) 00010000:00010000:1.0:1788574237.761421:0:11893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788574237.761426:0:11893:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85faea2e00, rc 0) 00000100:00100000:1.0:1788574237.762182:0:11893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:659467ff-94af-418e-92fe-11e4323a48aa+36:12372:x1875455669002112:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 1149us (1369us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574237.762207:0:11893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 196 00000100:00100000:2.0:1788574237.784996:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574237.785107:0:8815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669002240 00000100:00100000:1.0:1788574237.785122:0:8815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669002240 00000100:00100000:1.0:1788574237.785240:0:8815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 60 00000100:00100000:1.0:1788574237.785254:0:8815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:659467ff-94af-418e-92fe-11e4323a48aa+7:2393:x1875455669002240:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788574237.785281:0:8815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574237.785314:0:8815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e240f75a/0x5bf8706fdac8cc1f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6a26 expref: -99 pid: 8815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788574237.785372:0:8815:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9b7a1d, blocks: 0x0 00010000:00010000:1.0:1788574237.785406:0:8815:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=377s v=(0 0) 00010000:00010000:1.0:1788574237.785412:0:8815:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574237.785424:0:8815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e240f75a/0x5bf8706fdac8cc1f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a26 expref: 8 pid: 8815 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.785449:0:8815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e240f75a/0x5bf8706fdac8cc1f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a26 expref: 8 pid: 8815 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.785467:0:8815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85faea2c00, rc 0) 00000100:00100000:1.0:1788574237.785539:0:8815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:659467ff-94af-418e-92fe-11e4323a48aa+8:2393:x1875455669002240:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 289us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574237.785548:0:8815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 60 00000100:00100000:0.0:1788574237.798076:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574237.798530:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669002496 00000100:00100000:2.0:1788574237.798544:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669002496 00000100:00100000:2.0:1788574237.798638:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 197 00000100:00100000:2.0:1788574237.798650:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+36:12372:x1875455669002496:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788574237.798833:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+36:12372:x1875455669002496:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 Request processed in 183us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574237.798843:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 197 00000100:00100000:3.0:1788574237.807952:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574237.808610:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669002624 00000100:00100000:2.0:1788574237.808630:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669002624 00000100:00100000:2.0:1788574237.808726:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 61 00000100:00100000:2.0:1788574237.808739:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2bdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:659467ff-94af-418e-92fe-11e4323a48aa+8:12372:x1875455669002624:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788574237.808766:0:8409:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574237.808793:0:8409:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea8df3f9/0x5bf8706fdac8cc26 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6a2d expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.808854:0:8409:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e240f75a/0x5bf8706fdac8cc1f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a26 expref: 9 pid: 8815 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.808901:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574237.808907:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574237.808915:0:8409:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea8df3f9/0x5bf8706fdac8cc26 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a2d expref: 9 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.808969:0:8409:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e240f75a/0x5bf8706fdac8cc1f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a26 expref: 9 pid: 8815 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.808988:0:8409:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e240f75a/0x5bf8706fdac8cc1f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a26 expref: 9 pid: 8815 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574237.809007:0:8409:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36df100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8409:1875455681649792:192.168.204.51@tcp:104: 00000100:00100000:2.0:1788574237.809499:0:8409:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c53cb600 going to sleep for 11 seconds 00000100:00100000:2.0:1788574237.815127:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574237.815277:0:8409:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36df100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8409:1875455681649792:192.168.204.51@tcp:104: 00010000:00010000:1.0:1788574237.815349:0:8409:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ea8df3f9/0x5bf8706fdac8cc26 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a2d expref: 9 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.815402:0:8409:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85fa32f400, rc 0) 00000100:00100000:1.0:1788574237.815478:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2bdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:659467ff-94af-418e-92fe-11e4323a48aa+9:12372:x1875455669002624:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 6741us (7541us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574237.815489:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 61 00000100:00100000:3.0:1788574237.816760:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669002752 00000100:00100000:3.0:1788574237.816778:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669002752 00010000:00010000:3.0:1788574237.816853:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e240f75a/0x5bf8706fdac8cc1f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a26 expref: 9 pid: 8815 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574237.816923:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 89 00000100:00100000:3.0:1788574237.816936:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e0bde850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:659467ff-94af-418e-92fe-11e4323a48aa+9:2394:x1875455669002752:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788574237.816957:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574237.816989:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e240f75a/0x5bf8706fdac8cc1f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a26 expref: 9 pid: 8815 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.817007:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e240f75a/0x5bf8706fdac8cc1f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a26 expref: 9 pid: 8815 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.817065:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e240f75a/0x5bf8706fdac8cc1f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a26 expref: 9 pid: 8815 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.817086:0:6478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574237.817091:0:6478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574237.817103:0:6478:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ea8df3f9/0x5bf8706fdac8cc26 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a2d expref: 8 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.817115:0:6478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea8df3f9/0x5bf8706fdac8cc26 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a2d expref: 8 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.817167:0:6478:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ea8df3f9/0x5bf8706fdac8cc26 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a2d expref: 8 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574237.817183:0:6478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c2bdf100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6478:1875455681649920:192.168.204.51@tcp:105: 00000100:00100000:3.0:1788574237.818116:0:6478:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c253ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1788574237.832408:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574237.833299:0:6478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c2bdf100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6478:1875455681649920:192.168.204.51@tcp:105: 00010000:00010000:0.0:1788574237.833354:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574237.833448:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e0bde850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:659467ff-94af-418e-92fe-11e4323a48aa+8:2394:x1875455669002752:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 16511us (18334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574237.833462:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 89 00000100:00100000:0.0:1788574237.834391:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669002880 00000100:00100000:0.0:1788574237.834407:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669002880 00002000:00100000:0.0:1788574237.834481:0:8415:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9c84c3727800 x1875455669002880/t0(0) o4->659467ff-94af-418e-92fe-11e4323a48aa@192.168.204.51@tcp:388/0 lens 504/0 e 0 to 0 dl 1788574248 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788574237.834494:0:8415:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c84c3727800 with x1875455669002880 ext(0->8) 00002000:00010000:0.0:1788574237.834500:0:8415:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c84c3727800 00000100:00100000:0.0:1788574237.834538:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 4 00000100:00100000:0.0:1788574237.834549:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3727800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:659467ff-94af-418e-92fe-11e4323a48aa+8:2394:x1875455669002880:12345-192.168.204.51@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788574237.837359:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3727800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:659467ff-94af-418e-92fe-11e4323a48aa+10:2394:x1875455669002880:12345-192.168.204.51@tcp:4:lhsmtool_posix.0 Request processed in 2785us (4941us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1788574237.837379:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 4 00002000:00100000:0.0:1788574237.837407:0:8415:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9c84c3727800 x1875455669002880/t4294967315(0) o4->659467ff-94af-418e-92fe-11e4323a48aa@192.168.204.51@tcp:388/0 lens 504/448 e 0 to 0 dl 1788574248 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788574237.837419:0:8415:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c84c3727800 with x1875455669002880 ext(0->8) 00002000:00010000:0.0:1788574237.837428:0:8415:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c84c3727800 00000100:00100000:0.0:1788574237.846636:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574237.846718:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669003008 00000100:00100000:3.0:1788574237.846734:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669003008 00000100:00100000:3.0:1788574237.846815:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 198 00000100:00100000:3.0:1788574237.846837:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+36:12372:x1875455669003008:12345-192.168.204.51@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788574237.850289:0:6471:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:0.0:1788574237.850316:0:6471:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:0.0:1788574237.850365:0:6471:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00010000:00010000:0.0:1788574237.850409:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152ee00/0x5bf8706fdac8cb00 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.850423:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152ee00/0x5bf8706fdac8cb00 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.850432:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152ee00/0x5bf8706fdac8cb00 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.850439:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85c152ee00 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:0.0:1788574237.850446:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152ee00/0x5bf8706fdac8cb00 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.850455:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152ee00/0x5bf8706fdac8cb00 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.850479:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c85d07b8300) 00010000:00010000:0.0:1788574237.850483:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574237.850490:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152ee00/0x5bf8706fdac8cb00 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.850497:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152ee00/0x5bf8706fdac8cb00 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.850551:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8cc03 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.850558:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8cc03 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.850564:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8cc03 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.850570:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85faea2200 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:0.0:1788574237.850573:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8cc03 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.850580:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8cc03 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.850588:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9c85fa28cf00) 00010000:00010000:0.0:1788574237.850592:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788574237.850595:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8cc03 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.850601:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8cc03 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788574237.850762:0:6524:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:0.0:1788574237.850776:0:6524:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1788574237.852261:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+19:12372:x1875455669003008:12345-192.168.204.51@tcp:44:lhsmtool_posix.0 Request processed in 5413us (5630us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574237.852276:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 198 00000100:00100000:0.0:1788574237.852350:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681650048:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788574237.852434:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574237.852503:0:13791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681650048 00000100:00100000:0.0:1788574237.852513:0:13791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681650048 00000100:00100000:0.0:1788574237.852579:0:13791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788574237.852591:0:13791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c2335880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681650048:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1788574237.852770:0:13791:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788574237.852774:0:13791:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788574237 00002000:00010000:0.0:1788574237.852778:0:13791:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788574237.852780:0:13791:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1788574237 -> 1788574237 00002000:00010000:0.0:1788574237.852782:0:13791:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1788574237.852820:0:13791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c2335880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3618:x1875455681650048:12345-0@lo:2:osp-syn-0-0.0 Request processed in 231us (386us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1788574237.852826:0:13791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:0.0:1788574237.852862:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788574237.855636:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574237.855986:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669003136 00000100:00100000:3.0:1788574237.856000:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669003136 00000100:00100000:3.0:1788574237.856083:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 63 00000100:00100000:3.0:1788574237.856095:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:659467ff-94af-418e-92fe-11e4323a48aa+10:2393:x1875455669003136:12345-192.168.204.51@tcp:16:lhsmtool_posix.0 00000004:00080000:0.0:1788574237.857087:0:3618:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c84c3769180/2, rc 0, transno 4294967316 00000100:00100000:0.0:1788574237.857105:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681650048:0@lo:2:osp-syn-0-0.0 00000001:00080000:0.0:1788574237.864373:0:8404:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000001:00080000:0.0:1788574237.864397:0:8404:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:3.0:1788574237.866839:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:659467ff-94af-418e-92fe-11e4323a48aa+7:2393:x1875455669003136:12345-192.168.204.51@tcp:16:lhsmtool_posix.0 Request processed in 10720us (11193us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574237.866860:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 63 00000100:00100000:3.0:1788574237.870777:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574237.870919:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669003392 00000100:00100000:0.0:1788574237.870933:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669003392 00000100:00100000:0.0:1788574237.871026:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 199 00000100:00100000:0.0:1788574237.871049:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2bdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+19:12372:x1875455669003392:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788574237.871137:0:7439:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574237.871176:0:7439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8cc18 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a1f expref: 19 pid: 11893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.871245:0:7439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9c85fa28cf00) 00010000:00010000:0.0:1788574237.871270:0:7439:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788574237.871316:0:7439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7c00/0x5bf8706fdac8cc2d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.871345:0:7439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7c00/0x5bf8706fdac8cc2d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.871358:0:7439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7c00/0x5bf8706fdac8cc2d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788574237.871550:0:7439:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001a2acb08 reply state 0000000004eaa9ac transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7c00/0x5bf8706fdac8cc2d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.871566:0:7439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7c00/0x5bf8706fdac8cc2d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.871573:0:7439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9c85fa28cf00) 00010000:00010000:0.0:1788574237.871576:0:7439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788574237.871579:0:7439:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788574237.871722:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2bdea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+20:12372:x1875455669003392:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 Request processed in 685us (960us total) trans 4294967463 rc 0/0 00000100:00100000:0.0:1788574237.871731:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 199 00000100:00100000:0.0:1788574237.874997:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574237.875097:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669003520 00000100:00100000:1.0:1788574237.875112:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669003520 00000100:00100000:1.0:1788574237.875237:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 64 00000100:00100000:1.0:1788574237.875251:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c37aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:659467ff-94af-418e-92fe-11e4323a48aa+7:2393:x1875455669003520:12345-192.168.204.51@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788574237.875514:0:8409:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1788574237.875519:0:8409:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1788574237 -> 1788574236 00002000:00010000:1.0:1788574237.875521:0:8409:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1788574234 00002000:00010000:1.0:1788574237.875524:0:8409:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1788574237 -> 1788574236 00002000:00010000:1.0:1788574237.875526:0:8409:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1788574237.875603:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c37aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:659467ff-94af-418e-92fe-11e4323a48aa+8:2393:x1875455669003520:12345-192.168.204.51@tcp:2:lhsmtool_posix.0 Request processed in 354us (620us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1788574237.875612:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 64 00000100:00100000:2.0:1788574237.896319:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574237.897149:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669003776 00000100:00100000:3.0:1788574237.897169:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669003776 00000100:00100000:3.0:1788574237.897403:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 200 00000100:00100000:3.0:1788574237.897418:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+20:12372:x1875455669003776:12345-192.168.204.51@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788574237.897576:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8cc34 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.897607:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617200/0x5bf8706fdac8cbfc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a11 expref: 20 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.897621:0:6493:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8cc34 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.897687:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617200/0x5bf8706fdac8cbfc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a11 expref: 20 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.897711:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617200/0x5bf8706fdac8cbfc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a11 expref: 20 pid: 6493 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574237.897733:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c2bdf100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6493:1875455681650176:192.168.204.51@tcp:104: 00000100:00100000:3.0:1788574237.897903:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c253a840 going to sleep for 11 seconds 00000100:00100000:0.0:1788574237.913213:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574237.913536:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c2bdf100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6493:1875455681650176:192.168.204.51@tcp:104: 00010000:00010000:1.0:1788574237.913584:0:6493:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8cc34 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574237.913637:0:7433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669003904 00000100:00100000:1.0:1788574237.913647:0:7433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669003904 00010000:00010000:1.0:1788574237.913721:0:7433:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617200/0x5bf8706fdac8cbfc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a11 expref: 21 pid: 6493 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574237.913773:0:7433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 90 00000100:00100000:1.0:1788574237.913785:0:7433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c09880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:659467ff-94af-418e-92fe-11e4323a48aa+21:2393:x1875455669003904:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788574237.913810:0:7433:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574237.913818:0:7433:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617200/0x5bf8706fdac8cbfc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a11 expref: 21 pid: 6493 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.913835:0:7433:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617200/0x5bf8706fdac8cbfc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a11 expref: 21 pid: 6493 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.913869:0:7433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617200/0x5bf8706fdac8cbfc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a11 expref: 21 pid: 6493 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.913900:0:7433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9c85fa28cf00) 00010000:00010000:1.0:1788574237.913906:0:7433:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8cc34 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.913921:0:7433:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8cc34 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.913931:0:7433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8cc34 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.913957:0:7433:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788574237.914036:0:7433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c09880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:659467ff-94af-418e-92fe-11e4323a48aa+20:2393:x1875455669003904:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 252us (855us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574237.914044:0:7433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 90 00010000:00010000:1.0:1788574237.914231:0:6493:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8cc34 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.914240:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8cc34 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.914295:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8cc34 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.914304:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8cc34 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.914312:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8cc34 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.914319:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c84c2617000 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:1.0:1788574237.914325:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8cc34 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.914345:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8cc34 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.914356:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9c85fa28cf00) 00010000:00010000:1.0:1788574237.914359:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788574237.914363:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8cc34 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574237.914370:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8cc34 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574237.914426:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+19:12372:x1875455669003776:12345-192.168.204.51@tcp:55:lhsmtool_posix.0 Request processed in 17011us (18123us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788574237.914446:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 200 00000100:00100000:1.0:1788574237.924527:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574237.924623:0:8815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669004032 00000100:00100000:0.0:1788574237.924638:0:8815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669004032 00000100:00100000:0.0:1788574237.924725:0:8815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 65 00000100:00100000:0.0:1788574237.924738:0:8815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:659467ff-94af-418e-92fe-11e4323a48aa+8:2394:x1875455669004032:12345-192.168.204.51@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788574237.924814:0:8815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f3810157/0x5bf8706fdac8cc3b lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.924895:0:8815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ea8df3f9/0x5bf8706fdac8cc26 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a2d expref: 8 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.924907:0:8815:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788574237.924913:0:8815:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788574237.924919:0:8815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3810157/0x5bf8706fdac8cc3b lrc: 4/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.924971:0:8815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ea8df3f9/0x5bf8706fdac8cc26 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a2d expref: 8 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.924990:0:8815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ea8df3f9/0x5bf8706fdac8cc26 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a2d expref: 8 pid: 8409 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574237.925011:0:8815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3722d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8815:1875455681650304:192.168.204.51@tcp:104: 00000100:00100000:0.0:1788574237.925233:0:8815:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85fafee6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788574237.934401:0:8815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3722d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8815:1875455681650304:192.168.204.51@tcp:104: 00010000:00010000:2.0:1788574237.934458:0:8815:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f3810157/0x5bf8706fdac8cc3b lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574237.935300:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574237.935437:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669004160 00000100:00100000:2.0:1788574237.935447:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669004160 00010000:00010000:2.0:1788574237.935504:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ea8df3f9/0x5bf8706fdac8cc26 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a2d expref: 9 pid: 8409 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574237.935585:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 91 00000100:00100000:2.0:1788574237.935598:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3722d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:659467ff-94af-418e-92fe-11e4323a48aa+9:2393:x1875455669004160:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788574237.935620:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788574237.935655:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ea8df3f9/0x5bf8706fdac8cc26 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a2d expref: 9 pid: 8409 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.935672:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ea8df3f9/0x5bf8706fdac8cc26 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a2d expref: 9 pid: 8409 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.935708:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea8df3f9/0x5bf8706fdac8cc26 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a2d expref: 9 pid: 8409 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.935732:0:6477:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788574237.935737:0:6477:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788574237.935744:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f3810157/0x5bf8706fdac8cc3b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.935754:0:6477:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3810157/0x5bf8706fdac8cc3b lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.935791:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788574237.935910:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3722d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:659467ff-94af-418e-92fe-11e4323a48aa+8:2393:x1875455669004160:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 314us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574237.935918:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 91 00010000:00010000:2.0:1788574237.935957:0:8815:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f3810157/0x5bf8706fdac8cc3b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.935967:0:8815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3810157/0x5bf8706fdac8cc3b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.935993:0:8815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f3810157/0x5bf8706fdac8cc3b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.936002:0:8815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f3810157/0x5bf8706fdac8cc3b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.936011:0:8815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f3810157/0x5bf8706fdac8cc3b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.936019:0:8815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d6400 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:2.0:1788574237.936025:0:8815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3810157/0x5bf8706fdac8cc3b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.936035:0:8815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3810157/0x5bf8706fdac8cc3b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.936048:0:8815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f3810157/0x5bf8706fdac8cc3b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.936057:0:8815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3810157/0x5bf8706fdac8cc3b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574237.936129:0:8815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:659467ff-94af-418e-92fe-11e4323a48aa+7:2394:x1875455669004032:12345-192.168.204.51@tcp:1:lhsmtool_posix.0 Request processed in 11393us (11618us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574237.936141:0:8815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 65 00000100:00100000:0.0:1788574237.943246:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574237.943360:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669004416 00000100:00100000:3.0:1788574237.943377:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669004416 00000100:00100000:3.0:1788574237.943467:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 201 00000100:00100000:3.0:1788574237.943482:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3596300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+19:12372:x1875455669004416:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788574237.943625:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8cc42 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.943651:0:6492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152e600/0x5bf8706fdac8ca89 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d69b6 expref: 19 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.943664:0:6492:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8cc42 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.943717:0:6492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152e600/0x5bf8706fdac8ca89 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d69b6 expref: 19 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.943738:0:6492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152e600/0x5bf8706fdac8ca89 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d69b6 expref: 19 pid: 7439 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574237.943757:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c2bdf100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6492:1875455681650432:192.168.204.51@tcp:104: 00000100:00100000:2.0:1788574237.944353:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8600c3af00 going to sleep for 11 seconds 00000100:00100000:2.0:1788574237.963308:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574237.963576:0:7433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669004544 00000100:00100000:3.0:1788574237.963590:0:7433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669004544 00010000:00010000:3.0:1788574237.963650:0:7433:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152e600/0x5bf8706fdac8ca89 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d69b6 expref: 20 pid: 7439 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574237.963715:0:7433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 92 00000100:00100000:3.0:1788574237.963727:0:7433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:659467ff-94af-418e-92fe-11e4323a48aa+20:2394:x1875455669004544:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788574237.963752:0:7433:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574237.963761:0:7433:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152e600/0x5bf8706fdac8ca89 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d69b6 expref: 20 pid: 7439 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.963797:0:7433:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152e600/0x5bf8706fdac8ca89 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d69b6 expref: 20 pid: 7439 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.963828:0:7433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c85d07b8300) 00010000:00010000:3.0:1788574237.963836:0:7433:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8cc42 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.963848:0:7433:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8cc42 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.963857:0:7433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8cc42 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.963882:0:7433:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788574237.963957:0:7433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:659467ff-94af-418e-92fe-11e4323a48aa+20:2394:x1875455669004544:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 231us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574237.963965:0:7433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 92 00010000:00010000:0.0:1788574237.964564:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152e600/0x5bf8706fdac8ca89 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d69b6 expref: 19 pid: 7439 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574237.964594:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c2bdf100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6492:1875455681650432:192.168.204.51@tcp:104: 00010000:00010000:0.0:1788574237.964625:0:6492:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8cc42 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.964654:0:6492:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8cc42 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.964663:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8cc42 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.965022:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8cc49 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.965314:0:6492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8cc0a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a18 expref: 19 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.965326:0:6492:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8cc49 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.965382:0:6492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8cc0a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a18 expref: 19 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574237.965402:0:6492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8cc0a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a18 expref: 19 pid: 6494 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574237.965420:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3649500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6492:1875455681650560:192.168.204.51@tcp:104: 00000100:00100000:0.0:1788574237.965522:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c3320900 going to sleep for 11 seconds 00000100:00100000:2.0:1788574237.969748:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574237.969867:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3649500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6492:1875455681650560:192.168.204.51@tcp:104: 00010000:00010000:0.0:1788574237.969917:0:6492:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8cc49 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574237.970116:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669004672 00000100:00100000:3.0:1788574237.970126:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669004672 00010000:00010000:3.0:1788574237.970174:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8cc0a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a18 expref: 20 pid: 6494 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574237.970255:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 93 00000100:00100000:3.0:1788574237.970267:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e56c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:659467ff-94af-418e-92fe-11e4323a48aa+20:2393:x1875455669004672:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788574237.970289:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574237.970298:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8cc0a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a18 expref: 20 pid: 6494 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.970348:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8cc0a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a18 expref: 20 pid: 6494 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.970380:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8cc0a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a18 expref: 20 pid: 6494 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.970401:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9c85fa28cf00) 00010000:00010000:3.0:1788574237.970407:0:6477:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8cc49 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.970419:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8cc49 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.970428:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8cc49 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.970462:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788574237.970528:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e56c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:659467ff-94af-418e-92fe-11e4323a48aa+19:2393:x1875455669004672:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 263us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574237.970536:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 93 00010000:00010000:2.0:1788574237.974138:0:6492:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8cc49 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.974161:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8cc49 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788574237.974368:0:6492:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:2.0:1788574237.974521:0:6492:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:2.0:1788574237.974560:0:6492:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:2.0:1788574237.974676:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3ea5180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6492:1875455681650688:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788574237.974786:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574237.974854:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85fafee6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788574237.975023:0:7533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681650688 00000100:00100000:3.0:1788574237.975033:0:7533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681650688 00000100:00100000:3.0:1788574237.975100:0:7533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1788574237.975111:0:7533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3ea7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6492:x1875455681650688:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788574237.975265:0:7533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3ea7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6492:x1875455681650688:12345-0@lo:1000:mdt00_000.0 Request processed in 155us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574237.975274:0:7533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1788574237.978623:0:6492:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:2.0:1788574237.978641:0:6492:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c84c3769180, transno 4294967316 00000100:00100000:2.0:1788574237.978674:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3ea5180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6492:1875455681650688:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1788574237.980395:0:6492:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:2.0:1788574237.980507:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3ea5180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6492:1875455681650816:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788574237.980608:0:6492:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574237.980653:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85fa1f1900 going to sleep for 11 seconds 00000100:00100000:0.0:1788574237.981009:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681650816 00000100:00100000:0.0:1788574237.981035:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681650816 00000100:00100000:0.0:1788574237.981104:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1788574237.981116:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3ea5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6492:x1875455681650816:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788574237.981347:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3ea5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6492:x1875455681650816:12345-0@lo:1000:mdt00_000.0 Request processed in 221us (726us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1788574237.981358:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1788574237.982136:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3ea5180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6492:1875455681650816:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1788574237.982301:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8cc49 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.983797:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8cc49 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.983811:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8cc49 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.983817:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d7200 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:2.0:1788574237.983823:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8cc49 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.983833:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8cc49 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.983856:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9c85fa28cf00) 00010000:00010000:2.0:1788574237.983859:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788574237.983866:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8cc49 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.983873:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8cc49 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.983924:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8cb85 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.983931:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8cb85 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.983937:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8cb85 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.983954:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85faea2000 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:2.0:1788574237.983958:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8cb85 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.983964:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8cb85 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.983975:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c85d07b8300) 00010000:00010000:2.0:1788574237.983977:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788574237.983981:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8cb85 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.983987:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8cb85 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.984018:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8cc50 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.984038:0:6492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8cba1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d69fc expref: 22 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.984049:0:6492:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8cc50 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.984103:0:6492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8cba1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d69fc expref: 22 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574237.984123:0:6492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8cba1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d69fc expref: 22 pid: 6494 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574237.984153:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8ab1500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6492:1875455681650944:192.168.204.51@tcp:104: 00000100:00100000:2.0:1788574237.984311:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85fa1f1900 going to sleep for 11 seconds 00000100:00100000:0.0:1788574237.995930:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574237.996011:0:7433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669004800 00000100:00100000:3.0:1788574237.996023:0:7433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669004800 00010000:00010000:3.0:1788574237.996099:0:7433:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8cba1 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d69fc expref: 23 pid: 6494 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574237.996155:0:7433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 94 00000100:00100000:3.0:1788574237.996166:0:7433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3649500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:659467ff-94af-418e-92fe-11e4323a48aa+23:2394:x1875455669004800:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788574237.996213:0:7433:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574237.996222:0:7433:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8cba1 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d69fc expref: 23 pid: 6494 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.996239:0:7433:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8cba1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d69fc expref: 23 pid: 6494 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.996271:0:7433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c85d07b8300) 00010000:00010000:3.0:1788574237.996277:0:7433:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8cc50 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.996290:0:7433:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8cc50 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.996299:0:7433:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8cc50 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574237.996323:0:7433:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788574238.000000:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8cba1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d69fc expref: 23 pid: 6494 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574238.000034:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8ab1500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6492:1875455681650944:192.168.204.51@tcp:104: 00010000:00010000:0.0:1788574238.000067:0:6492:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8cc50 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574238.000079:0:6492:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8cc50 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574238.000085:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8cc50 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574238.000102:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8cc50 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574238.000109:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8cc50 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574238.000117:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8cc50 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574238.000125:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32e000 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:0.0:1788574238.000143:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8cc50 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574238.000153:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8cc50 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574238.000175:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c85d07b8300) 00010000:00010000:0.0:1788574238.000180:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574238.000185:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8cc50 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574238.000214:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8cc50 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574238.000227:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8cc42 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574238.000234:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8cc42 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574238.000239:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8cc42 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574238.000244:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c84c2617400 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:0.0:1788574238.000247:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8cc42 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574238.000254:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8cc42 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574238.000262:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c85d07b8300) 00010000:00010000:0.0:1788574238.000264:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788574238.000274:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8cc42 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574238.000280:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8cc42 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788574238.000752:0:13764:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788574238.000759:0:13764:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788574238.001281:0:13764:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:2.0:1788574238.001293:0:13764:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788574238.003478:0:7433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3649500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:659467ff-94af-418e-92fe-11e4323a48aa+22:2394:x1875455669004800:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 7293us (7541us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574238.003499:0:7433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 94 00000100:00100000:0.0:1788574238.003740:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3596300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+21:12372:x1875455669004416:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 Request processed in 60260us (60507us total) trans 4294967468 rc 0/0 00000100:00100000:0.0:1788574238.003753:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 201 00000020:00080000:0.0:1788574238.003759:0:6492:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1788574238.014977:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574238.015093:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669005056 00000100:00100000:3.0:1788574238.015126:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669005056 00000100:00100000:3.0:1788574238.015266:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 50 00000100:00100000:3.0:1788574238.015280:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85d01f4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:659467ff-94af-418e-92fe-11e4323a48aa+21:12372:x1875455669005056:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788574238.015713:0:6496:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788574238.015766:0:6496:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:3.0:1788574238.015814:0:6496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617600/0x5bf8706fdac8cc57 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574238.015840:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617600/0x5bf8706fdac8cc57 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574238.015858:0:6496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617600/0x5bf8706fdac8cc57 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574238.015869:0:6496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617600/0x5bf8706fdac8cc57 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574238.015877:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617600/0x5bf8706fdac8cc57 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574238.015885:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617600/0x5bf8706fdac8cc57 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574238.015911:0:6496:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788574238.016038:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85d01f4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:659467ff-94af-418e-92fe-11e4323a48aa+23:12372:x1875455669005056:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 Request processed in 759us (1077us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1788574238.016047:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 50 00000020:00080000:3.0:1788574238.016053:0:6496:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788574238.016216:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788574238.016226:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617600/0x5bf8706fdac8cc57 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574238.016234:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c84c2617600 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:2.0:1788574238.016240:0:6481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617600/0x5bf8706fdac8cc57 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574238.016250:0:6481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617600/0x5bf8706fdac8cc57 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574238.016266:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9c85fa28cf00) 00010000:00010000:2.0:1788574238.016270:0:6481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788574238.016276:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617600/0x5bf8706fdac8cc57 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574238.016284:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617600/0x5bf8706fdac8cc57 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6496 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574238.016301:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574238.016303:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574238.016305:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788574238.016804:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788574238.356850:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788574238.686895:0:14634:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788574238.686907:0:14634:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788574238.686941:0:14634:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1788574238.686961:0:14634:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788574238.826099:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574238.839350:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669005312 00000100:00100000:2.0:1788574238.839373:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669005312 00000100:00100000:2.0:1788574238.839465:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 202 00000100:00100000:2.0:1788574238.839479:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+23:12382:x1875455669005312:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:2.0:1788574238.840471:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574238.840511:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8cc5e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6a34 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574238.841463:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f400/0x5bf8706fdac8cc65 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574238.841486:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f400/0x5bf8706fdac8cc65 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574238.841501:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f400/0x5bf8706fdac8cc65 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788574238.842362:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1788574238.843300:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8cc5e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a34 expref: 26 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574238.843340:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f400/0x5bf8706fdac8cc65 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a34 expref: 25 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574238.843352:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c85d07b8d00) 00010000:00010000:2.0:1788574238.843355:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788574238.843359:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85fa32f400, rc 0) 00000100:00100000:2.0:1788574238.843455:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+25:12382:x1875455669005312:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 3978us (17369us total) trans 4294967471 rc 0/0 00000100:00100000:2.0:1788574238.843478:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 202 00000100:00100000:0.0:1788574238.848048:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574238.848516:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669005440 00000100:00100000:2.0:1788574238.848538:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669005440 00000100:00100000:2.0:1788574238.848630:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 203 00000100:00100000:2.0:1788574238.848644:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3769180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+25:12382:x1875455669005440:12345-192.168.204.51@tcp:34:lfs.0 00010000:00010000:2.0:1788574238.848780:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fa00/0x5bf8706fdac8cc73 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574238.848805:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fa00/0x5bf8706fdac8cc73 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574238.848824:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fa00/0x5bf8706fdac8cc73 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574238.848846:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8cc7a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574238.848854:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8cc7a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574238.848861:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8cc7a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574238.849395:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ec00/0x5bf8706fdac8cc81 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574238.849406:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ec00/0x5bf8706fdac8cc81 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574238.849414:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ec00/0x5bf8706fdac8cc81 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788574238.849499:0:6493:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ec00/0x5bf8706fdac8cc81 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574238.849670:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fa00/0x5bf8706fdac8cc73 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574238.849679:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fa00/0x5bf8706fdac8cc73 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574238.849687:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fa00/0x5bf8706fdac8cc73 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574238.849693:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32fa00 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:2.0:1788574238.849699:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fa00/0x5bf8706fdac8cc73 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574238.849709:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fa00/0x5bf8706fdac8cc73 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574238.849726:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c85d07b8d00) 00010000:00010000:2.0:1788574238.849731:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788574238.849738:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fa00/0x5bf8706fdac8cc73 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574238.849746:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fa00/0x5bf8706fdac8cc73 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574238.849762:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8cc7a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574238.849769:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8cc7a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574238.849783:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8cc7a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574238.849789:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32fe00 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:2.0:1788574238.849792:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8cc7a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574238.849799:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8cc7a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574238.849808:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c85c4fa6000) 00010000:00010000:2.0:1788574238.849811:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788574238.849814:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8cc7a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574238.849820:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8cc7a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574238.849836:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ec00/0x5bf8706fdac8cc81 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574238.849843:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ec00/0x5bf8706fdac8cc81 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574238.849849:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ec00/0x5bf8706fdac8cc81 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574238.849854:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32ec00 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:2.0:1788574238.849857:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ec00/0x5bf8706fdac8cc81 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574238.849874:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ec00/0x5bf8706fdac8cc81 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574238.849883:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c85c4fa6600) 00010000:00010000:2.0:1788574238.849885:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788574238.849888:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ec00/0x5bf8706fdac8cc81 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574238.849893:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ec00/0x5bf8706fdac8cc81 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574238.850468:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3769180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+25:12382:x1875455669005440:12345-192.168.204.51@tcp:34:lfs.0 Request processed in 1820us (2428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574238.850482:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 203 00000100:00100000:0.0:1788574238.905676:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574238.906122:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669005696 00000100:00100000:3.0:1788574238.906137:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669005696 00000100:00100000:3.0:1788574238.906237:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 204 00000100:00100000:3.0:1788574238.906250:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffafca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+25:12386:x1875455669005696:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:3.0:1788574238.906281:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574238.906314:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616200/0x5bf8706fdac8cc88 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6a3b expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574238.906433:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617a00/0x5bf8706fdac8cc8f lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574238.906452:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617a00/0x5bf8706fdac8cc8f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574238.906467:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617a00/0x5bf8706fdac8cc8f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574238.906484:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617800/0x5bf8706fdac8cc96 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574238.906493:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617800/0x5bf8706fdac8cc96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574238.906500:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617800/0x5bf8706fdac8cc96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574238.906656:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616a00/0x5bf8706fdac8cc9d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574238.906666:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616a00/0x5bf8706fdac8cc9d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574238.906693:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616a00/0x5bf8706fdac8cc9d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788574238.906707:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:3.0:1788574238.907076:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617a00/0x5bf8706fdac8cc8f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574238.907086:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617a00/0x5bf8706fdac8cc8f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574238.907094:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617a00/0x5bf8706fdac8cc8f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574238.907101:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c84c2617a00 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:3.0:1788574238.907107:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617a00/0x5bf8706fdac8cc8f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574238.907117:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617a00/0x5bf8706fdac8cc8f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574238.907133:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c85d07b8d00) 00010000:00010000:3.0:1788574238.907136:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574238.907142:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617a00/0x5bf8706fdac8cc8f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574238.907149:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617a00/0x5bf8706fdac8cc8f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574238.907160:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617800/0x5bf8706fdac8cc96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574238.907165:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617800/0x5bf8706fdac8cc96 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574238.907179:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617800/0x5bf8706fdac8cc96 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574238.907184:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c84c2617800 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:3.0:1788574238.907187:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617800/0x5bf8706fdac8cc96 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574238.907216:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617800/0x5bf8706fdac8cc96 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574238.907225:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c85fa28cb00) 00010000:00010000:3.0:1788574238.907227:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574238.907230:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617800/0x5bf8706fdac8cc96 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574238.907236:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617800/0x5bf8706fdac8cc96 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574238.907291:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616200/0x5bf8706fdac8cc88 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a3b expref: 28 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574238.907309:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616a00/0x5bf8706fdac8cc9d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a3b expref: 27 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574238.907327:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c85fa28c400) 00010000:00010000:3.0:1788574238.907329:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788574238.907333:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c84c2616a00, rc 0) 00000100:00100000:3.0:1788574238.907476:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffafca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+27:12386:x1875455669005696:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 1227us (1817us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1788574238.907495:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 204 00000100:00100000:1.0:1788574238.916548:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574238.916658:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669005824 00000100:00100000:3.0:1788574238.916673:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669005824 00000100:00100000:3.0:1788574238.916748:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 205 00000100:00100000:3.0:1788574238.916759:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3008a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+27:12386:x1875455669005824:12345-192.168.204.51@tcp:54:lfs.0 00010000:00010000:3.0:1788574238.916873:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617600/0x5bf8706fdac8ccab lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574238.916897:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617600/0x5bf8706fdac8ccab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574238.916914:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617600/0x5bf8706fdac8ccab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574238.916967:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617600/0x5bf8706fdac8ccab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574238.916976:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617600/0x5bf8706fdac8ccab lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574238.916984:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617600/0x5bf8706fdac8ccab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574238.916992:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c84c2617600 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:3.0:1788574238.916997:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617600/0x5bf8706fdac8ccab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574238.917005:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617600/0x5bf8706fdac8ccab lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574238.917019:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c85fa28c400) 00010000:00010000:3.0:1788574238.917036:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788574238.917043:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617600/0x5bf8706fdac8ccab lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574238.917050:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617600/0x5bf8706fdac8ccab lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574238.917149:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3008a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+27:12386:x1875455669005824:12345-192.168.204.51@tcp:54:lfs.0 Request processed in 389us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574238.917157:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 205 00000100:00100000:0.0:1788574238.924941:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574238.924986:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669006080 00000100:00100000:0.0:1788574238.924999:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669006080 00000100:00100000:0.0:1788574238.925070:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 51 00000100:00100000:0.0:1788574238.925083:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffafea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:659467ff-94af-418e-92fe-11e4323a48aa+27:12386:x1875455669006080:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:0.0:1788574238.925439:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffafea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:659467ff-94af-418e-92fe-11e4323a48aa+28:12386:x1875455669006080:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 358us (508us total) trans 4294967473 rc 0/0 00000100:00100000:0.0:1788574238.925449:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 51 00000100:00100000:3.0:1788574238.965264:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574238.965337:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669006336 00000100:00100000:3.0:1788574238.965350:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669006336 00000100:00100000:3.0:1788574238.965422:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 206 00000100:00100000:3.0:1788574238.965435:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2bdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+28:11917:x1875455669006336:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:3.0:1788574238.965466:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574238.965493:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617600/0x5bf8706fdac8ccb2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6a42 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574238.965647:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616200/0x5bf8706fdac8ccb9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574238.965665:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616a00/0x5bf8706fdac8cc9d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a3b expref: 29 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574238.965676:0:6493:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616200/0x5bf8706fdac8ccb9 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574238.965718:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616a00/0x5bf8706fdac8cc9d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a3b expref: 29 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574238.965760:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616a00/0x5bf8706fdac8cc9d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a3b expref: 29 pid: 6492 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574238.965776:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c2bdf100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6493:1875455681651072:192.168.204.51@tcp:104: 00000100:00100000:3.0:1788574238.966162:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8600c3a240 going to sleep for 11 seconds 00000100:00100000:3.0:1788574238.969408:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c2bdf100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6493:1875455681651072:192.168.204.51@tcp:104: 00010000:00010000:3.0:1788574238.969448:0:6493:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616200/0x5bf8706fdac8ccb9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574238.969785:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574238.970443:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669006464 00000100:00100000:3.0:1788574238.970454:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669006464 00010000:00010000:3.0:1788574238.970502:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616a00/0x5bf8706fdac8cc9d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a3b expref: 30 pid: 6492 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574238.970602:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 95 00000100:00100000:3.0:1788574238.970613:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c300b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:659467ff-94af-418e-92fe-11e4323a48aa+30:2393:x1875455669006464:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788574238.970635:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574238.970644:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616a00/0x5bf8706fdac8cc9d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a3b expref: 30 pid: 6492 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574238.970657:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616a00/0x5bf8706fdac8cc9d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a3b expref: 30 pid: 6492 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574238.970685:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616a00/0x5bf8706fdac8cc9d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a3b expref: 30 pid: 6492 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574238.970718:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c85fa28c400) 00010000:00010000:3.0:1788574238.970723:0:6477:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616200/0x5bf8706fdac8ccb9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574238.970734:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616200/0x5bf8706fdac8ccb9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574238.970742:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616200/0x5bf8706fdac8ccb9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574238.970769:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788574238.970847:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c300b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:659467ff-94af-418e-92fe-11e4323a48aa+29:2393:x1875455669006464:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 235us (1064us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574238.970854:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 95 00010000:00010000:1.0:1788574238.970931:0:6493:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616200/0x5bf8706fdac8ccb9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574238.970940:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616200/0x5bf8706fdac8ccb9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788574238.970964:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:1.0:1788574238.971158:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617600/0x5bf8706fdac8ccb2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a42 expref: 30 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574238.971186:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616200/0x5bf8706fdac8ccb9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a42 expref: 29 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574238.971223:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c85fa28c400) 00010000:00010000:1.0:1788574238.971226:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788574238.971229:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c84c2616200, rc 0) 00000100:00100000:1.0:1788574238.971257:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2bdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+29:11917:x1875455669006336:12345-192.168.204.51@tcp:101:bash.0 Request processed in 5825us (6010us total) trans 4294967474 rc 0/0 00000100:00100000:1.0:1788574238.971265:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 206 00000100:00100000:1.0:1788574238.975430:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574238.975513:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669006592 00000100:00100000:3.0:1788574238.975524:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669006592 00000100:00100000:3.0:1788574238.975593:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 207 00000100:00100000:3.0:1788574238.975605:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c300ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+29:11917:x1875455669006592:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:3.0:1788574238.975640:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574238.975669:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617800/0x5bf8706fdac8ccc7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6a49 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574238.975717:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617a00/0x5bf8706fdac8ccce lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574238.975735:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617a00/0x5bf8706fdac8ccce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574238.975750:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617a00/0x5bf8706fdac8ccce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574238.975925:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617800/0x5bf8706fdac8ccc7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a49 expref: 31 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574238.975944:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617a00/0x5bf8706fdac8ccce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a49 expref: 30 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574238.975955:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c85fa28c400) 00010000:00010000:3.0:1788574238.975959:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788574238.975964:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c84c2617a00, rc 0) 00000100:00100000:3.0:1788574238.976055:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c300ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+30:11917:x1875455669006592:12345-192.168.204.51@tcp:101:bash.0 Request processed in 452us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574238.976063:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 207 00000100:00100000:3.0:1788574238.982924:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574238.983053:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669006848 00000100:00100000:0.0:1788574238.983067:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669006848 00000100:00100000:0.0:1788574238.983154:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 208 00000100:00100000:0.0:1788574238.983167:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2bdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+30:11917:x1875455669006848:12345-192.168.204.51@tcp:36:bash.0 00010000:00010000:0.0:1788574238.983529:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8ccd5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574238.983552:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8ccd5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574238.983568:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8ccd5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788574238.983639:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:0.0:1788574238.983665:0:6494:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bc1877ad reply state 00000000f8c58ceb transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8ccd5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574238.983679:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8ccd5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574238.983688:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c85fa28c400) 00010000:00010000:0.0:1788574238.983692:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788574238.983696:0:6494:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1788574238.983738:0:6494:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:0.0:1788574238.983869:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2bdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+34:11917:x1875455669006848:12345-192.168.204.51@tcp:36:bash.0 Request processed in 703us (960us total) trans 4294967477 rc 0/0 00000100:00100000:0.0:1788574238.983879:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 208 00000020:00080000:0.0:1788574238.983885:0:6494:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1788574238.986045:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574238.986229:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669006976 00000100:00100000:1.0:1788574238.986243:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669006976 00000100:00100000:1.0:1788574238.986326:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 209 00000100:00100000:1.0:1788574238.986347:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+34:11917:x1875455669006976:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:1.0:1788574238.986377:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574238.986398:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8ccdc lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6a50 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574238.986468:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8ccdc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a50 expref: 35 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574238.986485:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8ccdc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a50 expref: 35 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574238.986506:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c85fa28c400) 00010000:00010000:1.0:1788574238.986509:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788574238.986513:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85faea3e00, rc 0) 00000100:00100000:1.0:1788574238.986589:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+35:11917:x1875455669006976:12345-192.168.204.51@tcp:101:bash.0 Request processed in 244us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574238.986597:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 209 00000100:00100000:1.0:1788574238.996861:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574238.996928:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669007104 00000100:00100000:1.0:1788574238.996941:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669007104 00000100:00100000:1.0:1788574238.997032:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 66 00000100:00100000:1.0:1788574238.997045:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c300a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:659467ff-94af-418e-92fe-11e4323a48aa+7:11917:x1875455669007104:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:1.0:1788574238.997071:0:8411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574238.997101:0:8411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e240f75a/0x5bf8706fdac8cce3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6a57 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788574238.997139:0:8411:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a9b7a1c, atime: 0x6a9b7a1a, ctime: 0x6a9b7a1c, blocks: 0x8 00010000:00010000:1.0:1788574238.997223:0:8411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=378s v=(0 0) 00010000:00010000:1.0:1788574238.997229:0:8411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574238.997239:0:8411:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e240f75a/0x5bf8706fdac8cce3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a57 expref: 8 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574238.997261:0:8411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e240f75a/0x5bf8706fdac8cce3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a57 expref: 8 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574238.997277:0:8411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85faea2c00, rc 0) 00000100:00100000:1.0:1788574238.997366:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c300a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:659467ff-94af-418e-92fe-11e4323a48aa+8:11917:x1875455669007104:12345-192.168.204.51@tcp:101:bash.0 Request processed in 324us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574238.997374:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 66 00000100:00080000:1.0:1788574238.997403:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788574239.002637:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574239.002734:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669007232 00000100:00100000:3.0:1788574239.002747:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669007232 00002000:00010000:3.0:1788574239.002810:0:8414:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:3.0:1788574239.002815:0:8414:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c85ffafdc00 with x1875455669007232 ext(0->18446744073709551615) 00002000:00010000:3.0:1788574239.002832:0:8414:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c85ffafdc00. 00000100:00100000:3.0:1788574239.002881:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 5 00000100:00100000:3.0:1788574239.002892:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffafdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:659467ff-94af-418e-92fe-11e4323a48aa+8:2393:x1875455669007232:12345-192.168.204.51@tcp:10:bash.0 00002000:00010000:3.0:1788574239.003288:0:8414:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1788574239.003292:0:8414:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1788574236 -> 1788574238 00002000:00010000:3.0:1788574239.003295:0:8414:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 1788574234 -> 1788574234 00002000:00010000:3.0:1788574239.003298:0:8414:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1788574236 -> 1788574238 00002000:00010000:3.0:1788574239.003325:0:8414:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:3.0:1788574239.003415:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffafdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:659467ff-94af-418e-92fe-11e4323a48aa+9:2393:x1875455669007232:12345-192.168.204.51@tcp:10:bash.0 Request processed in 522us (786us total) trans 4294967319 rc 0/0 00000100:00100000:3.0:1788574239.003425:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 5 00002000:00010000:3.0:1788574239.003430:0:8414:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:3.0:1788574239.003433:0:8414:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c85ffafdc00 with x1875455669007232 ext(0->18446744073709551615) 00002000:00010000:3.0:1788574239.003439:0:8414:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c85ffafdc00. 00000100:00100000:0.0:1788574239.062969:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574239.063366:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669007360 00000100:00100000:2.0:1788574239.063383:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669007360 00000100:00100000:2.0:1788574239.063585:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 210 00000100:00100000:2.0:1788574239.063599:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3f24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+35:12400:x1875455669007360:12345-192.168.204.51@tcp:34:lfs.0 00010000:00010000:2.0:1788574239.063895:0:7439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8ccea lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574239.063921:0:7439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8ccea lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574239.063942:0:7439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8ccea lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574239.063963:0:7439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fa00/0x5bf8706fdac8ccf1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574239.063971:0:7439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fa00/0x5bf8706fdac8ccf1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574239.063978:0:7439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fa00/0x5bf8706fdac8ccf1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574239.064333:0:7439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8ccf8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574239.064345:0:7439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8ccf8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574239.064353:0:7439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8ccf8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788574239.064430:0:7439:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8ccf8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574239.064444:0:7439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8ccea lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574239.064452:0:7439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8ccea lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574239.064459:0:7439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8ccea lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574239.064465:0:7439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32fe00 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:2.0:1788574239.064471:0:7439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8ccea lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574239.064480:0:7439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8ccea lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574239.064494:0:7439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c85d07b8d00) 00010000:00010000:2.0:1788574239.064498:0:7439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788574239.064503:0:7439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8ccea lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574239.064518:0:7439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8ccea lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574239.064535:0:7439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fa00/0x5bf8706fdac8ccf1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574239.064542:0:7439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fa00/0x5bf8706fdac8ccf1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574239.064547:0:7439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fa00/0x5bf8706fdac8ccf1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574239.064552:0:7439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32fa00 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:2.0:1788574239.064555:0:7439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fa00/0x5bf8706fdac8ccf1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574239.064562:0:7439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fa00/0x5bf8706fdac8ccf1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574239.064569:0:7439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c85c4fa6600) 00010000:00010000:2.0:1788574239.064572:0:7439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788574239.064575:0:7439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fa00/0x5bf8706fdac8ccf1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574239.064581:0:7439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fa00/0x5bf8706fdac8ccf1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574239.064598:0:7439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8ccf8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574239.064604:0:7439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8ccf8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574239.064743:0:7439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8ccf8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574239.064749:0:7439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32e000 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:2.0:1788574239.064751:0:7439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8ccf8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574239.064757:0:7439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8ccf8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574239.064765:0:7439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c85fa28c400) 00010000:00010000:2.0:1788574239.064768:0:7439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788574239.064772:0:7439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8ccf8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574239.064778:0:7439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e000/0x5bf8706fdac8ccf8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574239.065033:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3f24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+35:12400:x1875455669007360:12345-192.168.204.51@tcp:34:lfs.0 Request processed in 1433us (2077us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574239.065054:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 210 00000100:00100000:1.0:1788574239.116741:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574239.116980:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669007616 00000100:00100000:0.0:1788574239.116995:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669007616 00000100:00100000:0.0:1788574239.117075:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 211 00000100:00100000:0.0:1788574239.117088:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3008380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+35:12403:x1875455669007616:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:0.0:1788574239.117143:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574239.117175:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8ccff lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6a5e expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574239.117352:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8cd06 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574239.117372:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8cd06 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574239.117388:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8cd06 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574239.117409:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8cd0d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574239.117416:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8cd0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574239.117424:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8cd0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574239.117738:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152e600/0x5bf8706fdac8cd14 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574239.117749:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152e600/0x5bf8706fdac8cd14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574239.117757:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152e600/0x5bf8706fdac8cd14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788574239.117768:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788574239.118009:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8cd06 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574239.118019:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8cd06 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574239.118026:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8cd06 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574239.118033:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d7e00 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:0.0:1788574239.118038:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8cd06 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574239.118047:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8cd06 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574239.118062:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c85d07b8d00) 00010000:00010000:0.0:1788574239.118066:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574239.118071:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8cd06 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574239.118078:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8cd06 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574239.118095:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8cd0d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574239.118102:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8cd0d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574239.118109:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8cd0d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574239.118114:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d6600 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:0.0:1788574239.118124:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8cd0d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574239.118132:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8cd0d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574239.118141:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c85d07b8300) 00010000:00010000:0.0:1788574239.118144:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574239.118147:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8cd0d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574239.118153:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8cd0d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574239.118253:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8ccff lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a5e expref: 38 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574239.118269:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152e600/0x5bf8706fdac8cd14 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a5e expref: 37 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574239.118276:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c85fa28c400) 00010000:00010000:0.0:1788574239.118279:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788574239.118282:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85c152e600, rc 0) 00000100:00100000:0.0:1788574239.118391:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3008380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+37:12403:x1875455669007616:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 1306us (1668us total) trans 4294967478 rc 0/0 00000100:00100000:0.0:1788574239.118400:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 211 00000100:00100000:0.0:1788574239.127931:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574239.128107:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669007744 00000100:00100000:3.0:1788574239.128123:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669007744 00000100:00100000:3.0:1788574239.128244:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 212 00000100:00100000:3.0:1788574239.128257:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3f25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+37:12403:x1875455669007744:12345-192.168.204.51@tcp:54:lfs.0 00010000:00010000:3.0:1788574239.128382:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617800/0x5bf8706fdac8cd22 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574239.128406:0:6492:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616200/0x5bf8706fdac8ccb9 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a42 expref: 37 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574239.128420:0:6492:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617800/0x5bf8706fdac8cd22 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574239.128467:0:6492:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616200/0x5bf8706fdac8ccb9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a42 expref: 37 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574239.128483:0:6492:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616200/0x5bf8706fdac8ccb9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a42 expref: 37 pid: 6493 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574239.128500:0:6492:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3723b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6492:1875455681651200:192.168.204.51@tcp:104: 00000100:00100000:3.0:1788574239.128672:0:6492:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8600c3a240 going to sleep for 11 seconds 00000100:00100000:0.0:1788574239.132535:0:6492:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3723b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6492:1875455681651200:192.168.204.51@tcp:104: 00010000:00010000:0.0:1788574239.132631:0:6492:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617800/0x5bf8706fdac8cd22 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574239.134393:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574239.134757:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669008000 00000100:00100000:3.0:1788574239.134775:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669008000 00000100:00100000:3.0:1788574239.135795:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 52 00000100:00100000:3.0:1788574239.135846:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3f27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:659467ff-94af-418e-92fe-11e4323a48aa+38:6161:x1875455669008000:12345-192.168.204.51@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788574239.142833:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3f27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:659467ff-94af-418e-92fe-11e4323a48aa+39:6161:x1875455669008000:12345-192.168.204.51@tcp:35:ldlm_bl.0 Request processed in 6993us (8439us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1788574239.142850:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 52 00000100:00100000:3.0:1788574239.152489:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574239.152641:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669008128 00000100:00100000:0.0:1788574239.152655:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669008128 00010000:00010000:0.0:1788574239.152720:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616200/0x5bf8706fdac8ccb9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a42 expref: 39 pid: 6493 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574239.152775:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 96 00000100:00100000:0.0:1788574239.152788:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e0bdf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:659467ff-94af-418e-92fe-11e4323a48aa+39:2393:x1875455669008128:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788574239.152819:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574239.152827:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616200/0x5bf8706fdac8ccb9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a42 expref: 39 pid: 6493 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574239.152844:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616200/0x5bf8706fdac8ccb9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a42 expref: 39 pid: 6493 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574239.153475:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616200/0x5bf8706fdac8ccb9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a42 expref: 39 pid: 6493 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574239.153504:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c85fa28c400) 00010000:00010000:0.0:1788574239.153510:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617800/0x5bf8706fdac8cd22 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574239.153523:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617800/0x5bf8706fdac8cd22 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574239.153532:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617800/0x5bf8706fdac8cd22 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574239.153599:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574239.153706:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e0bdf050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:659467ff-94af-418e-92fe-11e4323a48aa+38:2393:x1875455669008128:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 919us (1232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574239.153716:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 96 00010000:00010000:1.0:1788574239.163245:0:6492:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617800/0x5bf8706fdac8cd22 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.163269:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617800/0x5bf8706fdac8cd22 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.163345:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617800/0x5bf8706fdac8cd22 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.163355:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617800/0x5bf8706fdac8cd22 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.163364:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617800/0x5bf8706fdac8cd22 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.163371:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c84c2617800 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:1.0:1788574239.163403:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617800/0x5bf8706fdac8cd22 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.163414:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617800/0x5bf8706fdac8cd22 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.163438:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c85fa28c400) 00010000:00010000:1.0:1788574239.163442:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788574239.163448:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617800/0x5bf8706fdac8cd22 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.163456:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617800/0x5bf8706fdac8cd22 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574239.163590:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3f25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+37:12403:x1875455669007744:12345-192.168.204.51@tcp:54:lfs.0 Request processed in 35329us (35667us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574239.163602:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 212 00000100:00100000:3.0:1788574239.169467:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574239.169754:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669008384 00000100:00100000:0.0:1788574239.169767:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669008384 00000100:00100000:0.0:1788574239.169846:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 53 00000100:00100000:0.0:1788574239.169860:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3722d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:659467ff-94af-418e-92fe-11e4323a48aa+37:12403:x1875455669008384:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:0.0:1788574239.170186:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3722d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:659467ff-94af-418e-92fe-11e4323a48aa+38:12403:x1875455669008384:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 328us (732us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1788574239.170216:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 53 00000100:00100000:2.0:1788574239.307299:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574239.307363:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574239.307490:0:13791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669008640 00000100:00100000:1.0:1788574239.307502:0:13791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669008640 00000100:00100000:1.0:1788574239.307579:0:13791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 67 00000100:00100000:1.0:1788574239.307591:0:13791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8ab1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:659467ff-94af-418e-92fe-11e4323a48aa+9:2395:x1875455669008640:12345-192.168.204.51@tcp:16:kworker.0 00000100:00100000:0.0:1788574239.308233:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669008512 00000100:00100000:0.0:1788574239.308241:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669008512 00002000:00100000:0.0:1788574239.308282:0:8415:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x5:0x0] (0->7) req@ffff9c85c8ab3800 x1875455669008512/t0(0) o4->659467ff-94af-418e-92fe-11e4323a48aa@192.168.204.51@tcp:390/0 lens 496/0 e 0 to 0 dl 1788574250 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788574239.308295:0:8415:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c85c8ab3800 with x1875455669008512 ext(0->7) 00002000:00010000:0.0:1788574239.308303:0:8415:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c85c8ab3800 00000100:00100000:0.0:1788574239.308341:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 6 00000100:00100000:0.0:1788574239.308350:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8ab3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:659467ff-94af-418e-92fe-11e4323a48aa+10:2395:x1875455669008512:12345-192.168.204.51@tcp:4:bash.0 00000001:00080000:1.0:1788574239.310591:0:8404:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967319 is committed 00000001:00080000:1.0:1788574239.310609:0:8404:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967318 is committed 00000100:00100000:0.0:1788574239.311131:0:13791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8ab1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:659467ff-94af-418e-92fe-11e4323a48aa+10:2395:x1875455669008640:12345-192.168.204.51@tcp:16:kworker.0 Request processed in 3527us (3751us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574239.311146:0:13791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 67 00000100:00100000:3.0:1788574239.312464:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8ab3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:659467ff-94af-418e-92fe-11e4323a48aa+9:2395:x1875455669008512:12345-192.168.204.51@tcp:4:bash.0 Request processed in 4105us (5170us total) trans 4294967320 rc 0/0 00000100:00100000:3.0:1788574239.312479:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 6 00002000:00100000:3.0:1788574239.312495:0:8415:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x5:0x0] (0->7) req@ffff9c85c8ab3800 x1875455669008512/t4294967320(0) o4->659467ff-94af-418e-92fe-11e4323a48aa@192.168.204.51@tcp:390/0 lens 496/448 e 0 to 0 dl 1788574250 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788574239.312506:0:8415:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c85c8ab3800 with x1875455669008512 ext(0->7) 00002000:00010000:3.0:1788574239.312514:0:8415:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c85c8ab3800 00000100:00100000:2.0:1788574239.339114:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574239.339243:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669008896 00000100:00100000:0.0:1788574239.339258:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669008896 00000100:00100000:0.0:1788574239.339372:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 213 00000100:00100000:0.0:1788574239.339385:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8ab1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+38:12414:x1875455669008896:12345-192.168.204.51@tcp:101:cat.0 00010000:00010000:0.0:1788574239.339417:0:7439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574239.339461:0:7439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f600/0x5bf8706fdac8cd29 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6a65 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574239.339568:0:7439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8cd30 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574239.339589:0:7439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8cd30 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574239.339603:0:7439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8cd30 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574239.339621:0:7439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152e000/0x5bf8706fdac8cd37 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574239.339629:0:7439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152e000/0x5bf8706fdac8cd37 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574239.339636:0:7439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152e000/0x5bf8706fdac8cd37 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574239.339770:0:7439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152ee00/0x5bf8706fdac8cd3e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574239.339780:0:7439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152ee00/0x5bf8706fdac8cd3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574239.339787:0:7439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152ee00/0x5bf8706fdac8cd3e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788574239.339811:0:7439:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:0.0:1788574239.339915:0:7439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8cd30 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574239.339924:0:7439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8cd30 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574239.339932:0:7439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8cd30 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574239.339939:0:7439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85c152f400 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:0.0:1788574239.339944:0:7439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8cd30 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574239.339953:0:7439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8cd30 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574239.339968:0:7439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c85d07b8d00) 00010000:00010000:0.0:1788574239.339972:0:7439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574239.339977:0:7439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8cd30 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574239.339984:0:7439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8cd30 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574239.340002:0:7439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152e000/0x5bf8706fdac8cd37 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574239.340009:0:7439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152e000/0x5bf8706fdac8cd37 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574239.340025:0:7439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152e000/0x5bf8706fdac8cd37 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574239.340031:0:7439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85c152e000 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:0.0:1788574239.340034:0:7439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152e000/0x5bf8706fdac8cd37 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574239.340041:0:7439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152e000/0x5bf8706fdac8cd37 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574239.340050:0:7439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c85d07b8300) 00010000:00010000:0.0:1788574239.340053:0:7439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574239.340056:0:7439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152e000/0x5bf8706fdac8cd37 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574239.340062:0:7439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152e000/0x5bf8706fdac8cd37 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574239.340114:0:7439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f600/0x5bf8706fdac8cd29 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a65 expref: 41 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574239.340130:0:7439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152ee00/0x5bf8706fdac8cd3e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a65 expref: 40 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574239.340138:0:7439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c85fa28c400) 00010000:00010000:0.0:1788574239.340140:0:7439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788574239.340143:0:7439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85c152ee00, rc 0) 00000100:00100000:0.0:1788574239.340513:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8ab1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+40:12414:x1875455669008896:12345-192.168.204.51@tcp:101:cat.0 Request processed in 1129us (1413us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1788574239.340532:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 213 00000100:00100000:1.0:1788574239.348689:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574239.348940:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669009152 00000100:00100000:0.0:1788574239.348954:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669009152 00000100:00100000:0.0:1788574239.349028:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 54 00000100:00100000:0.0:1788574239.349049:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3009f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:659467ff-94af-418e-92fe-11e4323a48aa+40:12414:x1875455669009152:12345-192.168.204.51@tcp:35:cat.0 00000100:00100000:0.0:1788574239.349701:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3009f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:659467ff-94af-418e-92fe-11e4323a48aa+41:12414:x1875455669009152:12345-192.168.204.51@tcp:35:cat.0 Request processed in 659us (1027us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1788574239.349712:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 54 00000100:00100000:2.0:1788574239.376758:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574239.377011:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669009408 00000100:00100000:1.0:1788574239.377027:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669009408 00000100:00100000:1.0:1788574239.377134:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 214 00000100:00100000:1.0:1788574239.377147:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+41:12415:x1875455669009408:12345-192.168.204.51@tcp:36:rm.0 00010000:00010000:1.0:1788574239.377503:0:6493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1788574239.377562:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8ccdc lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a50 expref: 41 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.377591:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152ee00/0x5bf8706fdac8cd3e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a65 expref: 40 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.377607:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152e600/0x5bf8706fdac8cd14 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a5e expref: 39 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.377620:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617a00/0x5bf8706fdac8ccce lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a49 expref: 38 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.377631:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c85fa28c400) 00010000:00010000:1.0:1788574239.377638:0:6493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788574239.377670:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8cd4c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.377689:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8cd4c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.377703:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8cd4c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.377723:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8cd53 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.377731:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8cd53 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.377739:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8cd53 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.377872:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8cd5a lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.377881:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8cd5a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.377887:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8cd5a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788574239.380330:0:6493:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:1.0:1788574239.380360:0:6493:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 379360169181ns, next at 380360159266ns, rc = 0 00010000:00010000:1.0:1788574239.380471:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8cd61 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.380493:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8cd61 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.380506:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8cd61 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.380516:0:6493:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8cd61 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.380522:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8cd61 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.380528:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8cd61 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.380561:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788574239.380591:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8cd5a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.380617:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8cd5a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.380624:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8cd5a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.380630:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85faea2200 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:1.0:1788574239.380635:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8cd5a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.380643:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8cd5a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.380658:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c85fa28c400) 00010000:00010000:1.0:1788574239.380661:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788574239.380666:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8cd5a lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.380673:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8cd5a lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.380698:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8cd4c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574239.380700:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:1.0:1788574239.380704:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8cd4c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.380709:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8cd4c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.380714:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85faea3800 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:1.0:1788574239.380723:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8cd4c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574239.380726:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3723b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681651328:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788574239.380730:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8cd4c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.380738:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c85d07b8d00) 00010000:00010000:1.0:1788574239.380740:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788574239.380743:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8cd4c lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.380748:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8cd4c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788574239.380760:0:6493:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000275d7f66 reply state 0000000055846ebe transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8cd53 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.380771:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8cd53 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.380777:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c84c34f0000) 00010000:00010000:1.0:1788574239.380779:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788574239.380782:0:6493:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788574239.380811:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574239.380921:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681651328 00000100:00100000:3.0:1788574239.380931:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681651328 00000100:00100000:3.0:1788574239.380990:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1788574239.381000:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3597800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681651328:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788574239.381039:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1788574239.381091:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3597800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681651328:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574239.381108:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1788574239.381172:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3723b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681651328:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788574239.381664:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788574239.381675:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8cd61 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574239.381684:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85faea2e00 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:2.0:1788574239.381697:0:6480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8cd61 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574239.381705:0:6480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8cd61 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574239.381721:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c85fa28c400) 00010000:00010000:2.0:1788574239.381724:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788574239.381730:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8cd61 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574239.381737:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8cd61 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574239.381751:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574239.381753:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574239.381755:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574239.384096:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+39:12415:x1875455669009408:12345-192.168.204.51@tcp:36:rm.0 Request processed in 6937us (7343us total) trans 4294967483 rc 0/0 00000100:00100000:1.0:1788574239.384112:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 214 00010000:00010000:3.0:1788574239.385470:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574239.487950:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574239.488073:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669009664 00000100:00100000:1.0:1788574239.488088:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669009664 00000100:00100000:1.0:1788574239.488169:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 215 00000100:00100000:1.0:1788574239.488182:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+39:12421:x1875455669009664:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:1.0:1788574239.488253:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574239.488301:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8cd68 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6a6c expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.488455:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8cd6f lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.488475:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8cd6f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.488489:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8cd6f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.488502:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8cd76 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.488509:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8cd76 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.488515:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8cd76 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788574239.488963:0:6492:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:1.0:1788574239.489144:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8cd7d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.489154:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8cd7d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.489163:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8cd7d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.489240:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8cd6f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.489261:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8cd6f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.489268:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8cd6f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.489275:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85faea2200 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:1.0:1788574239.489280:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8cd6f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.489290:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8cd6f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.489321:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c85d07b8d00) 00010000:00010000:1.0:1788574239.489325:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788574239.489331:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8cd6f lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.489338:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8cd6f lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788574239.489354:0:6492:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000662d09f1 reply state 00000000c9d107c2 transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8cd76 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.489367:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8cd76 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.489374:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c84c34f0000) 00010000:00010000:1.0:1788574239.489377:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788574239.489380:0:6492:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788574239.489415:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8cd68 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a6c expref: 42 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.489440:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8cd7d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a6c expref: 41 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.489448:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c84c34f0600) 00010000:00010000:1.0:1788574239.489451:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788574239.489453:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85faea2e00, rc 0) 00000100:00100000:1.0:1788574239.489535:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+42:12421:x1875455669009664:12345-192.168.204.51@tcp:101:bash.0 Request processed in 1356us (1601us total) trans 4294967484 rc 0/0 00000100:00100000:1.0:1788574239.489545:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 215 00000100:00100000:2.0:1788574239.502575:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574239.502704:0:8815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669009792 00000100:00100000:0.0:1788574239.502718:0:8815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669009792 00000100:00100000:0.0:1788574239.502828:0:8815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 68 00000100:00100000:0.0:1788574239.502843:0:8815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2f47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:659467ff-94af-418e-92fe-11e4323a48aa+7:2393:x1875455669009792:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:0.0:1788574239.502877:0:8815:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574239.502905:0:8815:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0e0e36b/0x5bf8706fdac8cd8b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6a73 expref: -99 pid: 8815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788574239.502940:0:8815:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788574239.502968:0:8815:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=379s v=(0 0) 00010000:00010000:0.0:1788574239.502974:0:8815:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788574239.502987:0:8815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0e0e36b/0x5bf8706fdac8cd8b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a73 expref: 8 pid: 8815 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574239.503012:0:8815:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a0e0e36b/0x5bf8706fdac8cd8b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a73 expref: 8 pid: 8815 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574239.503057:0:8815:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85c152f600, rc 0) 00000100:00100000:0.0:1788574239.503140:0:8815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2f47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:659467ff-94af-418e-92fe-11e4323a48aa+8:2393:x1875455669009792:12345-192.168.204.51@tcp:101:bash.0 Request processed in 301us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574239.503148:0:8815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 68 00000100:00080000:1.0:1788574239.503234:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788574239.507377:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574239.507487:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669009920 00000100:00100000:1.0:1788574239.507501:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669009920 00000100:00100000:1.0:1788574239.507573:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 69 00000100:00100000:1.0:1788574239.507585:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2f47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:659467ff-94af-418e-92fe-11e4323a48aa+8:12421:x1875455669009920:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:1.0:1788574239.507608:0:8409:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574239.507633:0:8409:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ccf2b5ac/0x5bf8706fdac8cd92 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6a7a expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.507676:0:8409:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a0e0e36b/0x5bf8706fdac8cd8b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a73 expref: 9 pid: 8815 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.507687:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574239.507692:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574239.507699:0:8409:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ccf2b5ac/0x5bf8706fdac8cd92 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a7a expref: 9 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.507769:0:8409:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a0e0e36b/0x5bf8706fdac8cd8b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a73 expref: 9 pid: 8815 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.507799:0:8409:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a0e0e36b/0x5bf8706fdac8cd8b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a73 expref: 9 pid: 8815 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574239.507817:0:8409:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c300b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8409:1875455681651456:192.168.204.51@tcp:104: 00000100:00100000:1.0:1788574239.507949:0:8409:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c353b480 going to sleep for 11 seconds 00000100:00100000:1.0:1788574239.514910:0:8409:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c300b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8409:1875455681651456:192.168.204.51@tcp:104: 00010000:00010000:1.0:1788574239.514962:0:8409:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ccf2b5ac/0x5bf8706fdac8cd92 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a7a expref: 9 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.514990:0:8409:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85faea3800, rc 0) 00000100:00100000:1.0:1788574239.515135:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2f47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:659467ff-94af-418e-92fe-11e4323a48aa+9:12421:x1875455669009920:12345-192.168.204.51@tcp:101:bash.0 Request processed in 7550us (7771us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574239.515145:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 69 00000100:00100000:2.0:1788574239.527843:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574239.528255:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669010048 00000100:00100000:0.0:1788574239.528268:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669010048 00010000:00010000:0.0:1788574239.528341:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a0e0e36b/0x5bf8706fdac8cd8b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a73 expref: 9 pid: 8815 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574239.528394:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 97 00000100:00100000:0.0:1788574239.528407:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2f44380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:659467ff-94af-418e-92fe-11e4323a48aa+9:2393:x1875455669010048:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788574239.528426:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574239.528454:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a0e0e36b/0x5bf8706fdac8cd8b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a73 expref: 9 pid: 8815 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574239.528471:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a0e0e36b/0x5bf8706fdac8cd8b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a73 expref: 9 pid: 8815 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574239.528501:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0e0e36b/0x5bf8706fdac8cd8b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a73 expref: 9 pid: 8815 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574239.528527:0:6478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788574239.528531:0:6478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788574239.528542:0:6478:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ccf2b5ac/0x5bf8706fdac8cd92 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a7a expref: 8 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574239.528574:0:6478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ccf2b5ac/0x5bf8706fdac8cd92 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a7a expref: 8 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574239.528626:0:6478:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ccf2b5ac/0x5bf8706fdac8cd92 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a7a expref: 8 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574239.528644:0:6478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3f24700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6478:1875455681651584:192.168.204.51@tcp:105: 00000100:00100000:0.0:1788574239.528764:0:6478:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85d0e7f900 going to sleep for 11 seconds 00000100:00100000:2.0:1788574239.534673:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574239.534813:0:6478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3f24700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6478:1875455681651584:192.168.204.51@tcp:105: 00010000:00010000:0.0:1788574239.534850:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574239.534941:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2f44380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:659467ff-94af-418e-92fe-11e4323a48aa+8:2393:x1875455669010048:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 6536us (7113us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574239.534955:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 97 00000100:00100000:1.0:1788574239.535703:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669010304 00000100:00100000:1.0:1788574239.535715:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669010304 00000100:00100000:1.0:1788574239.535797:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 55 00000100:00100000:1.0:1788574239.535809:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2f44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:659467ff-94af-418e-92fe-11e4323a48aa+42:12421:x1875455669010304:12345-192.168.204.51@tcp:35:bash.0 00000001:00080000:1.0:1788574239.536133:0:6495:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967485 00000100:00100000:1.0:1788574239.536284:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2f44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:659467ff-94af-418e-92fe-11e4323a48aa+44:12421:x1875455669010304:12345-192.168.204.51@tcp:35:bash.0 Request processed in 476us (1625us total) trans 4294967486 rc 0/0 00000100:00100000:1.0:1788574239.536327:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 55 00000020:00080000:1.0:1788574239.536332:0:6495:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788574239.761316:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574239.761634:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669010432 00000100:00100000:3.0:1788574239.761649:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669010432 00000100:00100000:3.0:1788574239.761734:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 216 00000100:00100000:3.0:1788574239.761746:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c443c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+44:12437:x1875455669010432:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:3.0:1788574239.761778:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574239.761816:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616a00/0x5bf8706fdac8cd99 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6a81 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574239.761917:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8cda0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574239.761937:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8cda0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574239.761951:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8cda0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788574239.762011:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1788574239.762015:0:6494:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788574239.762053:0:6494:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8cda0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574239.762093:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616a00/0x5bf8706fdac8cd99 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a81 expref: 46 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574239.762117:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8cda0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a81 expref: 45 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574239.762138:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c85d07b8d00) 00010000:00010000:3.0:1788574239.762142:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788574239.762147:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c84c2617400, rc 0) 00000100:00100000:3.0:1788574239.762276:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c443c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+45:12437:x1875455669010432:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 533us (991us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574239.762284:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 216 00000100:00100000:2.0:1788574239.769268:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574239.769682:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669010688 00000100:00100000:1.0:1788574239.769696:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669010688 00000100:00100000:1.0:1788574239.769796:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 217 00000100:00100000:1.0:1788574239.769809:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c443f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+45:12437:x1875455669010688:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:1.0:1788574239.769841:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574239.769881:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8cda7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6a88 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.770052:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8cdae lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.770071:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8cdae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.770423:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8cdae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788574239.770449:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788574239.770626:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8cda7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a88 expref: 48 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.770649:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8cdae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a88 expref: 47 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.770660:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c84c34f0600) 00010000:00010000:1.0:1788574239.770664:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788574239.770691:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85faea2600, rc 0) 00000100:00100000:1.0:1788574239.770801:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c443f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+47:12437:x1875455669010688:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 994us (1549us total) trans 4294967487 rc 0/0 00000100:00100000:1.0:1788574239.770811:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 217 00000100:00100000:2.0:1788574239.777704:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574239.777801:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574239.778087:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669011072 00000100:00100000:3.0:1788574239.778102:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669011072 00000100:00100000:3.0:1788574239.778218:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 15 00000100:00100000:3.0:1788574239.778232:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c443c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:659467ff-94af-418e-92fe-11e4323a48aa+47:2394:x1875455669011072:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788574239.778253:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574239.778285:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8cdae lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a88 expref: 47 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574239.778320:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c84c34f0600) 00010000:00010000:3.0:1788574239.778589:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788574239.779005:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669010944 00000100:00100000:1.0:1788574239.779013:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669010944 00000100:00100000:1.0:1788574239.779073:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 218 00000100:00100000:1.0:1788574239.779092:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c443ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+47:12437:x1875455669010944:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:1.0:1788574239.779117:0:7439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574239.779137:0:7439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e800/0x5bf8706fdac8cdbc lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6a8f expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.779313:0:7439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217fa00/0x5bf8706fdac8cdc3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574239.779617:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c443c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:659467ff-94af-418e-92fe-11e4323a48aa+48:2394:x1875455669011072:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 445us (872us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574239.779628:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 15 00010000:00010000:1.0:1788574239.779964:0:7439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217fa00/0x5bf8706fdac8cdc3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.779980:0:7439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217fa00/0x5bf8706fdac8cdc3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788574239.780000:0:7439:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788574239.783043:0:7439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e800/0x5bf8706fdac8cdbc lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a8f expref: 49 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.783080:0:7439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217fa00/0x5bf8706fdac8cdc3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a8f expref: 48 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.783093:0:7439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c84c34f0600) 00010000:00010000:1.0:1788574239.783115:0:7439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788574239.783120:0:7439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c860217fa00, rc 0) 00000100:00100000:1.0:1788574239.783229:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c443ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+48:12437:x1875455669010944:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 4137us (5539us total) trans 4294967488 rc 0/0 00000100:00100000:1.0:1788574239.783241:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 218 00000100:00100000:2.0:1788574239.795783:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574239.795896:0:13791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669011200 00000100:00100000:0.0:1788574239.795911:0:13791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669011200 00000100:00100000:0.0:1788574239.795996:0:13791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 70 00000100:00100000:0.0:1788574239.796009:0:13791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c443dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:659467ff-94af-418e-92fe-11e4323a48aa+8:2393:x1875455669011200:12345-192.168.204.51@tcp:1:lfs.0 00010000:00010000:0.0:1788574239.796094:0:13791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0e0e36b/0x5bf8706fdac8cdd1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574239.796123:0:13791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ccf2b5ac/0x5bf8706fdac8cd92 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a7a expref: 8 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574239.796134:0:13791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788574239.796162:0:13791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788574239.796169:0:13791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0e0e36b/0x5bf8706fdac8cdd1 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574239.796261:0:13791:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ccf2b5ac/0x5bf8706fdac8cd92 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a7a expref: 8 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574239.796278:0:13791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ccf2b5ac/0x5bf8706fdac8cd92 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a7a expref: 8 pid: 8409 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574239.796295:0:13791:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3f24700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13791:1875455681651712:192.168.204.51@tcp:104: 00000100:00100000:0.0:1788574239.796443:0:13791:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85d0e7f900 going to sleep for 11 seconds 00000100:00100000:2.0:1788574239.799427:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574239.799574:0:8416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669011328 00000100:00100000:1.0:1788574239.799587:0:8416:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669011328 00002000:00100000:1.0:1788574239.799656:0:8416:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9c84c443c700 x1875455669011328/t0(0) o4->659467ff-94af-418e-92fe-11e4323a48aa@192.168.204.51@tcp:390/0 lens 504/0 e 0 to 0 dl 1788574250 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788574239.799667:0:8416:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c84c443c700 with x1875455669011328 ext(0->8) 00010000:00010000:1.0:1788574239.799679:0:8416:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ccf2b5ac/0x5bf8706fdac8cd92 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a7a expref: 9 pid: 8409 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.799697:0:8416:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ccf2b5ac/0x5bf8706fdac8cd92 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a7a expref: 9 pid: 8409 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788574239.799704:0:8416:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9c84c443c700 00000100:00100000:1.0:1788574239.799749:0:8416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 3 00000100:00100000:1.0:1788574239.799761:0:8416:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c443c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:659467ff-94af-418e-92fe-11e4323a48aa+9:2394:x1875455669011328:12345-192.168.204.51@tcp:4:lfs.0 00000100:00100000:1.0:1788574239.801914:0:8416:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c443c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:659467ff-94af-418e-92fe-11e4323a48aa+11:2394:x1875455669011328:12345-192.168.204.51@tcp:4:lfs.0 Request processed in 2140us (2489us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788574239.801933:0:8416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 3 00002000:00100000:1.0:1788574239.801949:0:8416:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9c84c443c700 x1875455669011328/t4294967309(0) o4->659467ff-94af-418e-92fe-11e4323a48aa@192.168.204.51@tcp:390/0 lens 504/448 e 0 to 0 dl 1788574250 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788574239.801961:0:8416:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c84c443c700 with x1875455669011328 ext(0->8) 00010000:00010000:1.0:1788574239.801989:0:8416:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ccf2b5ac/0x5bf8706fdac8cd92 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a7a expref: 11 pid: 8409 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.802012:0:8416:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ccf2b5ac/0x5bf8706fdac8cd92 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a7a expref: 11 pid: 8409 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788574239.802020:0:8416:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9c84c443c700 00000100:00100000:0.0:1788574239.802615:0:13791:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3f24700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:13791:1875455681651712:192.168.204.51@tcp:104: 00010000:00010000:0.0:1788574239.802651:0:13791:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a0e0e36b/0x5bf8706fdac8cdd1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574239.805595:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574239.806014:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669011456 00000100:00100000:2.0:1788574239.806029:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669011456 00010000:00010000:2.0:1788574239.806609:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ccf2b5ac/0x5bf8706fdac8cd92 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a7a expref: 11 pid: 8409 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574239.806730:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 98 00000100:00100000:2.0:1788574239.806743:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3594000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:659467ff-94af-418e-92fe-11e4323a48aa+11:2396:x1875455669011456:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788574239.806765:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788574239.806802:0:6477:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788574239.806806:0:6477:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788574239 00002000:00010000:2.0:1788574239.806808:0:6477:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1788574239 00002000:00010000:2.0:1788574239.806810:0:6477:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1788574239 00002000:00010000:2.0:1788574239.806812:0:6477:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1788574239.806820:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ccf2b5ac/0x5bf8706fdac8cd92 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a7a expref: 11 pid: 8409 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574239.806838:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ccf2b5ac/0x5bf8706fdac8cd92 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a7a expref: 11 pid: 8409 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574239.806869:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ccf2b5ac/0x5bf8706fdac8cd92 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a7a expref: 11 pid: 8409 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574239.806891:0:6477:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788574239.806898:0:6477:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788574239.806907:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a0e0e36b/0x5bf8706fdac8cdd1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574239.806919:0:6477:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0e0e36b/0x5bf8706fdac8cdd1 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574239.806981:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788574239.807064:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3594000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:659467ff-94af-418e-92fe-11e4323a48aa+10:2396:x1875455669011456:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 324us (1484us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574239.807073:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 98 00010000:00010000:1.0:1788574239.808062:0:13791:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a0e0e36b/0x5bf8706fdac8cdd1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.808080:0:13791:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0e0e36b/0x5bf8706fdac8cdd1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.808116:0:13791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0e0e36b/0x5bf8706fdac8cdd1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.808126:0:13791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a0e0e36b/0x5bf8706fdac8cdd1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.808135:0:13791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a0e0e36b/0x5bf8706fdac8cdd1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.808142:0:13791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85c152f600 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:1.0:1788574239.808148:0:13791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0e0e36b/0x5bf8706fdac8cdd1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.808158:0:13791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0e0e36b/0x5bf8706fdac8cdd1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.808213:0:13791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a0e0e36b/0x5bf8706fdac8cdd1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.808223:0:13791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0e0e36b/0x5bf8706fdac8cdd1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574239.808342:0:13791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c443dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:659467ff-94af-418e-92fe-11e4323a48aa+9:2393:x1875455669011200:12345-192.168.204.51@tcp:1:lfs.0 Request processed in 12333us (12573us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574239.808353:0:13791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 70 00000100:00100000:3.0:1788574239.815880:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574239.815986:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669011712 00000100:00100000:1.0:1788574239.816000:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669011712 00000100:00100000:1.0:1788574239.816084:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 56 00000100:00100000:1.0:1788574239.816099:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85d01f6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:659467ff-94af-418e-92fe-11e4323a48aa+48:12437:x1875455669011712:12345-192.168.204.51@tcp:35:lfs.0 00000004:00010000:1.0:1788574239.816236:0:6495:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217fa00/0x5bf8706fdac8cdc3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a8f expref: 48 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788574239.816523:0:6495:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:1.0:1788574239.816559:0:6495:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000001:00080000:1.0:1788574239.819045:0:6495:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00010000:00010000:1.0:1788574239.819148:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e800/0x5bf8706fdac8cdd8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.819179:0:6495:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8cd7d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a6c expref: 52 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.819209:0:6495:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e800/0x5bf8706fdac8cdd8 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.819290:0:6495:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8cd7d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a6c expref: 52 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.819334:0:6495:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8cd7d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a6c expref: 52 pid: 6492 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574239.819355:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c300b480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6495:1875455681651840:192.168.204.51@tcp:104: 00000100:00100000:1.0:1788574239.819482:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c353b240 going to sleep for 11 seconds 00000100:00100000:1.0:1788574239.826801:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c300b480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6495:1875455681651840:192.168.204.51@tcp:104: 00010000:00010000:1.0:1788574239.826852:0:6495:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e800/0x5bf8706fdac8cdd8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788574239.828498:0:9487:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:2.0:1788574239.828527:0:9487:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:2.0:1788574239.829736:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574239.830777:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669011840 00000100:00100000:3.0:1788574239.830803:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669011840 00010000:00010000:3.0:1788574239.830881:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8cd7d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a6c expref: 53 pid: 6492 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574239.830969:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 99 00000100:00100000:3.0:1788574239.830981:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c443ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:659467ff-94af-418e-92fe-11e4323a48aa+53:2394:x1875455669011840:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788574239.831003:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574239.831011:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8cd7d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a6c expref: 53 pid: 6492 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574239.831028:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8cd7d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a6c expref: 53 pid: 6492 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574239.831419:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8cd7d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a6c expref: 53 pid: 6492 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574239.831441:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c84c34f0600) 00010000:00010000:3.0:1788574239.831447:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e800/0x5bf8706fdac8cdd8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574239.831459:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e800/0x5bf8706fdac8cdd8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574239.831467:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e800/0x5bf8706fdac8cdd8 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574239.831509:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788574239.831708:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c443ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:659467ff-94af-418e-92fe-11e4323a48aa+52:2394:x1875455669011840:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 729us (1983us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574239.831718:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 99 00010000:00010000:1.0:1788574239.831951:0:6495:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e800/0x5bf8706fdac8cdd8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.831961:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e800/0x5bf8706fdac8cdd8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788574239.832126:0:6495:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000001:00080000:1.0:1788574239.832312:0:6495:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:1.0:1788574239.832616:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c300b480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6495:1875455681651968:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788574239.832699:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574239.832739:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c353bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788574239.833062:0:7533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681651968 00000100:00100000:3.0:1788574239.833090:0:7533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681651968 00000100:00100000:3.0:1788574239.833175:0:7533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1788574239.833185:0:7533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601835880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6495:x1875455681651968:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00080000:2.0:1788574239.833427:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788574239.833765:0:7533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601835880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6495:x1875455681651968:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 579us (1064us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574239.833774:0:7533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1788574239.833889:0:6495:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967308 gen 2 00000004:00080000:2.0:1788574239.833897:0:6495:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967308 00000004:00080000:2.0:1788574239.833923:0:6495:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c84c1be0a80, transno 4294967308 00000100:00100000:2.0:1788574239.833949:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c300b480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6495:1875455681651968:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788574239.834151:0:6495:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00000100:00100000:2.0:1788574239.834259:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c443e680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6495:1875455681652096:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788574239.834337:0:6495:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574239.834363:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c82c7000 going to sleep for 11 seconds 00000100:00100000:3.0:1788574239.836423:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681652096 00000100:00100000:3.0:1788574239.836442:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681652096 00000100:00100000:3.0:1788574239.836522:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1788574239.836533:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c443e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6495:x1875455681652096:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788574239.836922:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c443e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6495:x1875455681652096:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 389us (2597us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788574239.836932:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1788574239.837208:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c443e680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6495:1875455681652096:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788574239.837311:0:6495:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:2.0:1788574239.837371:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e800/0x5bf8706fdac8cdd8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574239.837384:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e800/0x5bf8706fdac8cdd8 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574239.837396:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e800/0x5bf8706fdac8cdd8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574239.837428:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c860217e800 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:2.0:1788574239.837434:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e800/0x5bf8706fdac8cdd8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574239.837444:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e800/0x5bf8706fdac8cdd8 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574239.837466:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c84c34f0600) 00010000:00010000:2.0:1788574239.837469:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788574239.837474:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e800/0x5bf8706fdac8cdd8 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574239.837481:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e800/0x5bf8706fdac8cdd8 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788574239.837634:0:6495:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788574239.837709:0:6495:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:2.0:1788574239.837724:0:6495:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 379817533227ns, next at 380817530214ns, rc = 0 00000001:00080000:2.0:1788574239.837731:0:6495:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967496 00010000:00010000:2.0:1788574239.837755:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c84c34f0600) 00010000:00010000:2.0:1788574239.837758:0:6495:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788574239.837766:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217fa00/0x5bf8706fdac8cdc3 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a8f expref: 56 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574239.837933:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85d01f6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:659467ff-94af-418e-92fe-11e4323a48aa+55:12437:x1875455669011712:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 21836us (22067us total) trans 4294967497 rc 0/0 00000100:00100000:2.0:1788574239.837945:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 56 00000020:00080000:2.0:1788574239.837950:0:6495:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788574239.842531:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574239.842690:0:11893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669011968 00000100:00100000:1.0:1788574239.842706:0:11893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669011968 00000100:00100000:1.0:1788574239.842775:0:11893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 219 00000100:00100000:1.0:1788574239.842787:0:11893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e57c0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:659467ff-94af-418e-92fe-11e4323a48aa+55:12437:x1875455669011968:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:1.0:1788574239.842842:0:11893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574239.842876:0:11893:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8cddf lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6a96 expref: -99 pid: 11893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.842957:0:11893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8cddf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a96 expref: 56 pid: 11893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.842976:0:11893:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8cddf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a96 expref: 56 pid: 11893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574239.843002:0:11893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c84c34f0e00) 00010000:00010000:1.0:1788574239.843005:0:11893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788574239.843010:0:11893:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85faea2e00, rc 0) 00000100:00100000:1.0:1788574239.843084:0:11893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e57c0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:659467ff-94af-418e-92fe-11e4323a48aa+56:12437:x1875455669011968:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 299us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574239.843091:0:11893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 219 00000100:00100000:0.0:1788574239.851365:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574239.852610:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669012224 00000100:00100000:3.0:1788574239.852631:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669012224 00000100:00100000:3.0:1788574239.852730:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 57 00000100:00100000:3.0:1788574239.852743:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3f24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:659467ff-94af-418e-92fe-11e4323a48aa+56:12437:x1875455669012224:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:3.0:1788574239.853133:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3f24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:659467ff-94af-418e-92fe-11e4323a48aa+57:12437:x1875455669012224:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 392us (1788us total) trans 4294967498 rc 0/0 00000100:00100000:3.0:1788574239.853143:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 57 00000100:00100000:0.0:1788574240.021731:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574240.021929:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669012352 00000100:00100000:1.0:1788574240.021948:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669012352 00000100:00080000:2.0:1788574240.022181:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788574240.022348:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 220 00000100:00100000:1.0:1788574240.022364:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3f27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+57:12447:x1875455669012352:12345-192.168.204.51@tcp:34:lfs.0 00010000:00010000:1.0:1788574240.022475:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8cde6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574240.022499:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8cde6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574240.022518:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8cde6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574240.022557:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8cded lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574240.022567:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8cded lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574240.022575:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8cded lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574240.022683:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8cdf4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574240.022693:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8cdf4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574240.022700:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8cdf4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788574240.022765:0:6493:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8cdf4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574240.022906:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8cde6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574240.022915:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8cde6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574240.022923:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8cde6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574240.022929:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85faea3800 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:1.0:1788574240.022934:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8cde6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574240.022949:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8cde6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574240.022963:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c85d07b8d00) 00010000:00010000:1.0:1788574240.022967:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788574240.022973:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8cde6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574240.022979:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8cde6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574240.022996:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8cded lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574240.023002:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8cded lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574240.023008:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8cded lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574240.023013:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85faea2600 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:1.0:1788574240.023015:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8cded lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574240.023021:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8cded lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574240.023028:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c84c34f0000) 00010000:00010000:1.0:1788574240.023030:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788574240.023033:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8cded lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574240.023494:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8cded lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574240.023507:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8cdf4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574240.023514:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8cdf4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574240.023521:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8cdf4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574240.023526:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85faea2200 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:1.0:1788574240.023529:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8cdf4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574240.023536:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8cdf4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574240.023545:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c84c34f0e00) 00010000:00010000:1.0:1788574240.023547:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788574240.023551:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8cdf4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574240.023556:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8cdf4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574240.023671:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3f27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+57:12447:x1875455669012352:12345-192.168.204.51@tcp:34:lfs.0 Request processed in 1309us (1947us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574240.023680:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 220 00000100:00100000:1.0:1788574240.067601:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574240.067768:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669012608 00000100:00100000:0.0:1788574240.067778:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669012608 00000100:00100000:0.0:1788574240.067841:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 221 00000100:00100000:0.0:1788574240.067853:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601837b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+57:12450:x1875455669012608:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:0.0:1788574240.067874:0:7439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574240.067987:0:7439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8cdfb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6a9d expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574240.068078:0:7439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152e000/0x5bf8706fdac8ce02 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574240.068092:0:7439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152e000/0x5bf8706fdac8ce02 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574240.068104:0:7439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152e000/0x5bf8706fdac8ce02 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574240.068114:0:7439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f600/0x5bf8706fdac8ce09 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574240.068122:0:7439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f600/0x5bf8706fdac8ce09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574240.068128:0:7439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f600/0x5bf8706fdac8ce09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574240.068254:0:7439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152e600/0x5bf8706fdac8ce10 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574240.068262:0:7439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152e600/0x5bf8706fdac8ce10 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574240.068268:0:7439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152e600/0x5bf8706fdac8ce10 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788574240.068277:0:7439:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788574240.068353:0:7439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152e000/0x5bf8706fdac8ce02 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574240.068360:0:7439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152e000/0x5bf8706fdac8ce02 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574240.068372:0:7439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152e000/0x5bf8706fdac8ce02 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574240.068378:0:7439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85c152e000 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:0.0:1788574240.068382:0:7439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152e000/0x5bf8706fdac8ce02 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574240.068389:0:7439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152e000/0x5bf8706fdac8ce02 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574240.068400:0:7439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c85d07b8d00) 00010000:00010000:0.0:1788574240.068403:0:7439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574240.068407:0:7439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152e000/0x5bf8706fdac8ce02 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574240.068414:0:7439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152e000/0x5bf8706fdac8ce02 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574240.068428:0:7439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f600/0x5bf8706fdac8ce09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574240.068434:0:7439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f600/0x5bf8706fdac8ce09 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574240.068440:0:7439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f600/0x5bf8706fdac8ce09 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574240.068445:0:7439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85c152f600 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:0.0:1788574240.068447:0:7439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f600/0x5bf8706fdac8ce09 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574240.068462:0:7439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f600/0x5bf8706fdac8ce09 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574240.068470:0:7439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c84c34f0000) 00010000:00010000:0.0:1788574240.068472:0:7439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574240.068476:0:7439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f600/0x5bf8706fdac8ce09 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574240.068482:0:7439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f600/0x5bf8706fdac8ce09 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574240.069441:0:7439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8cdfb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a9d expref: 60 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574240.069466:0:7439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152e600/0x5bf8706fdac8ce10 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a9d expref: 59 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574240.069475:0:7439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c84c34f0e00) 00010000:00010000:0.0:1788574240.069478:0:7439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788574240.069481:0:7439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85c152e600, rc 0) 00000100:00100000:0.0:1788574240.069561:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601837b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+59:12450:x1875455669012608:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 1710us (1971us total) trans 4294967499 rc 0/0 00000100:00100000:0.0:1788574240.069570:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 221 00000100:00100000:3.0:1788574240.073714:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574240.074126:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669012736 00000100:00100000:0.0:1788574240.074137:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669012736 00000100:00100000:0.0:1788574240.074226:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 222 00000100:00100000:0.0:1788574240.074237:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3596d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+59:12450:x1875455669012736:12345-192.168.204.51@tcp:54:lfs.0 00010000:00010000:0.0:1788574240.074333:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152ee00/0x5bf8706fdac8ce1e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574240.074351:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152ee00/0x5bf8706fdac8ce1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574240.074365:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152ee00/0x5bf8706fdac8ce1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574240.074402:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152ee00/0x5bf8706fdac8ce1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574240.074409:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152ee00/0x5bf8706fdac8ce1e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574240.074416:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152ee00/0x5bf8706fdac8ce1e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574240.074422:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85c152ee00 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:0.0:1788574240.074426:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152ee00/0x5bf8706fdac8ce1e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574240.074434:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152ee00/0x5bf8706fdac8ce1e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574240.074445:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c84c34f0e00) 00010000:00010000:0.0:1788574240.074448:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788574240.074453:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152ee00/0x5bf8706fdac8ce1e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574240.074477:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152ee00/0x5bf8706fdac8ce1e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574240.075064:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3596d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+59:12450:x1875455669012736:12345-192.168.204.51@tcp:54:lfs.0 Request processed in 825us (1356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574240.075074:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 222 00000100:00100000:3.0:1788574240.078705:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574240.079976:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669012992 00000100:00100000:0.0:1788574240.079990:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669012992 00000100:00100000:0.0:1788574240.080103:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 58 00000100:00100000:0.0:1788574240.080115:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3594e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:659467ff-94af-418e-92fe-11e4323a48aa+59:12450:x1875455669012992:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:0.0:1788574240.080387:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3594e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:659467ff-94af-418e-92fe-11e4323a48aa+60:12450:x1875455669012992:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 274us (1690us total) trans 4294967500 rc 0/0 00000100:00100000:0.0:1788574240.080395:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 58 00000100:00100000:1.0:1788574240.197608:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574240.197694:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669013248 00000100:00100000:3.0:1788574240.197704:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669013248 00000100:00100000:3.0:1788574240.197762:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 223 00000100:00100000:3.0:1788574240.197772:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601834380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+60:12460:x1875455669013248:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:3.0:1788574240.198183:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574240.198213:0:6493:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788574240.198243:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8cda0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a81 expref: 60 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574240.198263:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c85d07b8d00) 00010000:00010000:3.0:1788574240.198268:0:6493:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788574240.198280:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8ce25 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6aa4 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574240.198752:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616a00/0x5bf8706fdac8ce2c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574240.198768:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616a00/0x5bf8706fdac8ce2c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574240.199345:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616a00/0x5bf8706fdac8ce2c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788574240.201222:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788574240.201728:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8ce25 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6aa4 expref: 62 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574240.201754:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616a00/0x5bf8706fdac8ce2c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6aa4 expref: 61 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574240.201764:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c84c34f0e00) 00010000:00010000:3.0:1788574240.201767:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788574240.201771:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c84c2616a00, rc 0) 00000100:00100000:3.0:1788574240.202711:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601834380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+61:12460:x1875455669013248:12345-192.168.204.51@tcp:101:bash.0 Request processed in 4937us (5109us total) trans 4294967501 rc 0/0 00000100:00100000:3.0:1788574240.202721:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 223 00000100:00100000:3.0:1788574240.220892:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574240.221002:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574240.221181:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669013376 00000100:00100000:1.0:1788574240.221217:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669013376 00000100:00100000:1.0:1788574240.221284:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 224 00000100:00100000:1.0:1788574240.221305:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3596a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+61:12460:x1875455669013376:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:1.0:1788574240.221331:0:7439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574240.221354:0:7439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8ce3a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6aab expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574240.221390:0:7439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8ce41 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574240.221406:0:7439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8ce41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574240.221418:0:7439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8ce41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574240.221530:0:7439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8ce3a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6aab expref: 63 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574240.221551:0:7439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8ce41 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6aab expref: 62 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574240.221560:0:7439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c84c34f0e00) 00010000:00010000:1.0:1788574240.221563:0:7439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788574240.221566:0:7439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85faea3800, rc 0) 00000100:00100000:1.0:1788574240.221636:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3596a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+62:12460:x1875455669013376:12345-192.168.204.51@tcp:101:bash.0 Request processed in 343us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574240.221652:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 224 00000100:00100000:0.0:1788574240.224037:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669013504 00000100:00100000:0.0:1788574240.224053:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669013504 00000100:00100000:0.0:1788574240.224165:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 16 00000100:00100000:0.0:1788574240.224176:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3594a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:659467ff-94af-418e-92fe-11e4323a48aa+62:2396:x1875455669013504:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788574240.224235:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574240.224262:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616a00/0x5bf8706fdac8ce2c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6aa4 expref: 62 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574240.224285:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c84c34f0e00) 00010000:00010000:0.0:1788574240.224300:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574240.224372:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3594a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:659467ff-94af-418e-92fe-11e4323a48aa+61:2396:x1875455669013504:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 197us (3488us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574240.224380:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 16 00000100:00100000:3.0:1788574240.227501:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574240.229432:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669013760 00000100:00100000:0.0:1788574240.229449:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669013760 00000100:00100000:0.0:1788574240.229531:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 225 00000100:00100000:0.0:1788574240.229543:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3595c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+61:12460:x1875455669013760:12345-192.168.204.51@tcp:36:bash.0 00010000:00010000:0.0:1788574240.229597:0:6492:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574240.229625:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152e600/0x5bf8706fdac8ce10 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a9d expref: 61 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574240.229645:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c84c34f0e00) 00010000:00010000:0.0:1788574240.229650:0:6492:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788574240.229820:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8ce48 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574240.229835:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8ce48 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574240.229845:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8ce48 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788574240.229887:0:6492:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967502 00000004:00010000:0.0:1788574240.229931:0:6492:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004e461144 reply state 00000000a2eb9c8c transno 4294967503 ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8ce48 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574240.230581:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8ce48 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574240.230595:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c84c34f0e00) 00010000:00010000:0.0:1788574240.230598:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788574240.230601:0:6492:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788574240.230717:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3595c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+63:12460:x1875455669013760:12345-192.168.204.51@tcp:36:bash.0 Request processed in 1175us (3224us total) trans 4294967503 rc 0/0 00000100:00100000:0.0:1788574240.230726:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 225 00000020:00080000:0.0:1788574240.230743:0:6492:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788574240.242752:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574240.242879:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669013888 00000100:00100000:1.0:1788574240.242890:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669013888 00000100:00100000:1.0:1788574240.242976:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 226 00000100:00100000:1.0:1788574240.242987:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3594380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+63:12460:x1875455669013888:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:1.0:1788574240.243016:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574240.243040:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8ce4f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6ab2 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574240.243498:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8ce56 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574240.243515:0:6493:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8ce56 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574240.243526:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8ce56 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788574240.243553:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788574240.243557:0:6493:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788574240.243576:0:6493:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8ce56 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574240.243605:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8ce4f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ab2 expref: 65 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574240.243622:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8ce56 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ab2 expref: 64 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574240.243650:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c84c34f0e00) 00010000:00010000:1.0:1788574240.243654:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788574240.243658:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85faea2200, rc 0) 00000100:00100000:1.0:1788574240.243722:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3594380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+64:12460:x1875455669013888:12345-192.168.204.51@tcp:101:bash.0 Request processed in 737us (982us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574240.243730:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 226 00000100:00100000:2.0:1788574240.255152:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574240.255318:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669014144 00000100:00100000:0.0:1788574240.255332:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669014144 00000100:00100000:0.0:1788574240.255408:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 59 00000100:00100000:0.0:1788574240.255496:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c443ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:659467ff-94af-418e-92fe-11e4323a48aa+64:12460:x1875455669014144:12345-192.168.204.51@tcp:35:bash.0 00000100:00100000:1.0:1788574240.255950:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c443ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:659467ff-94af-418e-92fe-11e4323a48aa+65:12460:x1875455669014144:12345-192.168.204.51@tcp:35:bash.0 Request processed in 455us (2547us total) trans 4294967504 rc 0/0 00000100:00100000:1.0:1788574240.255959:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 59 00000100:00100000:3.0:1788574240.393596:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574240.401555:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669014272 00000100:00100000:0.0:1788574240.401572:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669014272 00000100:00100000:0.0:1788574240.401903:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 227 00000100:00100000:0.0:1788574240.401917:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3594700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+65:12466:x1875455669014272:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:0.0:1788574240.401944:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574240.401967:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152e600/0x5bf8706fdac8ce5d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6ab9 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574240.402041:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f600/0x5bf8706fdac8ce64 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574240.402058:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f600/0x5bf8706fdac8ce64 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574240.402071:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f600/0x5bf8706fdac8ce64 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788574240.402120:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1788574240.402124:0:6494:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788574240.402145:0:6494:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f600/0x5bf8706fdac8ce64 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574240.402171:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152e600/0x5bf8706fdac8ce5d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ab9 expref: 67 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574240.402365:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f600/0x5bf8706fdac8ce64 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ab9 expref: 66 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574240.402374:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c85d07b8d00) 00010000:00010000:0.0:1788574240.402377:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788574240.402380:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85c152f600, rc 0) 00000100:00100000:0.0:1788574240.402643:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3594700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+66:12466:x1875455669014272:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 727us (9055us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574240.402652:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 227 00010000:00010000:2.0:1788574240.403369:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574240.413863:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574240.413965:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669014400 00000100:00100000:0.0:1788574240.413977:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669014400 00000100:00100000:0.0:1788574240.414056:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 228 00000100:00100000:0.0:1788574240.414067:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3597b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+66:12466:x1875455669014400:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:0.0:1788574240.414090:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574240.414115:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152e600/0x5bf8706fdac8ce6b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6ac0 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574240.414231:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152e000/0x5bf8706fdac8ce72 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574240.414247:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152e000/0x5bf8706fdac8ce72 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574240.414260:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152e000/0x5bf8706fdac8ce72 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574240.414274:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152ee00/0x5bf8706fdac8ce79 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574240.414310:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152ee00/0x5bf8706fdac8ce79 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574240.414318:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152ee00/0x5bf8706fdac8ce79 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574240.414409:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8ce80 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574240.414418:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8ce80 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574240.414425:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8ce80 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788574240.414472:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788574240.414478:0:6492:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788574240.414498:0:6492:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8ce80 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574240.414510:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8ce80 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574240.414517:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152e000/0x5bf8706fdac8ce72 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574240.414524:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152e000/0x5bf8706fdac8ce72 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574240.414530:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152e000/0x5bf8706fdac8ce72 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574240.414546:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85c152e000 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:0.0:1788574240.414551:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152e000/0x5bf8706fdac8ce72 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574240.414558:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152e000/0x5bf8706fdac8ce72 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574240.414570:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c85d07b8d00) 00010000:00010000:0.0:1788574240.414573:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574240.414578:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152e000/0x5bf8706fdac8ce72 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574240.414584:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152e000/0x5bf8706fdac8ce72 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574240.414601:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152ee00/0x5bf8706fdac8ce79 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574240.414607:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152ee00/0x5bf8706fdac8ce79 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574240.414613:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152ee00/0x5bf8706fdac8ce79 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574240.414619:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85c152ee00 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:0.0:1788574240.414621:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152ee00/0x5bf8706fdac8ce79 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574240.414627:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152ee00/0x5bf8706fdac8ce79 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574240.414645:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c84c34f0000) 00010000:00010000:0.0:1788574240.414647:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574240.414650:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152ee00/0x5bf8706fdac8ce79 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574240.414656:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152ee00/0x5bf8706fdac8ce79 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574240.414683:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152e600/0x5bf8706fdac8ce6b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ac0 expref: 68 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574240.414698:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8ce80 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ac0 expref: 67 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574240.414706:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c84c34f0e00) 00010000:00010000:0.0:1788574240.414708:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788574240.414710:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d20d7200, rc 0) 00000100:00100000:0.0:1788574240.414776:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3597b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+67:12466:x1875455669014400:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 710us (922us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574240.414783:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 228 00000100:00100000:2.0:1788574240.417447:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574240.417535:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669014656 00000100:00100000:1.0:1788574240.417544:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669014656 00000100:00100000:1.0:1788574240.417605:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 229 00000100:00100000:1.0:1788574240.417616:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c443df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+67:12466:x1875455669014656:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:1.0:1788574240.417643:0:6493:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574240.417664:0:6493:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8ce87 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6ac7 expref: -99 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574240.417797:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a3400/0x5bf8706fdac8ce8e lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574240.417813:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8ce56 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ab2 expref: 68 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574240.417821:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8ce80 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ac0 expref: 68 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574240.417846:0:6493:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a3400/0x5bf8706fdac8ce8e lrc: 5/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574240.417879:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8ce80 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ac0 expref: 68 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574240.417891:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8ce80 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ac0 expref: 68 pid: 6492 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574240.417905:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c8601836d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6493:1875455681652224:192.168.204.51@tcp:104: 00010000:00010000:1.0:1788574240.418001:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8ce56 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ab2 expref: 68 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574240.418009:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8ce56 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ab2 expref: 68 pid: 6493 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574240.418018:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c8601836300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6493:1875455681652352:192.168.204.51@tcp:104: 00000100:00100000:1.0:1788574240.418037:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c353b180 going to sleep for 11 seconds 00000100:00100000:2.0:1788574240.418580:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574240.418642:0:7433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669014784 00000100:00100000:3.0:1788574240.418648:0:7433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669014784 00010000:00010000:3.0:1788574240.418673:0:7433:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8ce80 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ac0 expref: 69 pid: 6492 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574240.418707:0:7433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 100 00000100:00100000:3.0:1788574240.418715:0:7433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c443d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:659467ff-94af-418e-92fe-11e4323a48aa+69:2395:x1875455669014784:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788574240.418727:0:7433:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574240.418733:0:7433:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8ce80 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ac0 expref: 69 pid: 6492 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574240.418745:0:7433:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8ce80 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ac0 expref: 69 pid: 6492 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574240.418766:0:7433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c84c34f0e00) 00010000:00010000:3.0:1788574240.418771:0:7433:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a3400/0x5bf8706fdac8ce8e lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574240.418777:0:7433:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a3400/0x5bf8706fdac8ce8e lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574240.418792:0:7433:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788574240.418875:0:7433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c443d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:659467ff-94af-418e-92fe-11e4323a48aa+69:2395:x1875455669014784:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 160us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574240.418883:0:7433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 100 00000100:00100000:2.0:1788574240.423062:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574240.423251:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669014912 00000100:00100000:0.0:1788574240.423262:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669014912 00010000:00010000:0.0:1788574240.423314:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8ce56 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ab2 expref: 69 pid: 6493 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574240.423352:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 101 00000100:00100000:0.0:1788574240.423362:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e0bdd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:659467ff-94af-418e-92fe-11e4323a48aa+69:2394:x1875455669014912:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788574240.423387:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574240.423395:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8ce56 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ab2 expref: 69 pid: 6493 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574240.423409:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8ce56 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ab2 expref: 69 pid: 6493 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574240.423432:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c84c34f0e00) 00010000:00010000:0.0:1788574240.423443:0:6477:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a3400/0x5bf8706fdac8ce8e lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574240.423454:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a3400/0x5bf8706fdac8ce8e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574240.423462:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a3400/0x5bf8706fdac8ce8e lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574240.423484:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574240.423547:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e0bdd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:659467ff-94af-418e-92fe-11e4323a48aa+69:2394:x1875455669014912:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 186us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574240.423555:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 101 00010000:00010000:3.0:1788574240.424095:0:6493:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.51@tcp) returned -22 from blocking AST (req@00000000d04aca6b x1875455681652224) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8ce80 lrc: 1/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ac0 expref: 68 pid: 6492 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574240.424111:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8ce80 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ac0 expref: 68 pid: 6492 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574240.424125:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c8601836d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6493:1875455681652224:192.168.204.51@tcp:104: 00010000:00010000:3.0:1788574240.424141:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8ce56 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ab2 expref: 67 pid: 6493 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574240.424149:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c8601836300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6493:1875455681652352:192.168.204.51@tcp:104: 00010000:00010000:3.0:1788574240.424167:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c84c34f0e00) 00010000:00010000:3.0:1788574240.424174:0:6493:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a3400/0x5bf8706fdac8ce8e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574240.424183:0:6493:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a3400/0x5bf8706fdac8ce8e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574240.424399:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a3400/0x5bf8706fdac8ce8e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788574240.424559:0:6493:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788574240.424703:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8ce87 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ac7 expref: 68 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574240.424719:0:6493:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a3400/0x5bf8706fdac8ce8e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ac7 expref: 67 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574240.424726:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c84c34f0e00) 00010000:00010000:3.0:1788574240.424729:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788574240.424732:0:6493:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d08a3400, rc 0) 00000100:00100000:3.0:1788574240.424812:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c443df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+67:12466:x1875455669014656:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 7198us (7374us total) trans 4294967505 rc 0/0 00000100:00100000:3.0:1788574240.424820:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 229 00000100:00100000:2.0:1788574240.426818:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574240.426900:0:7433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669015168 00000100:00100000:3.0:1788574240.426909:0:7433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669015168 00000100:00100000:3.0:1788574240.427015:0:7433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 17 00000100:00100000:3.0:1788574240.427026:0:7433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c443f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:659467ff-94af-418e-92fe-11e4323a48aa+67:12466:x1875455669015168:12345-192.168.204.51@tcp:103:lfs.0 00010000:00010000:3.0:1788574240.427042:0:7433:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574240.427068:0:7433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8cddf lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a96 expref: 67 pid: 11893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574240.427089:0:7433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c84c34f0e00) 00010000:00010000:3.0:1788574240.427094:0:7433:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788574240.427149:0:7433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c443f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:659467ff-94af-418e-92fe-11e4323a48aa+66:12466:x1875455669015168:12345-192.168.204.51@tcp:103:lfs.0 Request processed in 126us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574240.427155:0:7433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 17 00000100:00100000:0.0:1788574240.429613:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574240.429681:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669015296 00000100:00100000:3.0:1788574240.429692:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669015296 00000100:00100000:3.0:1788574240.429799:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 230 00000100:00100000:3.0:1788574240.429809:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3f25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+66:12466:x1875455669015296:12345-192.168.204.51@tcp:58:lfs.0 00010000:00010000:3.0:1788574240.430350:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8ce9c lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574240.430371:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8ce9c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574240.430382:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8ce9c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788574240.430557:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:3.0:1788574240.430664:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3f25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+66:12466:x1875455669015296:12345-192.168.204.51@tcp:58:lfs.0 Request processed in 856us (1058us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574240.430673:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 230 00000100:00100000:2.0:1788574240.438023:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574240.439979:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669015424 00000100:00100000:1.0:1788574240.439996:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669015424 00000100:00100000:1.0:1788574240.440072:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 231 00000100:00100000:1.0:1788574240.440082:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c443d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+66:12466:x1875455669015424:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:1.0:1788574240.441603:0:7439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574240.441630:0:7439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a3000/0x5bf8706fdac8cea3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6ace expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574240.441709:0:7439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8ce9c lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574240.441722:0:7439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a3000/0x5bf8706fdac8cea3 lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ace expref: 67 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574240.441742:0:7439:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8ce9c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574240.441756:0:7439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a3000/0x5bf8706fdac8cea3 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ace expref: 67 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574240.441768:0:7439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c84c34f0e00) 00010000:00010000:1.0:1788574240.441770:0:7439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788574240.441774:0:7439:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a3000/0x5bf8706fdac8cea3 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ace expref: 67 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574240.441781:0:7439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d08a3000, rc 0) 00000100:00100000:1.0:1788574240.441901:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c443d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+67:12466:x1875455669015424:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 1821us (3888us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574240.441908:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 231 00000100:00100000:2.0:1788574240.915418:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788574240.915440:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c443d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681652480:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788574240.915512:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574240.915622:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788574240.915643:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3f27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681652608:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788574240.915725:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1788574240.916138:0:8811:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 380895946473ns, next at 381895942970ns, rc = 0 00000100:00100000:3.0:1788574240.916541:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3f26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681652736:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788574240.916588:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574240.916679:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681652480 00000100:00100000:0.0:1788574240.916691:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681652480 00000100:00100000:0.0:1788574240.916779:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681652736 00000100:00100000:0.0:1788574240.916800:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681652736 00000100:00100000:0.0:1788574240.916827:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788574240.916963:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c443fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681652480:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788574240.916994:0:14401:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:0.0:1788574240.917054:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c443fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681652480:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (1541us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574240.917063:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788574240.917087:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788574240.917095:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3595880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681652736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788574240.917106:0:14401:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:0.0:1788574240.917136:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3595880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681652736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 43us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574240.917143:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00080000:3.0:1788574240.917818:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788574240.917942:0:3618:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967318 gen 2 00000004:00080000:3.0:1788574240.917950:0:3618:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967318 00000100:00100000:3.0:1788574240.917988:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3f26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681652736:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788574240.920563:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c443d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681652480:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788574240.920615:0:7533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681652608 00000100:00100000:2.0:1788574240.920622:0:7533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681652608 00000100:00100000:2.0:1788574240.920683:0:7533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1788574240.920695:0:7533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3f27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681652608:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788574240.920747:0:7533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788574240.920844:0:7533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3f27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681652608:12345-0@lo:41:osp-pre-1-0.0 Request processed in 151us (5120us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574240.920852:0:7533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1788574240.920999:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3f27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681652608:0@lo:41:osp-pre-1-0.0 00000040:00080000:2.0:1788574241.107540:0:13764:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788574241.107551:0:13764:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788574241.107603:0:13764:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:2.0:1788574241.107613:0:13764:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788574241.110990:0:13764:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c443d180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13764:1875455681652864:192.168.204.51@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788574241.111353:0:13764:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c82c7180 going to sleep for 11 seconds 00000100:00100000:3.0:1788574241.124623:0:13764:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c443d180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13764:1875455681652864:192.168.204.51@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788574241.126653:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574241.127264:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669015552 00000100:00100000:3.0:1788574241.127287:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669015552 00000100:00100000:3.0:1788574241.127361:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 232 00000100:00100000:3.0:1788574241.127374:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3f27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+67:12467:x1875455669015552:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788574241.127424:0:6493:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788574241.127603:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3f27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+67:12467:x1875455669015552:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 Request processed in 231us (960us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574241.127613:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 232 00000100:00100000:2.0:1788574241.133484:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574241.133654:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669015680 00000100:00100000:3.0:1788574241.133668:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669015680 00000100:00100000:3.0:1788574241.133755:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 233 00000100:00100000:3.0:1788574241.133776:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c443ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+67:12467:x1875455669015680:12345-192.168.204.51@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788574241.134157:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8ceaa lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574241.134180:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8ceaa lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574241.134233:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8ceaa lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574241.134253:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617200/0x5bf8706fdac8ceb1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574241.134261:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617200/0x5bf8706fdac8ceb1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574241.134268:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617200/0x5bf8706fdac8ceb1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574241.134314:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616000/0x5bf8706fdac8ceb8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574241.134325:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616000/0x5bf8706fdac8ceb8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574241.134332:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616000/0x5bf8706fdac8ceb8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788574241.134404:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788574241.134409:0:6494:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788574241.134428:0:6494:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616000/0x5bf8706fdac8ceb8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574241.134441:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8ceaa lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574241.134449:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8ceaa lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574241.134456:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8ceaa lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574241.134462:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c84c2617400 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:3.0:1788574241.134466:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8ceaa lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574241.134475:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8ceaa lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574241.134489:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c85c90c8800) 00010000:00010000:3.0:1788574241.134492:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574241.134498:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8ceaa lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574241.134505:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8ceaa lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574241.134521:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617200/0x5bf8706fdac8ceb1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574241.134540:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617200/0x5bf8706fdac8ceb1 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574241.134547:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617200/0x5bf8706fdac8ceb1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574241.134551:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c84c2617200 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:3.0:1788574241.134555:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617200/0x5bf8706fdac8ceb1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574241.134561:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617200/0x5bf8706fdac8ceb1 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574241.134569:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff9c85fa28cb00) 00010000:00010000:3.0:1788574241.134572:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574241.134574:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617200/0x5bf8706fdac8ceb1 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574241.134580:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617200/0x5bf8706fdac8ceb1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574241.134599:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616000/0x5bf8706fdac8ceb8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574241.134605:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616000/0x5bf8706fdac8ceb8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574241.134609:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616000/0x5bf8706fdac8ceb8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574241.134614:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c84c2616000 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:3.0:1788574241.134622:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616000/0x5bf8706fdac8ceb8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574241.134629:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616000/0x5bf8706fdac8ceb8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574241.134637:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c84c34f0e00) 00010000:00010000:3.0:1788574241.134640:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574241.134642:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616000/0x5bf8706fdac8ceb8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574241.134649:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616000/0x5bf8706fdac8ceb8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574241.134744:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c443ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+67:12467:x1875455669015680:12345-192.168.204.51@tcp:34:lhsmtool_posix.0 Request processed in 969us (1273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574241.134753:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 233 00000100:00100000:2.0:1788574241.139518:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574241.139646:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669015936 00000100:00100000:1.0:1788574241.139660:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669015936 00000100:00100000:1.0:1788574241.139778:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 234 00000100:00100000:1.0:1788574241.139791:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c443f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+67:12467:x1875455669015936:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788574241.139820:0:7439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574241.139878:0:7439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a3800/0x5bf8706fdac8cebf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6ad5 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.140032:0:7439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2800/0x5bf8706fdac8cec6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.140051:0:7439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2800/0x5bf8706fdac8cec6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.140065:0:7439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2800/0x5bf8706fdac8cec6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788574241.140080:0:7439:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788574241.140231:0:7439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2800/0x5bf8706fdac8cec6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.140239:0:7439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2800/0x5bf8706fdac8cec6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.140246:0:7439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2800/0x5bf8706fdac8cec6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.140253:0:7439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d08a2800 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:1.0:1788574241.140258:0:7439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2800/0x5bf8706fdac8cec6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.140267:0:7439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2800/0x5bf8706fdac8cec6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.140291:0:7439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c84c34f0e00) 00010000:00010000:1.0:1788574241.140296:0:7439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788574241.140315:0:7439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2800/0x5bf8706fdac8cec6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.140338:0:7439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2800/0x5bf8706fdac8cec6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.140392:0:7439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a3800/0x5bf8706fdac8cebf lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ad5 expref: 69 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.140404:0:7439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c85c90c8800) 00010000:00010000:1.0:1788574241.140406:0:7439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788574241.140410:0:7439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a3800/0x5bf8706fdac8cebf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ad5 expref: 69 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.140421:0:7439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d08a3800, rc 0) 00000100:00100000:1.0:1788574241.140522:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c443f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+68:12467:x1875455669015936:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 734us (1227us total) trans 4294967506 rc 301/301 00000100:00100000:1.0:1788574241.140532:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 234 00000100:00100000:0.0:1788574241.146594:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574241.146678:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669016064 00000100:00100000:1.0:1788574241.146691:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669016064 00000100:00100000:1.0:1788574241.146765:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 235 00000100:00100000:1.0:1788574241.146778:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3f26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+68:12467:x1875455669016064:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788574241.146839:0:6492:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788574241.146998:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3f26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+68:12467:x1875455669016064:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 Request processed in 222us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574241.147007:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 235 00000100:00100000:0.0:1788574241.153858:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574241.154495:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669016320 00000100:00100000:3.0:1788574241.154512:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669016320 00000100:00100000:3.0:1788574241.154596:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 236 00000100:00100000:3.0:1788574241.154608:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3f26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+68:12467:x1875455669016320:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788574241.154636:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574241.154640:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788574241.154676:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f600/0x5bf8706fdac8ce64 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ab9 expref: 68 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574241.154701:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c85d07b8d00) 00010000:00010000:3.0:1788574241.154708:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788574241.154724:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616000/0x5bf8706fdac8ced4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6adc expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788574241.157664:0:6494:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x6:0x0], index 0: 0 00010000:00010000:2.0:1788574241.162460:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ec00/0x5bf8706fdac8cedb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574241.162495:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ec00/0x5bf8706fdac8cedb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574241.162511:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ec00/0x5bf8706fdac8cedb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574241.162624:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616000/0x5bf8706fdac8ced4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6adc expref: 70 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574241.162653:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ec00/0x5bf8706fdac8cedb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6adc expref: 69 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574241.162664:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9c85c4fa6200) 00010000:00010000:2.0:1788574241.162667:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788574241.162671:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85fa32ec00, rc 0) 00000100:00100000:2.0:1788574241.163451:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3f26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+69:12467:x1875455669016320:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 8840us (9604us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1788574241.163465:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 236 00000100:00100000:2.0:1788574241.179439:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574241.179688:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669016576 00000100:00100000:1.0:1788574241.179704:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669016576 00000100:00100000:1.0:1788574241.179791:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 237 00000100:00100000:1.0:1788574241.179817:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c443d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+69:12467:x1875455669016576:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788574241.179902:0:7439:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574241.179942:0:7439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ec00/0x5bf8706fdac8cedb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6adc expref: 69 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.179965:0:7439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9c85c4fa6200) 00010000:00010000:1.0:1788574241.179977:0:7439:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788574241.180005:0:7439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a3800/0x5bf8706fdac8cee9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.180022:0:7439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a3800/0x5bf8706fdac8cee9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.180032:0:7439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a3800/0x5bf8706fdac8cee9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.180047:0:7439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2800/0x5bf8706fdac8cef0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x4bb95016 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.180053:0:7439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2800/0x5bf8706fdac8cef0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x4bb95016 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.180060:0:7439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2800/0x5bf8706fdac8cef0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x4bb95016 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.180117:0:7439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a3800/0x5bf8706fdac8cee9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.180125:0:7439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a3800/0x5bf8706fdac8cee9 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.180449:0:7439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a3800/0x5bf8706fdac8cee9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.180456:0:7439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d08a3800 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:1.0:1788574241.180462:0:7439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a3800/0x5bf8706fdac8cee9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.180472:0:7439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a3800/0x5bf8706fdac8cee9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.180481:0:7439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c85d07b8d00) 00010000:00010000:1.0:1788574241.180484:0:7439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788574241.180488:0:7439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a3800/0x5bf8706fdac8cee9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.180495:0:7439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a3800/0x5bf8706fdac8cee9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.180506:0:7439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2800/0x5bf8706fdac8cef0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x4bb95016 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.180512:0:7439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2800/0x5bf8706fdac8cef0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x4bb95016 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.180518:0:7439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2800/0x5bf8706fdac8cef0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x4bb95016 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.180523:0:7439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d08a2800 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:1.0:1788574241.180526:0:7439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2800/0x5bf8706fdac8cef0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x4bb95016 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.180544:0:7439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2800/0x5bf8706fdac8cef0 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x4bb95016 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.180552:0:7439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x4bb95016 (ffff9c84c34f0b00) 00010000:00010000:1.0:1788574241.180555:0:7439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788574241.180558:0:7439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2800/0x5bf8706fdac8cef0 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x4bb95016 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.180564:0:7439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2800/0x5bf8706fdac8cef0 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x4bb95016 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574241.180651:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c443d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+68:12467:x1875455669016576:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 Request processed in 836us (1228us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788574241.180659:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 237 00000100:00100000:0.0:1788574241.184291:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574241.184504:0:11893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669016704 00000100:00100000:3.0:1788574241.184518:0:11893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669016704 00000100:00100000:3.0:1788574241.184594:0:11893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 238 00000100:00100000:3.0:1788574241.184606:0:11893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3f24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:659467ff-94af-418e-92fe-11e4323a48aa+68:12467:x1875455669016704:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788574241.184634:0:11893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574241.184664:0:11893:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617200/0x5bf8706fdac8cef7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6ae3 expref: -99 pid: 11893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574241.184728:0:11893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8cefe lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574241.184745:0:11893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8cefe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574241.184768:0:11893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8cefe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574241.185095:0:11893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617200/0x5bf8706fdac8cef7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ae3 expref: 70 pid: 11893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574241.185118:0:11893:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8cefe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ae3 expref: 69 pid: 11893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574241.186123:0:11893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9c85fa28cb00) 00010000:00010000:3.0:1788574241.186528:0:11893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788574241.186536:0:11893:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c84c2617400, rc 0) 00000100:00100000:3.0:1788574241.186651:0:11893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3f24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:659467ff-94af-418e-92fe-11e4323a48aa+69:12467:x1875455669016704:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 2040us (2381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574241.186678:0:11893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 238 00000100:00100000:0.0:1788574241.209307:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574241.209536:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669016960 00000100:00100000:2.0:1788574241.209552:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669016960 00000100:00100000:2.0:1788574241.209638:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 239 00000100:00100000:2.0:1788574241.209651:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3f25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+69:12467:x1875455669016960:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788574241.209779:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e600/0x5bf8706fdac8cf05 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574241.209822:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e600/0x5bf8706fdac8cf05 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574241.209837:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e600/0x5bf8706fdac8cf05 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788574241.210067:0:6494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00010000:2.0:1788574241.210622:0:6494:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b6043377 reply state 00000000e68655c5 transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e600/0x5bf8706fdac8cf05 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574241.210642:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e600/0x5bf8706fdac8cf05 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574241.210651:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9c85fa28cb00) 00010000:00010000:2.0:1788574241.210654:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788574241.210660:0:6494:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788574241.210830:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3f25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+71:12467:x1875455669016960:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 Request processed in 1180us (1555us total) trans 4294967508 rc 0/0 00000100:00100000:2.0:1788574241.210840:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 239 00000100:00100000:2.0:1788574241.218896:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574241.227523:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669017088 00000100:00100000:1.0:1788574241.227547:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669017088 00000100:00100000:0.0:1788574241.231613:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 240 00000100:00100000:0.0:1788574241.231632:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c443c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+71:12467:x1875455669017088:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788574241.231670:0:7439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574241.231707:0:7439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8cf0c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6aea expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574241.231801:0:7439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8cf0c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6aea expref: 72 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574241.232296:0:7439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8cf0c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6aea expref: 72 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574241.232377:0:7439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9c85fa28cb00) 00010000:00010000:0.0:1788574241.232381:0:7439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788574241.232387:0:7439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d20d7e00, rc 0) 00000100:00100000:0.0:1788574241.232491:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c443c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+72:12467:x1875455669017088:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 862us (13671us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574241.232501:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 240 00000100:00100000:0.0:1788574241.247305:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574241.247668:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669017216 00000100:00100000:3.0:1788574241.247684:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669017216 00000100:00100000:3.0:1788574241.247817:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 71 00000100:00100000:3.0:1788574241.248012:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3f24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:659467ff-94af-418e-92fe-11e4323a48aa+9:2394:x1875455669017216:12345-192.168.204.51@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1788574241.248294:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788574241.248646:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3f24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:659467ff-94af-418e-92fe-11e4323a48aa+10:2394:x1875455669017216:12345-192.168.204.51@tcp:2:lhsmtool_posix.0 Request processed in 638us (1356us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1788574241.248656:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 71 00000100:00100000:2.0:1788574241.258899:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574241.259160:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669017472 00000100:00100000:3.0:1788574241.259174:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669017472 00000100:00100000:1.0:1788574241.259503:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 60 00000100:00100000:1.0:1788574241.259520:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c443ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:659467ff-94af-418e-92fe-11e4323a48aa+72:12467:x1875455669017472:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788574241.259873:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c443ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:659467ff-94af-418e-92fe-11e4323a48aa+73:12467:x1875455669017472:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 Request processed in 356us (991us total) trans 4294967509 rc 0/0 00000100:00100000:1.0:1788574241.259882:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 60 00000100:00100000:0.0:1788574241.271008:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574241.271354:0:11893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669017728 00000100:00100000:3.0:1788574241.271369:0:11893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669017728 00000100:00100000:3.0:1788574241.271453:0:11893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 241 00000100:00100000:3.0:1788574241.271465:0:11893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3f24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:659467ff-94af-418e-92fe-11e4323a48aa+73:12467:x1875455669017728:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788574241.271628:0:11893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3f24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:659467ff-94af-418e-92fe-11e4323a48aa+73:12467:x1875455669017728:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 Request processed in 165us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574241.271636:0:11893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 241 00000100:00100000:0.0:1788574241.279241:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574241.279526:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669017856 00000100:00100000:1.0:1788574241.279542:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669017856 00000100:00100000:1.0:1788574241.279627:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 242 00000100:00100000:1.0:1788574241.279640:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3f25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+73:12467:x1875455669017856:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788574241.279672:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574241.279728:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2800/0x5bf8706fdac8cf13 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6af1 expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.279856:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a3800/0x5bf8706fdac8cf1a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.279877:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a3800/0x5bf8706fdac8cf1a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.279893:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a3800/0x5bf8706fdac8cf1a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788574241.280075:0:6492:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788574241.280102:0:6492:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a3800/0x5bf8706fdac8cf1a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.280266:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2800/0x5bf8706fdac8cf13 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6af1 expref: 75 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.280456:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a3800/0x5bf8706fdac8cf1a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6af1 expref: 74 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.280467:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9c85fa28cb00) 00010000:00010000:1.0:1788574241.280470:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788574241.280475:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d08a3800, rc 0) 00000100:00100000:1.0:1788574241.280560:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3f25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+74:12467:x1875455669017856:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 923us (1384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574241.280568:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 242 00000100:00100000:0.0:1788574241.288315:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574241.288421:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669017984 00000100:00100000:1.0:1788574241.288435:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669017984 00000100:00100000:1.0:1788574241.288537:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 72 00000100:00100000:1.0:1788574241.288549:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3f27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:659467ff-94af-418e-92fe-11e4323a48aa+10:2393:x1875455669017984:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788574241.288575:0:8409:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574241.288604:0:8409:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000dce4c9a/0x5bf8706fdac8cf21 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6af8 expref: -99 pid: 8409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788574241.288648:0:8409:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9b7a20, blocks: 0x0 00010000:00010000:1.0:1788574241.288676:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=381s v=(0 0) 00010000:00010000:1.0:1788574241.288682:0:8409:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574241.288694:0:8409:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000dce4c9a/0x5bf8706fdac8cf21 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6af8 expref: 11 pid: 8409 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.288723:0:8409:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000dce4c9a/0x5bf8706fdac8cf21 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6af8 expref: 11 pid: 8409 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.288740:0:8409:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d08a2800, rc 0) 00000100:00100000:1.0:1788574241.288818:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3f27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:659467ff-94af-418e-92fe-11e4323a48aa+11:2393:x1875455669017984:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 271us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574241.288826:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 72 00000100:00100000:2.0:1788574241.298837:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574241.299480:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669018240 00000100:00100000:0.0:1788574241.299495:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669018240 00000100:00100000:0.0:1788574241.299582:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 243 00000100:00100000:0.0:1788574241.299596:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c443d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+74:12467:x1875455669018240:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788574241.299767:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c443d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+74:12467:x1875455669018240:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 Request processed in 174us (954us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574241.299776:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 243 00000100:00100000:0.0:1788574241.303373:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574241.303500:0:13791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669018368 00000100:00100000:1.0:1788574241.303513:0:13791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669018368 00000100:00100000:1.0:1788574241.303592:0:13791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 73 00000100:00100000:1.0:1788574241.303606:0:13791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3f26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:659467ff-94af-418e-92fe-11e4323a48aa+11:12467:x1875455669018368:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788574241.303637:0:13791:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574241.303679:0:13791:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fe1fdef5/0x5bf8706fdac8cf28 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6aff expref: -99 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.303745:0:13791:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000dce4c9a/0x5bf8706fdac8cf21 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6af8 expref: 12 pid: 8409 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.303758:0:13791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574241.303762:0:13791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574241.303768:0:13791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe1fdef5/0x5bf8706fdac8cf28 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6aff expref: 12 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.303814:0:13791:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000dce4c9a/0x5bf8706fdac8cf21 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6af8 expref: 12 pid: 8409 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.304062:0:13791:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000dce4c9a/0x5bf8706fdac8cf21 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6af8 expref: 12 pid: 8409 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574241.304080:0:13791:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c8601836680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:13791:1875455681652992:192.168.204.51@tcp:104: 00000100:00100000:1.0:1788574241.304426:0:13791:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c353b780 going to sleep for 11 seconds 00000100:00100000:2.0:1788574241.318464:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574241.318628:0:13791:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c8601836680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:13791:1875455681652992:192.168.204.51@tcp:104: 00010000:00010000:1.0:1788574241.318679:0:13791:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fe1fdef5/0x5bf8706fdac8cf28 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6aff expref: 12 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.318708:0:13791:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d08a3a00, rc 0) 00000100:00100000:1.0:1788574241.318815:0:13791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3f26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:659467ff-94af-418e-92fe-11e4323a48aa+12:12467:x1875455669018368:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 15211us (15457us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574241.320767:0:13791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 73 00000100:00100000:0.0:1788574241.321908:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669018496 00000100:00100000:0.0:1788574241.321992:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669018496 00010000:00010000:0.0:1788574241.322058:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000dce4c9a/0x5bf8706fdac8cf21 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6af8 expref: 12 pid: 8409 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574241.322289:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 102 00000100:00100000:0.0:1788574241.322309:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c443c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:659467ff-94af-418e-92fe-11e4323a48aa+12:2393:x1875455669018496:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788574241.322333:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574241.322366:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000dce4c9a/0x5bf8706fdac8cf21 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6af8 expref: 12 pid: 8409 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574241.322385:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000dce4c9a/0x5bf8706fdac8cf21 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6af8 expref: 12 pid: 8409 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574241.322418:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000dce4c9a/0x5bf8706fdac8cf21 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6af8 expref: 12 pid: 8409 timeout: 481 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574241.322444:0:6477:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788574241.322450:0:6477:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788574241.322462:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fe1fdef5/0x5bf8706fdac8cf28 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6aff expref: 11 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574241.322475:0:6477:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe1fdef5/0x5bf8706fdac8cf28 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6aff expref: 11 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574241.322528:0:6477:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000fe1fdef5/0x5bf8706fdac8cf28 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6aff expref: 11 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574241.322545:0:6477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c08700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6477:1875455681653120:192.168.204.51@tcp:105: 00000100:00100000:0.0:1788574241.322684:0:6477:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85d0e7fd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788574241.327449:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574241.327519:0:8415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669018624 00000100:00100000:2.0:1788574241.327532:0:8415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669018624 00002000:00100000:2.0:1788574241.327603:0:8415:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff9c84c3597480 x1875455669018624/t0(0) o4->659467ff-94af-418e-92fe-11e4323a48aa@192.168.204.51@tcp:392/0 lens 504/0 e 0 to 0 dl 1788574252 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788574241.327617:0:8415:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c84c3597480 with x1875455669018624 ext(0->12) 00002000:00010000:2.0:1788574241.327651:0:8415:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c84c3597480 00000100:00100000:2.0:1788574241.327700:0:8415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 7 00000100:00100000:2.0:1788574241.327711:0:8415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3597480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:659467ff-94af-418e-92fe-11e4323a48aa+12:2393:x1875455669018624:12345-192.168.204.51@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788574241.329576:0:6477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c08700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6477:1875455681653120:192.168.204.51@tcp:105: 00010000:00010000:0.0:1788574241.329612:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574241.329674:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c443c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:659467ff-94af-418e-92fe-11e4323a48aa+14:2393:x1875455669018496:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 7375us (11228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574241.329686:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 102 00000100:00100000:2.0:1788574241.333900:0:8415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3597480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:659467ff-94af-418e-92fe-11e4323a48aa+13:2393:x1875455669018624:12345-192.168.204.51@tcp:4:lhsmtool_posix.0 Request processed in 6044us (6319us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1788574241.333983:0:8415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 7 00002000:00100000:2.0:1788574241.334008:0:8415:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff9c84c3597480 x1875455669018624/t4294967322(0) o4->659467ff-94af-418e-92fe-11e4323a48aa@192.168.204.51@tcp:392/0 lens 504/448 e 0 to 0 dl 1788574252 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788574241.334020:0:8415:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c84c3597480 with x1875455669018624 ext(0->12) 00002000:00010000:2.0:1788574241.334028:0:8415:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c84c3597480 00000100:00100000:3.0:1788574241.338629:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574241.339267:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669018752 00000100:00100000:2.0:1788574241.339296:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669018752 00000100:00100000:2.0:1788574241.339387:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 244 00000100:00100000:2.0:1788574241.339400:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3596680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+74:12467:x1875455669018752:12345-192.168.204.51@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788574241.342996:0:6471:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967509 is committed 00000004:00080000:0.0:1788574241.343030:0:6471:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00010000:00010000:3.0:1788574241.343123:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7c00/0x5bf8706fdac8cc2d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574241.343147:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7c00/0x5bf8706fdac8cc2d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574241.343157:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7c00/0x5bf8706fdac8cc2d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574241.343178:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d7c00 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:3.0:1788574241.343186:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7c00/0x5bf8706fdac8cc2d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574241.343223:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7c00/0x5bf8706fdac8cc2d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574241.343248:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9c85fa28cf00) 00010000:00010000:3.0:1788574241.343251:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574241.343257:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7c00/0x5bf8706fdac8cc2d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574241.343265:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7c00/0x5bf8706fdac8cc2d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574241.343328:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8ccd5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574241.343334:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8ccd5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574241.343340:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8ccd5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574241.343345:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d6400 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:3.0:1788574241.343348:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8ccd5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574241.343354:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8ccd5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574241.343375:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9c85fa28c400) 00010000:00010000:3.0:1788574241.343378:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574241.343381:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8ccd5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574241.343387:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8ccd5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574241.343408:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8cd53 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574241.343415:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8cd53 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574241.343422:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8cd53 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574241.343427:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85faea2000 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:3.0:1788574241.343430:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8cd53 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574241.343437:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8cd53 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574241.343445:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c84c34f0000) 00010000:00010000:3.0:1788574241.343447:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574241.343451:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8cd53 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574241.343457:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2000/0x5bf8706fdac8cd53 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574241.343483:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8cd76 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574241.343490:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8cd76 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574241.343496:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8cd76 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574241.343502:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85faea3e00 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:3.0:1788574241.343506:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8cd76 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574241.343511:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8cd76 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574241.343520:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c84c34f0000) 00010000:00010000:3.0:1788574241.343523:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574241.343526:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8cd76 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574241.343532:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3e00/0x5bf8706fdac8cd76 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574241.343568:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8ce48 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574241.343576:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8ce48 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574241.343582:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8ce48 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574241.343595:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85c152f400 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:3.0:1788574241.343598:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8ce48 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574241.343605:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8ce48 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574241.343614:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c84c34f0e00) 00010000:00010000:3.0:1788574241.343616:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574241.343619:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8ce48 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574241.343625:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8ce48 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574241.343639:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e600/0x5bf8706fdac8cf05 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574241.343645:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e600/0x5bf8706fdac8cf05 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574241.343651:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e600/0x5bf8706fdac8cf05 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574241.343656:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32e600 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:3.0:1788574241.343658:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e600/0x5bf8706fdac8cf05 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574241.343664:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e600/0x5bf8706fdac8cf05 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574241.343682:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9c85fa28cb00) 00010000:00010000:3.0:1788574241.343685:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788574241.343688:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e600/0x5bf8706fdac8cf05 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574241.343694:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e600/0x5bf8706fdac8cf05 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788574241.343836:0:6471:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:0.0:1788574241.343861:0:6471:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c85fafeea80 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:0.0:1788574241.343866:0:6471:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c85fae5fd00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c85fafee6c0 00000020:00080000:0.0:1788574241.343870:0:6471:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c85fae5ff00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c84c3564c00 00000004:00080000:0.0:1788574241.343898:0:6471:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:2.0:1788574241.343958:0:6524:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1788574241.344561:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788574241.344583:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3596300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681653248:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788574241.344677:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574241.344763:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681653248 00000100:00100000:3.0:1788574241.344773:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681653248 00000100:00100000:3.0:1788574241.344859:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788574241.344870:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3594000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3620:x1875455681653248:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788574241.344909:0:8411:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00002000:00010000:3.0:1788574241.344963:0:8411:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a9b7a1f, atime: 0x6a9b7a1f, ctime: 0x6a9b7a1f, blocks: 0x8 00010000:00010000:3.0:1788574241.344973:0:8411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a209186/0x5bf8706fdac8cf2f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574241.344992:0:8411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=381s v=(0 0) 00010000:00010000:3.0:1788574241.344997:0:8411:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574241.345006:0:8411:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a209186/0x5bf8706fdac8cf2f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574241.345025:0:8411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a209186/0x5bf8706fdac8cf2f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574241.345053:0:8411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a209186/0x5bf8706fdac8cf2f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574241.345061:0:8411:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007a209186/0x5bf8706fdac8cf2f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574241.345080:0:8411:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788574241.345577:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3594000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3620:x1875455681653248:12345-0@lo:6:osp-syn-1-0.0 Request processed in 708us (900us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1788574241.345586:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:3.0:1788574241.345618:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1788574241.345659:0:3620:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c84c3596300/2, rc 0, transno 4294967311 00000100:00100000:3.0:1788574241.345667:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3596300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681653248:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1788574241.346235:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788574241.346247:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007a209186/0x5bf8706fdac8cf2f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574241.346258:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c84c2617200 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:2.0:1788574241.346263:0:6480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007a209186/0x5bf8706fdac8cf2f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574241.346285:0:6480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007a209186/0x5bf8706fdac8cf2f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574241.346380:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007a209186/0x5bf8706fdac8cf2f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574241.346388:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a209186/0x5bf8706fdac8cf2f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574241.346413:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574241.346415:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574241.346417:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574241.347241:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c8601836680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681653376:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788574241.347331:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574241.347492:0:8815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681653376 00000100:00100000:1.0:1788574241.347502:0:8815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681653376 00000100:00100000:1.0:1788574241.347569:0:8815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788574241.347580:0:8815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3594a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681653376:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788574241.347619:0:8815:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00010000:00010000:1.0:1788574241.347656:0:8815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042acfec9/0x5bf8706fdac8cf36 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.347686:0:8815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e240f75a/0x5bf8706fdac8cce3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a57 expref: 12 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.347698:0:8815:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=3s v=(0 0) 00010000:00010000:1.0:1788574241.347705:0:8815:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788574241.347711:0:8815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042acfec9/0x5bf8706fdac8cf36 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.347768:0:8815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e240f75a/0x5bf8706fdac8cce3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a57 expref: 12 pid: 8411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.347788:0:8815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e240f75a/0x5bf8706fdac8cce3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a57 expref: 12 pid: 8411 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574241.347803:0:8815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c8601834000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8815:1875455681653504:192.168.204.51@tcp:104: 00000100:00100000:1.0:1788574241.348264:0:8815:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c353b780 going to sleep for 11 seconds 00000020:00080000:0.0:1788574241.348675:0:6471:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c85fa1f1780 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:0.0:1788574241.348682:0:6471:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c85fae5f400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c85fa1f1f00 00000020:00080000:0.0:1788574241.348686:0:6471:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c85fae5fa00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c84c2597e00 00000020:00080000:2.0:1788574241.348718:0:6524:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:2.0:1788574241.348837:0:6524:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1788574241.353611:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3596680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+21:12467:x1875455669018752:12345-192.168.204.51@tcp:44:lhsmtool_posix.0 Request processed in 14197us (14987us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574241.353629:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 244 00000100:00100000:1.0:1788574241.355799:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574241.356457:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574241.356500:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669019008 00000100:00100000:1.0:1788574241.356530:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669019008 00000100:00100000:1.0:1788574241.356615:0:11893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669019264 00000100:00100000:1.0:1788574241.356618:0:11893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669019264 00000100:00100000:1.0:1788574241.356646:0:11893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 353 00000100:00100000:1.0:1788574241.356659:0:11893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601837800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:659467ff-94af-418e-92fe-11e4323a48aa+5:2395:x1875455669019008:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1788574241.357183:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574241.357263:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669018880 00000100:00100000:0.0:1788574241.357282:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669018880 00000100:00100000:0.0:1788574241.357325:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 396 00000100:00100000:0.0:1788574241.357335:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5675850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+13:2395:x1875455669018880:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1788574241.357388:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5675850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+13:2395:x1875455669018880:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 54us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574241.357397:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 396 00000100:00100000:0.0:1788574241.357460:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574241.357553:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574241.357592:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669019392 00000100:00100000:0.0:1788574241.357596:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669019392 00000100:00100000:0.0:1788574241.357621:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 354 00000100:00100000:0.0:1788574241.357628:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601834a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2395:x1875455669019264:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1788574241.358154:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 355 00000100:00100000:3.0:1788574241.358166:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2395:x1875455669019392:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1788574241.358500:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601834a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2395:x1875455669019264:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 871us (2044us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574241.358508:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 354 00000100:00080000:2.0:1788574241.359293:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788574241.359302:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788574241.364452:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2395:x1875455669019392:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 6270us (6879us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574241.364474:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 355 00000100:00100000:1.0:1788574241.366651:0:11893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601837800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:659467ff-94af-418e-92fe-11e4323a48aa+5:2395:x1875455669019008:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 9979us (10853us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574241.366669:0:11893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 353 00000100:00100000:1.0:1788574241.366728:0:13791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669019136 00000100:00100000:1.0:1788574241.366749:0:13791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669019136 00000100:00100000:1.0:1788574241.367061:0:13791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 137 00000100:00100000:1.0:1788574241.367072:0:13791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601b6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:659467ff-94af-418e-92fe-11e4323a48aa+5:2395:x1875455669019136:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788574241.367174:0:13791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601b6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:659467ff-94af-418e-92fe-11e4323a48aa+5:2395:x1875455669019136:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 104us (9713us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574241.367181:0:13791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 137 00000100:00100000:0.0:1788574241.367557:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574241.367588:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669019520 00000100:00100000:0.0:1788574241.367595:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669019520 00010000:00010000:0.0:1788574241.367630:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e240f75a/0x5bf8706fdac8cce3 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a57 expref: 13 pid: 8411 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574241.367682:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 103 00000100:00100000:0.0:1788574241.367690:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c0b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:659467ff-94af-418e-92fe-11e4323a48aa+13:2394:x1875455669019520:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788574241.367704:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574241.367711:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e240f75a/0x5bf8706fdac8cce3 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a57 expref: 13 pid: 8411 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574241.367726:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e240f75a/0x5bf8706fdac8cce3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a57 expref: 13 pid: 8411 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574241.368426:0:6479:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788574241.368433:0:6479:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788574241.368442:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000042acfec9/0x5bf8706fdac8cf36 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574241.368475:0:6479:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042acfec9/0x5bf8706fdac8cf36 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574241.368504:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574241.368553:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c0b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:659467ff-94af-418e-92fe-11e4323a48aa+13:2394:x1875455669019520:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 863us (998us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574241.368562:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 103 00000100:00100000:0.0:1788574241.369448:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00010000:00010000:1.0:1788574241.370531:0:8815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e240f75a/0x5bf8706fdac8cce3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a57 expref: 12 pid: 8411 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574241.370561:0:8815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c8601834000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8815:1875455681653504:192.168.204.51@tcp:104: 00010000:00010000:1.0:1788574241.370593:0:8815:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000042acfec9/0x5bf8706fdac8cf36 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.370607:0:8815:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000042acfec9/0x5bf8706fdac8cf36 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.370616:0:8815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042acfec9/0x5bf8706fdac8cf36 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.370646:0:8815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042acfec9/0x5bf8706fdac8cf36 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.370654:0:8815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042acfec9/0x5bf8706fdac8cf36 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.370680:0:8815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788574241.371044:0:8815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3594a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3620:x1875455681653376:12345-0@lo:6:osp-syn-0-0.0 Request processed in 23465us (23711us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1788574241.371055:0:8815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788574241.371318:0:8815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669019648 00000100:00100000:1.0:1788574241.371326:0:8815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669019648 00000100:00100000:1.0:1788574241.371372:0:8815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 76 00000100:00100000:1.0:1788574241.371381:0:8815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:659467ff-94af-418e-92fe-11e4323a48aa+12:2394:x1875455669019648:12345-192.168.204.51@tcp:16:lhsmtool_posix.0 00010000:00010000:1.0:1788574241.371672:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788574241.371681:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042acfec9/0x5bf8706fdac8cf36 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.371692:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d08a2400 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:1.0:1788574241.371697:0:6481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042acfec9/0x5bf8706fdac8cf36 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.371709:0:6481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042acfec9/0x5bf8706fdac8cf36 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.371765:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042acfec9/0x5bf8706fdac8cf36 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.371773:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042acfec9/0x5bf8706fdac8cf36 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.371796:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574241.371799:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574241.371800:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788574241.371849:0:3620:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c8601836680/2, rc 0, transno 4294967323 00000100:00100000:1.0:1788574241.371863:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c8601836680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681653376:0@lo:6:osp-syn-0-0.0 00000100:00080000:3.0:1788574241.372745:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1788574241.375420:0:8404:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:1.0:1788574241.375445:0:8404:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000100:00100000:3.0:1788574241.376041:0:8815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:659467ff-94af-418e-92fe-11e4323a48aa+7:2394:x1875455669019648:12345-192.168.204.51@tcp:16:lhsmtool_posix.0 Request processed in 4651us (6588us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574241.376058:0:8815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 76 00000100:00100000:3.0:1788574241.379645:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574241.379873:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669019904 00000100:00100000:0.0:1788574241.379887:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669019904 00000100:00100000:0.0:1788574241.379982:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 245 00000100:00100000:0.0:1788574241.379994:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3594000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+21:12467:x1875455669019904:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788574241.380079:0:6494:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574241.380119:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a3800/0x5bf8706fdac8cf1a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6af1 expref: 21 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574241.380159:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9c85fa28cb00) 00010000:00010000:0.0:1788574241.380166:0:6494:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788574241.380286:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7c00/0x5bf8706fdac8cf3d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574241.380305:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7c00/0x5bf8706fdac8cf3d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574241.380318:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7c00/0x5bf8706fdac8cf3d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788574241.380519:0:6494:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b5a6fd13 reply state 00000000f8c58ceb transno 4294967510 ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7c00/0x5bf8706fdac8cf3d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574241.380534:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7c00/0x5bf8706fdac8cf3d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574241.380541:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9c85fa28cb00) 00010000:00010000:0.0:1788574241.380543:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788574241.380546:0:6494:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788574241.380682:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3594000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+22:12467:x1875455669019904:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 Request processed in 690us (1054us total) trans 4294967510 rc 0/0 00000100:00100000:0.0:1788574241.380691:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 245 00000100:00100000:3.0:1788574241.384153:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574241.384297:0:13791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669020032 00000100:00100000:1.0:1788574241.384312:0:13791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669020032 00000100:00100000:1.0:1788574241.384390:0:13791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 77 00000100:00100000:1.0:1788574241.384401:0:13791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3594a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:659467ff-94af-418e-92fe-11e4323a48aa+7:2393:x1875455669020032:12345-192.168.204.51@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788574241.384627:0:13791:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788574241.384631:0:13791:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1788574239 00002000:00010000:1.0:1788574241.384634:0:13791:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 1788574239 00002000:00010000:1.0:1788574241.384636:0:13791:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1788574240 -> 1788574239 00002000:00010000:1.0:1788574241.384639:0:13791:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1788574241.384721:0:13791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3594a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:659467ff-94af-418e-92fe-11e4323a48aa+8:2393:x1875455669020032:12345-192.168.204.51@tcp:2:lhsmtool_posix.0 Request processed in 321us (592us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1788574241.384730:0:13791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 77 00000100:00100000:2.0:1788574241.388155:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574241.388736:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669020288 00000100:00100000:3.0:1788574241.388753:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669020288 00000100:00100000:3.0:1788574241.388839:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 246 00000100:00100000:3.0:1788574241.388855:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c443f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+22:12467:x1875455669020288:12345-192.168.204.51@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788574241.388978:0:6493:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617200/0x5bf8706fdac8cf44 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574241.389001:0:6493:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8cefe lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ae3 expref: 22 pid: 11893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574241.389012:0:6493:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617200/0x5bf8706fdac8cf44 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574241.389599:0:6493:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8cefe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ae3 expref: 22 pid: 11893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574241.389620:0:6493:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8cefe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ae3 expref: 22 pid: 11893 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574241.389639:0:6493:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c443ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6493:1875455681653632:192.168.204.51@tcp:104: 00000100:00100000:2.0:1788574241.389778:0:6493:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8600c3af00 going to sleep for 11 seconds 00000100:00100000:3.0:1788574241.394423:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574241.394573:0:6493:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c443ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6493:1875455681653632:192.168.204.51@tcp:104: 00010000:00010000:2.0:1788574241.394634:0:6493:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617200/0x5bf8706fdac8cf44 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574241.395569:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669020416 00000100:00100000:1.0:1788574241.395583:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669020416 00010000:00010000:1.0:1788574241.395651:0:6478:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8cefe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ae3 expref: 23 pid: 11893 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574241.395999:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 104 00000100:00100000:1.0:1788574241.396012:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:659467ff-94af-418e-92fe-11e4323a48aa+23:2394:x1875455669020416:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788574241.396034:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574241.396107:0:6478:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8cefe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ae3 expref: 23 pid: 11893 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.396123:0:6478:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8cefe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ae3 expref: 23 pid: 11893 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.396260:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617400/0x5bf8706fdac8cefe lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ae3 expref: 23 pid: 11893 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.396299:0:6478:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9c85fa28cb00) 00010000:00010000:1.0:1788574241.396306:0:6478:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617200/0x5bf8706fdac8cf44 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.396319:0:6478:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617200/0x5bf8706fdac8cf44 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.396329:0:6478:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617200/0x5bf8706fdac8cf44 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.396419:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788574241.396516:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:659467ff-94af-418e-92fe-11e4323a48aa+22:2394:x1875455669020416:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 505us (2108us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574241.396542:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 104 00010000:00010000:2.0:1788574241.398507:0:6493:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617200/0x5bf8706fdac8cf44 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574241.398531:0:6493:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617200/0x5bf8706fdac8cf44 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574241.398595:0:6493:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617200/0x5bf8706fdac8cf44 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574241.398603:0:6493:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617200/0x5bf8706fdac8cf44 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574241.398610:0:6493:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617200/0x5bf8706fdac8cf44 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574241.398616:0:6493:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c84c2617200 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:2.0:1788574241.398623:0:6493:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617200/0x5bf8706fdac8cf44 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574241.398631:0:6493:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617200/0x5bf8706fdac8cf44 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574241.398651:0:6493:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9c85fa28cb00) 00010000:00010000:2.0:1788574241.398655:0:6493:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788574241.398660:0:6493:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617200/0x5bf8706fdac8cf44 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574241.398667:0:6493:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617200/0x5bf8706fdac8cf44 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6493 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574241.399379:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c443f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+21:12467:x1875455669020288:12345-192.168.204.51@tcp:55:lhsmtool_posix.0 Request processed in 10521us (11242us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788574241.399394:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 246 00000100:00100000:3.0:1788574241.402556:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574241.402790:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669020544 00000100:00100000:2.0:1788574241.402806:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669020544 00000100:00100000:2.0:1788574241.403044:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 78 00000100:00100000:2.0:1788574241.403056:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:659467ff-94af-418e-92fe-11e4323a48aa+8:2393:x1875455669020544:12345-192.168.204.51@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788574241.403121:0:8410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c1cb0df0/0x5bf8706fdac8cf4b lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574241.403243:0:8410:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fe1fdef5/0x5bf8706fdac8cf28 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6aff expref: 8 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574241.403253:0:8410:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574241.403258:0:8410:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788574241.403264:0:8410:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1cb0df0/0x5bf8706fdac8cf4b lrc: 4/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574241.403322:0:8410:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fe1fdef5/0x5bf8706fdac8cf28 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6aff expref: 8 pid: 13791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574241.403339:0:8410:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fe1fdef5/0x5bf8706fdac8cf28 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6aff expref: 8 pid: 13791 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574241.403358:0:8410:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c443ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8410:1875455681653760:192.168.204.51@tcp:104: 00000100:00100000:2.0:1788574241.403490:0:8410:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c82c7540 going to sleep for 11 seconds 00000100:00100000:2.0:1788574241.406355:0:8410:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c443ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8410:1875455681653760:192.168.204.51@tcp:104: 00010000:00010000:2.0:1788574241.406401:0:8410:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c1cb0df0/0x5bf8706fdac8cf4b lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574241.408877:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574241.410117:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669020672 00000100:00100000:0.0:1788574241.410145:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669020672 00010000:00010000:0.0:1788574241.410247:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fe1fdef5/0x5bf8706fdac8cf28 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6aff expref: 9 pid: 13791 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574241.410313:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 105 00000100:00100000:0.0:1788574241.410326:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601834000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:659467ff-94af-418e-92fe-11e4323a48aa+9:2393:x1875455669020672:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788574241.410346:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574241.410377:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fe1fdef5/0x5bf8706fdac8cf28 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6aff expref: 9 pid: 13791 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574241.410393:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fe1fdef5/0x5bf8706fdac8cf28 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6aff expref: 9 pid: 13791 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574241.410422:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fe1fdef5/0x5bf8706fdac8cf28 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6aff expref: 9 pid: 13791 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574241.410462:0:6479:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788574241.410466:0:6479:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788574241.410473:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c1cb0df0/0x5bf8706fdac8cf4b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574241.410484:0:6479:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1cb0df0/0x5bf8706fdac8cf4b lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574241.410523:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574241.410603:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601834000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:659467ff-94af-418e-92fe-11e4323a48aa+8:2393:x1875455669020672:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 278us (1737us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574241.410611:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 105 00010000:00010000:2.0:1788574241.410857:0:8410:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c1cb0df0/0x5bf8706fdac8cf4b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574241.410870:0:8410:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c1cb0df0/0x5bf8706fdac8cf4b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574241.410900:0:8410:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000c1cb0df0/0x5bf8706fdac8cf4b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574241.410910:0:8410:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c1cb0df0/0x5bf8706fdac8cf4b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574241.410919:0:8410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c1cb0df0/0x5bf8706fdac8cf4b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574241.410938:0:8410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32fe00 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:2.0:1788574241.410944:0:8410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1cb0df0/0x5bf8706fdac8cf4b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574241.410954:0:8410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1cb0df0/0x5bf8706fdac8cf4b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574241.410984:0:8410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c1cb0df0/0x5bf8706fdac8cf4b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574241.410992:0:8410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c1cb0df0/0x5bf8706fdac8cf4b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574241.411054:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:659467ff-94af-418e-92fe-11e4323a48aa+7:2393:x1875455669020544:12345-192.168.204.51@tcp:1:lhsmtool_posix.0 Request processed in 8000us (8511us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574241.411064:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 78 00000100:00100000:1.0:1788574241.421618:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574241.421725:0:11893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669020928 00000100:00100000:2.0:1788574241.421739:0:11893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669020928 00000100:00100000:2.0:1788574241.421817:0:11893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 247 00000100:00100000:2.0:1788574241.421834:0:11893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601837480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:659467ff-94af-418e-92fe-11e4323a48aa+21:12467:x1875455669020928:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788574241.421937:0:11893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8cf52 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574241.421957:0:11893:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8ce41 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6aab expref: 21 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574241.421969:0:11893:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8cf52 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574241.422009:0:11893:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8ce41 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6aab expref: 21 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574241.422024:0:11893:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8ce41 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6aab expref: 21 pid: 7439 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574241.422067:0:11893:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c443ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11893:1875455681653888:192.168.204.51@tcp:104: 00000100:00100000:2.0:1788574241.422173:0:11893:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c82c7540 going to sleep for 11 seconds 00000100:00100000:1.0:1788574241.426016:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574241.426248:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669021056 00000100:00100000:0.0:1788574241.426260:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669021056 00010000:00010000:0.0:1788574241.426326:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8ce41 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6aab expref: 22 pid: 7439 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574241.426393:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 106 00000100:00100000:0.0:1788574241.426405:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601834e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:659467ff-94af-418e-92fe-11e4323a48aa+22:2396:x1875455669021056:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788574241.426424:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574241.426433:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8ce41 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6aab expref: 22 pid: 7439 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574241.426449:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8ce41 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6aab expref: 22 pid: 7439 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574241.426503:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c84c34f0e00) 00010000:00010000:0.0:1788574241.426510:0:6477:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a3000/0x5bf8706fdac8cea3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ace expref: 22 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574241.426524:0:6477:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8cf52 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574241.426533:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8cf52 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574241.426543:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8cf52 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574241.426571:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574241.426648:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601834e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:659467ff-94af-418e-92fe-11e4323a48aa+22:2396:x1875455669021056:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 245us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574241.426657:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 106 00010000:00010000:2.0:1788574241.427261:0:11893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3800/0x5bf8706fdac8ce41 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6aab expref: 21 pid: 7439 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574241.427297:0:11893:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c443ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11893:1875455681653888:192.168.204.51@tcp:104: 00010000:00010000:2.0:1788574241.427326:0:11893:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8cf52 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574241.427338:0:11893:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8cf52 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574241.427345:0:11893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8cf52 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574241.427579:0:11893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e400/0x5bf8706fdac8cf59 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574241.427595:0:11893:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8cf0c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6aea expref: 21 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574241.427604:0:11893:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e400/0x5bf8706fdac8cf59 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574241.427642:0:11893:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8cf0c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6aea expref: 21 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574241.427659:0:11893:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8cf0c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6aea expref: 21 pid: 7439 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574241.427686:0:11893:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c443ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11893:1875455681654016:192.168.204.51@tcp:104: 00000100:00100000:2.0:1788574241.427778:0:11893:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c82c7c00 going to sleep for 11 seconds 00010000:00010000:2.0:1788574241.429458:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574241.433954:0:11893:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c443ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11893:1875455681654016:192.168.204.51@tcp:104: 00010000:00010000:2.0:1788574241.433998:0:11893:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e400/0x5bf8706fdac8cf59 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574241.436389:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574241.436679:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669021184 00000100:00100000:0.0:1788574241.436694:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669021184 00010000:00010000:0.0:1788574241.436773:0:6479:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8cf0c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6aea expref: 22 pid: 7439 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574241.436831:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 107 00000100:00100000:0.0:1788574241.436844:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e0bdf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:659467ff-94af-418e-92fe-11e4323a48aa+22:2393:x1875455669021184:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788574241.436866:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574241.436875:0:6479:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8cf0c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6aea expref: 22 pid: 7439 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574241.436929:0:6479:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8cf0c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6aea expref: 22 pid: 7439 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574241.436960:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7e00/0x5bf8706fdac8cf0c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6aea expref: 22 pid: 7439 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574241.436985:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9c85fa28cb00) 00010000:00010000:0.0:1788574241.436991:0:6479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e400/0x5bf8706fdac8cf59 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574241.437004:0:6479:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e400/0x5bf8706fdac8cf59 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574241.437013:0:6479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e400/0x5bf8706fdac8cf59 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574241.437395:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574241.437473:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e0bdf450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:659467ff-94af-418e-92fe-11e4323a48aa+21:2393:x1875455669021184:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 629us (1095us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574241.437482:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 107 00010000:00010000:2.0:1788574241.439011:0:11893:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e400/0x5bf8706fdac8cf59 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574241.439029:0:11893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e400/0x5bf8706fdac8cf59 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788574241.439444:0:11893:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:2.0:1788574241.439585:0:11893:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000001:00080000:2.0:1788574241.439621:0:11893:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:2.0:1788574241.439721:0:11893:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c443ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11893:1875455681654144:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788574241.439994:0:11893:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574241.440106:0:11893:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c82c7180 going to sleep for 11 seconds 00000100:00100000:3.0:1788574241.442438:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681654144 00000100:00100000:3.0:1788574241.442456:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681654144 00000100:00100000:3.0:1788574241.442570:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1788574241.442583:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c443f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:11893:x1875455681654144:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788574241.442771:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c443f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:11893:x1875455681654144:12345-0@lo:1000:mdt00_004.0 Request processed in 190us (2777us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574241.442779:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1788574241.442877:0:11893:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967323 gen 2 00000004:00080000:1.0:1788574241.442885:0:11893:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c8601836680, transno 4294967323 00000100:00100000:1.0:1788574241.442912:0:11893:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c443ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11893:1875455681654144:0@lo:1000:mdt00_004.0 00000001:00080000:1.0:1788574241.443112:0:11893:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967514 00000100:00100000:1.0:1788574241.443239:0:11893:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c8601835f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11893:1875455681654272:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1788574241.443302:0:11893:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574241.444027:0:11893:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c353b240 going to sleep for 11 seconds 00000100:00100000:2.0:1788574241.444091:0:7533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681654272 00000100:00100000:2.0:1788574241.444098:0:7533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681654272 00000100:00100000:0.0:1788574241.444301:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1788574241.444315:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601834700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:11893:x1875455681654272:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788574241.444487:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601834700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:11893:x1875455681654272:12345-0@lo:1000:mdt00_004.0 Request processed in 175us (1184us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1788574241.444495:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1788574241.444581:0:11893:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c8601835f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:11893:1875455681654272:0@lo:1000:mdt00_004.0 00010000:00010000:1.0:1788574241.444631:0:11893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e400/0x5bf8706fdac8cf59 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.444643:0:11893:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e400/0x5bf8706fdac8cf59 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.444651:0:11893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e400/0x5bf8706fdac8cf59 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.444658:0:11893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32e400 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:1.0:1788574241.444663:0:11893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e400/0x5bf8706fdac8cf59 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.444673:0:11893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e400/0x5bf8706fdac8cf59 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.444716:0:11893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9c85fa28cb00) 00010000:00010000:1.0:1788574241.444720:0:11893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788574241.444727:0:11893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e400/0x5bf8706fdac8cf59 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.444750:0:11893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e400/0x5bf8706fdac8cf59 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.444794:0:11893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8ce9c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.444801:0:11893:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8ce9c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.444807:0:11893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8ce9c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.444813:0:11893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c84c2617000 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:1.0:1788574241.444816:0:11893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8ce9c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.444938:0:11893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8ce9c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.444948:0:11893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c84c34f0e00) 00010000:00010000:1.0:1788574241.444951:0:11893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788574241.444960:0:11893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a3000/0x5bf8706fdac8cea3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ace expref: 24 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.444975:0:11893:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a3000/0x5bf8706fdac8cea3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ace expref: 24 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.444996:0:11893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a3000/0x5bf8706fdac8cea3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ace expref: 24 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.445033:0:11893:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a3000/0x5bf8706fdac8cea3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ace expref: 24 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574241.445048:0:11893:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c8601835500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11893:1875455681654400:192.168.204.51@tcp:105: 00000100:00100000:1.0:1788574241.445300:0:11893:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c353b240 going to sleep for 11 seconds 00000100:00100000:1.0:1788574241.449762:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574241.450626:0:11893:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c8601835500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11893:1875455681654400:192.168.204.51@tcp:105: 00010000:00010000:3.0:1788574241.450664:0:11893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8ce9c lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574241.450701:0:11893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8ce9c lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574241.450915:0:11893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ea00/0x5bf8706fdac8cf60 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574241.450943:0:11893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ea00/0x5bf8706fdac8cf60 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574241.450956:0:11893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ea00/0x5bf8706fdac8cf60 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574241.450975:0:11893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ea00/0x5bf8706fdac8cf60 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574241.450982:0:11893:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ea00/0x5bf8706fdac8cf60 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574241.450989:0:11893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ea00/0x5bf8706fdac8cf60 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574241.450994:0:11893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32ea00 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:2.0:1788574241.450999:0:11893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ea00/0x5bf8706fdac8cf60 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574241.451007:0:11893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ea00/0x5bf8706fdac8cf60 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574241.451020:0:11893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c84c34f0e00) 00010000:00010000:2.0:1788574241.451023:0:11893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788574241.451028:0:11893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ea00/0x5bf8706fdac8cf60 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574241.451033:0:11893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32ea00/0x5bf8706fdac8cf60 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574241.451044:0:11893:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8cf52 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574241.451050:0:11893:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8cf52 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574241.451056:0:11893:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8cf52 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574241.451067:0:11893:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32fe00 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:2.0:1788574241.451071:0:11893:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8cf52 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574241.451076:0:11893:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8cf52 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574241.451086:0:11893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c84c34f0e00) 00010000:00010000:2.0:1788574241.451088:0:11893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788574241.451091:0:11893:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8cf52 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574241.451095:0:11893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fe00/0x5bf8706fdac8cf52 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574241.451356:0:11893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601837480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:659467ff-94af-418e-92fe-11e4323a48aa+24:12467:x1875455669020928:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 Request processed in 29528us (29749us total) trans 4294967515 rc 0/0 00000100:00100000:2.0:1788574241.451369:0:11893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 247 00000020:00080000:2.0:1788574241.451375:0:11893:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788574241.453076:0:13764:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788574241.453088:0:13764:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788574241.453609:0:13764:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1788574241.453622:0:13764:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788574241.455315:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669021312 00000100:00100000:0.0:1788574241.455336:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669021312 00000100:00100000:0.0:1788574241.455463:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 61 00000100:00100000:0.0:1788574241.455475:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601835180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:659467ff-94af-418e-92fe-11e4323a48aa+24:12466:x1875455669021312:12345-192.168.204.51@tcp:49:lfs.0 00000100:00100000:0.0:1788574241.455647:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601835180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:659467ff-94af-418e-92fe-11e4323a48aa+24:12466:x1875455669021312:12345-192.168.204.51@tcp:49:lfs.0 Request processed in 173us (5906us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574241.455655:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 61 00000100:00100000:0.0:1788574241.459561:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574241.459643:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669021568 00000100:00100000:2.0:1788574241.459655:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669021568 00000100:00100000:2.0:1788574241.459723:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 248 00000100:00100000:2.0:1788574241.459733:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+24:12466:x1875455669021568:12345-192.168.204.51@tcp:58:lfs.0 00000040:00080000:2.0:1788574241.459998:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:2.0:1788574241.460107:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+24:12466:x1875455669021568:12345-192.168.204.51@tcp:58:lfs.0 Request processed in 374us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574241.460114:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 248 00000100:00100000:0.0:1788574241.472315:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574241.473896:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669021824 00000100:00100000:1.0:1788574241.473918:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669021824 00000100:00100000:1.0:1788574241.474017:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 62 00000100:00100000:1.0:1788574241.474028:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85d01f7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:659467ff-94af-418e-92fe-11e4323a48aa+24:12467:x1875455669021824:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788574241.474461:0:6495:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788574241.474507:0:6495:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967516 00010000:00010000:1.0:1788574241.474550:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a3c00/0x5bf8706fdac8cf67 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.474572:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a3c00/0x5bf8706fdac8cf67 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.474587:0:6495:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a3c00/0x5bf8706fdac8cf67 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.474597:0:6495:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a3c00/0x5bf8706fdac8cf67 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.474604:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a3c00/0x5bf8706fdac8cf67 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.474629:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a3c00/0x5bf8706fdac8cf67 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.474656:0:6495:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788574241.474789:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85d01f7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:659467ff-94af-418e-92fe-11e4323a48aa+26:12467:x1875455669021824:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 Request processed in 761us (2489us total) trans 4294967517 rc 0/0 00000100:00100000:1.0:1788574241.474798:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 62 00000020:00080000:1.0:1788574241.474805:0:6495:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788574241.475103:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788574241.475112:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a3c00/0x5bf8706fdac8cf67 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574241.475120:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d08a3c00 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:3.0:1788574241.475125:0:6480:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a3c00/0x5bf8706fdac8cf67 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574241.475134:0:6480:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a3c00/0x5bf8706fdac8cf67 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574241.475149:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9c85fa28cb00) 00010000:00010000:3.0:1788574241.475152:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788574241.475157:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a3c00/0x5bf8706fdac8cf67 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574241.475176:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a3c00/0x5bf8706fdac8cf67 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6495 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574241.475203:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574241.475205:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574241.475207:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574241.505898:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574241.506073:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669021952 00000100:00100000:2.0:1788574241.506110:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669021952 00000100:00100000:0.0:1788574241.506250:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 249 00000100:00100000:0.0:1788574241.506282:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+26:12469:x1875455669021952:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:0.0:1788574241.506311:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574241.506425:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2e00/0x5bf8706fdac8cf6e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6b06 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.506492:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a3e00/0x5bf8706fdac8cf75 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.506506:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a3e00/0x5bf8706fdac8cf75 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.506517:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a3e00/0x5bf8706fdac8cf75 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.506532:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2c00/0x5bf8706fdac8cf7c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.506539:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2c00/0x5bf8706fdac8cf7c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.506546:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2c00/0x5bf8706fdac8cf7c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.506612:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2600/0x5bf8706fdac8cf83 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.506634:0:6494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a3400/0x5bf8706fdac8ce8e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ac7 expref: 27 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.506643:0:6494:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2600/0x5bf8706fdac8cf83 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.506674:0:6494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a3400/0x5bf8706fdac8ce8e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ac7 expref: 27 pid: 6493 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574241.506688:0:6494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a3400/0x5bf8706fdac8ce8e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ac7 expref: 27 pid: 6493 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574241.506701:0:6494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c8601835180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6494:1875455681654528:192.168.204.51@tcp:104: 00000100:00100000:1.0:1788574241.506803:0:6494:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c353b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788574241.520092:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574241.520544:0:6494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c8601835180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6494:1875455681654528:192.168.204.51@tcp:104: 00010000:00010000:2.0:1788574241.520585:0:6494:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2600/0x5bf8706fdac8cf83 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574241.521435:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669022208 00000100:00100000:0.0:1788574241.521448:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669022208 00000100:00100000:0.0:1788574241.521505:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 63 00000100:00100000:0.0:1788574241.521513:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601835c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:659467ff-94af-418e-92fe-11e4323a48aa+28:6162:x1875455669022208:12345-192.168.204.51@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788574241.521855:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601835c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:659467ff-94af-418e-92fe-11e4323a48aa+29:6162:x1875455669022208:12345-192.168.204.51@tcp:35:ldlm_bl.0 Request processed in 340us (1771us total) trans 4294967518 rc 0/0 00000100:00100000:0.0:1788574241.521864:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 63 00000100:00100000:2.0:1788574241.532257:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574241.533991:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669022336 00000100:00100000:0.0:1788574241.534006:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669022336 00010000:00010000:0.0:1788574241.534062:0:6477:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a3400/0x5bf8706fdac8ce8e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ac7 expref: 29 pid: 6493 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574241.534106:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 108 00000100:00100000:0.0:1788574241.534116:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c443c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:659467ff-94af-418e-92fe-11e4323a48aa+29:2393:x1875455669022336:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788574241.534148:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574241.534155:0:6477:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a3400/0x5bf8706fdac8ce8e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ac7 expref: 29 pid: 6493 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574241.534170:0:6477:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a3400/0x5bf8706fdac8ce8e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ac7 expref: 29 pid: 6493 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574241.534221:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a3400/0x5bf8706fdac8ce8e lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ac7 expref: 29 pid: 6493 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574241.534239:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c84c34f0e00) 00010000:00010000:0.0:1788574241.534244:0:6477:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2600/0x5bf8706fdac8cf83 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574241.534254:0:6477:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2600/0x5bf8706fdac8cf83 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574241.534262:0:6477:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2600/0x5bf8706fdac8cf83 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574241.534298:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574241.534362:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c443c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:659467ff-94af-418e-92fe-11e4323a48aa+28:2393:x1875455669022336:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 247us (2120us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574241.534369:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 108 00010000:00010000:2.0:1788574241.534901:0:6494:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2600/0x5bf8706fdac8cf83 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574241.534928:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2600/0x5bf8706fdac8cf83 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788574241.535003:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788574241.535009:0:6494:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788574241.535035:0:6494:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2600/0x5bf8706fdac8cf83 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574241.535055:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2600/0x5bf8706fdac8cf83 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574241.535068:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a3e00/0x5bf8706fdac8cf75 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574241.535076:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a3e00/0x5bf8706fdac8cf75 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574241.535083:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a3e00/0x5bf8706fdac8cf75 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574241.535088:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d08a3e00 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:2.0:1788574241.535093:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a3e00/0x5bf8706fdac8cf75 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574241.535121:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a3e00/0x5bf8706fdac8cf75 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574241.535150:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c85d07b8d00) 00010000:00010000:2.0:1788574241.535154:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788574241.535160:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a3e00/0x5bf8706fdac8cf75 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574241.535167:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a3e00/0x5bf8706fdac8cf75 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574241.535184:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2c00/0x5bf8706fdac8cf7c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574241.535232:0:6494:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2c00/0x5bf8706fdac8cf7c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574241.535238:0:6494:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2c00/0x5bf8706fdac8cf7c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574241.535244:0:6494:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d08a2c00 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:2.0:1788574241.535247:0:6494:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2c00/0x5bf8706fdac8cf7c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574241.535254:0:6494:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2c00/0x5bf8706fdac8cf7c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574241.535275:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9c84c34f0700) 00010000:00010000:2.0:1788574241.535279:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788574241.535284:0:6494:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2c00/0x5bf8706fdac8cf7c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574241.535311:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2c00/0x5bf8706fdac8cf7c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574241.535368:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2e00/0x5bf8706fdac8cf6e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6b06 expref: 28 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574241.535388:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2600/0x5bf8706fdac8cf83 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6b06 expref: 27 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574241.535397:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c84c34f0e00) 00010000:00010000:2.0:1788574241.535399:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788574241.535402:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d08a2600, rc 0) 00000100:00100000:2.0:1788574241.535479:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:659467ff-94af-418e-92fe-11e4323a48aa+27:12469:x1875455669021952:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 29215us (29586us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574241.535489:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 249 00000100:00100000:0.0:1788574241.939590:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:69505170-06bc-41d1-9626-ab1a3c7f32a0:3617:1875455681654656:0@lo:400:kworker.0 00000100:00100000:3.0:1788574241.939626:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875455681654784:0@lo:400:kworker.0 00000100:00100000:2.0:1788574241.939713:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681654912:0@lo:400:kworker.0 00000100:00100000:3.0:1788574241.940545:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574241.940609:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3618:1875455681655296:0@lo:400:kworker.0 00000100:00100000:3.0:1788574241.940635:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574241.940662:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3618:1875455681655808:0@lo:400:kworker.0 00000100:00100000:3.0:1788574241.940686:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574241.940731:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681654784 00000100:00100000:3.0:1788574241.940738:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681654784 00000100:00100000:3.0:1788574241.940904:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681655296 00000100:00100000:3.0:1788574241.940908:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681655296 00000100:00100000:3.0:1788574241.940933:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681655808 00000100:00100000:3.0:1788574241.940936:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681655808 00000100:00100000:3.0:1788574241.940952:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1788574241.940960:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875455681654784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574241.941012:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875455681654784:12345-0@lo:400:kworker.0 Request processed in 53us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574241.941019:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1788574241.941037:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1788574241.941043:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875455681655296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574241.941068:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875455681655296:12345-0@lo:400:kworker.0 Request processed in 25us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574241.941074:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1788574241.941086:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1788574241.941091:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875455681655808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574241.941114:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875455681655808:12345-0@lo:400:kworker.0 Request processed in 23us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574241.941120:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00080000:3.0:1788574241.941149:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788574241.941153:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788574241.941181:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875455681654784:0@lo:400:kworker.0 00000100:00100000:3.0:1788574241.941211:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3618:1875455681655296:0@lo:400:kworker.0 00010000:00080000:3.0:1788574241.941222:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3c0a680 x1875455681655808/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574257 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574241.941233:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3618:1875455681655808:0@lo:400:kworker.0 00000100:00100000:3.0:1788574241.942238:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574241.942336:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1875455681655424:0@lo:400:kworker.0 00000100:00100000:3.0:1788574241.942368:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574241.942421:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681655936:0@lo:400:kworker.0 00000100:00100000:3.0:1788574241.942449:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574241.942488:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788574241.942498:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875455681655040:0@lo:400:kworker.0 00000100:00100000:3.0:1788574241.942530:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574241.942558:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681655552:0@lo:400:kworker.0 00000100:00100000:1.0:1788574241.942562:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788574241.942587:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574241.942587:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c8601836a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681656192:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788574241.942616:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c8601837100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681656064:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788574241.942664:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574241.942670:0:8815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681655936 00000100:00100000:3.0:1788574241.942679:0:8815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681655936 00000100:00100000:1.0:1788574241.942746:0:13791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681655552 00000100:00100000:1.0:1788574241.942755:0:13791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681655552 00000100:00100000:3.0:1788574241.942762:0:8815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788574241.942773:0:8815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681655936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574241.942809:0:13791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788574241.942820:0:13791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681655552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574241.942993:0:8815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681655936:12345-0@lo:400:kworker.0 Request processed in 221us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574241.943016:0:8815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788574241.943045:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681655424 00000100:00100000:3.0:1788574241.943049:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681655424 00000100:00100000:3.0:1788574241.943077:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681655040 00000100:00100000:3.0:1788574241.943080:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681655040 00000100:00100000:3.0:1788574241.943096:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1788574241.943102:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875455681655424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574241.943136:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875455681655424:12345-0@lo:400:kworker.0 Request processed in 34us (768us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574241.943142:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1788574241.943153:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1788574241.943158:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875455681655040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574241.943181:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875455681655040:12345-0@lo:400:kworker.0 Request processed in 23us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574241.943208:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00080000:3.0:1788574241.943230:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788574241.943235:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788574241.943307:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788574241.943348:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3c08380 x1875455681655424/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574257 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574241.943360:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1875455681655424:0@lo:400:kworker.0 00000100:00100000:3.0:1788574241.943372:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681655936:0@lo:400:kworker.0 00000100:00100000:3.0:1788574241.943590:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875455681655040:0@lo:400:kworker.0 00000100:00100000:3.0:1788574241.943614:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681656192 00000100:00100000:3.0:1788574241.943618:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681656192 00000100:00100000:3.0:1788574241.943651:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681656064 00000100:00100000:3.0:1788574241.943655:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681656064 00000100:00100000:3.0:1788574241.943667:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788574241.943672:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601835180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3618:x1875455681656192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788574241.943698:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788574241.943741:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601835180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3618:x1875455681656192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (1079us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574241.943760:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788574241.943774:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788574241.943780:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681656064:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788574241.943788:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788574241.943934:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681656064:12345-0@lo:13:osp-pre-1-1.0 Request processed in 153us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574241.943941:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788574241.943973:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c8601837100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681656064:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788574241.944020:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c8601836a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681656192:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788574241.944378:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681654912 00000100:00100000:2.0:1788574241.944384:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681654912 00000100:00100000:3.0:1788574241.944549:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1788574241.944556:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681654912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574241.944606:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681654912:12345-0@lo:400:kworker.0 Request processed in 50us (2370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574241.944612:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1788574241.944641:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681654912:0@lo:400:kworker.0 00000100:00100000:0.0:1788574241.947135:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574241.947406:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681655168:0@lo:400:kworker.0 00000100:00100000:3.0:1788574241.947482:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574241.947540:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3617:1875455681655680:0@lo:400:kworker.0 00000100:00100000:3.0:1788574241.947565:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574241.947597:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681655680 00000100:00100000:3.0:1788574241.947604:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681655680 00000100:00100000:3.0:1788574241.947660:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:3.0:1788574241.947667:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875455681655680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574241.947714:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875455681655680:12345-0@lo:400:kworker.0 Request processed in 48us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574241.947721:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00080000:3.0:1788574241.947757:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788574241.947789:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3617:1875455681655680:0@lo:400:kworker.0 00000100:00100000:0.0:1788574241.949397:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681655168 00000100:00100000:0.0:1788574241.949414:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681655168 00000100:00100000:0.0:1788574241.949515:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1788574241.949527:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681655168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574241.949641:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681655168:12345-0@lo:400:kworker.0 Request processed in 117us (2159us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574241.949650:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1788574241.949710:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681655168:0@lo:400:kworker.0 00000100:00100000:1.0:1788574241.949992:0:13791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681655552:12345-0@lo:400:kworker.0 Request processed in 7172us (7408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574241.950005:0:13791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788574241.950559:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681655552:0@lo:400:kworker.0 00000100:00100000:2.0:1788574241.951580:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681654656 00000100:00100000:2.0:1788574241.951594:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681654656 00000100:00100000:3.0:1788574241.952436:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:3.0:1788574241.952450:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5676850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:3617:x1875455681654656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574241.952550:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5676850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:3617:x1875455681654656:12345-0@lo:400:kworker.0 Request processed in 103us (5428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574241.952558:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:0.0:1788574241.952725:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:69505170-06bc-41d1-9626-ab1a3c7f32a0:3617:1875455681654656:0@lo:400:kworker.0 00010000:00010000:1.0:1788574242.451399:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788574242.452055:0:13764:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788574242.452063:0:13764:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788574242.452098:0:13764:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788574242.452105:0:13764:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788574242.452441:0:13764:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be0000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13764:1875455681656320:192.168.204.51@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788574242.452589:0:13764:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8600c3a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788574242.462829:0:13764:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be0000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13764:1875455681656320:192.168.204.51@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788574242.466907:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574242.467011:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669022464 00000100:00100000:0.0:1788574242.467025:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669022464 00000100:00100000:0.0:1788574242.467121:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 250 00000100:00100000:0.0:1788574242.467135:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601835500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+27:12480:x1875455669022464:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788574242.467184:0:6493:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788574242.467453:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601835500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+27:12480:x1875455669022464:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 Request processed in 322us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574242.467462:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 250 00000100:00080000:1.0:1788574242.469438:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788574242.473825:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574242.474022:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669022720 00000100:00100000:3.0:1788574242.474036:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669022720 00000100:00100000:3.0:1788574242.474113:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 251 00000100:00100000:3.0:1788574242.474126:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601836680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+27:12480:x1875455669022720:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788574242.474168:0:6492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574242.474220:0:6492:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8cf8a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6b0d expref: -99 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574242.474665:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616a00/0x5bf8706fdac8cf91 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574242.474685:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616a00/0x5bf8706fdac8cf91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574242.474701:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616a00/0x5bf8706fdac8cf91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788574242.474716:0:6492:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788574242.474869:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617000/0x5bf8706fdac8cf8a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6b0d expref: 30 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574242.474890:0:6492:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616a00/0x5bf8706fdac8cf91 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6b0d expref: 29 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574242.474901:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c84c34f0e00) 00010000:00010000:3.0:1788574242.474905:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788574242.474909:0:6492:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c84c2616a00, rc 0) 00000100:00100000:3.0:1788574242.476971:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601836680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+29:12480:x1875455669022720:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 2833us (3146us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1788574242.476987:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 251 00000100:00100000:3.0:1788574242.494319:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574242.494552:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669022976 00000100:00100000:1.0:1788574242.494565:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669022976 00000100:00100000:1.0:1788574242.494636:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 252 00000100:00100000:1.0:1788574242.494648:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+29:12480:x1875455669022976:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788574242.494773:0:7439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2000/0x5bf8706fdac8cf9f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574242.494796:0:7439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2000/0x5bf8706fdac8cf9f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574242.494817:0:7439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2000/0x5bf8706fdac8cf9f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574242.495029:0:7439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2000/0x5bf8706fdac8cf9f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574242.495037:0:7439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2000/0x5bf8706fdac8cf9f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574242.495044:0:7439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2000/0x5bf8706fdac8cf9f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574242.495050:0:7439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d08a2000 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:1.0:1788574242.495056:0:7439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2000/0x5bf8706fdac8cf9f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574242.495065:0:7439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2000/0x5bf8706fdac8cf9f lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574242.495098:0:7439:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c84c34f0e00) 00010000:00010000:1.0:1788574242.495101:0:7439:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788574242.495108:0:7439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2000/0x5bf8706fdac8cf9f lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574242.495115:0:7439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2000/0x5bf8706fdac8cf9f lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7439 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574242.495301:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+30:12480:x1875455669022976:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 Request processed in 654us (997us total) trans 4294967520 rc 0/0 00000100:00100000:1.0:1788574242.495310:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 252 00000040:00080000:0.0:1788574242.505238:0:13764:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788574242.505266:0:13764:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788574242.505938:0:13764:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1788574242.505961:0:13764:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788574242.507734:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574242.510603:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669023104 00000100:00100000:0.0:1788574242.510626:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669023104 00000100:00100000:0.0:1788574242.510733:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 18 00000100:00100000:0.0:1788574242.510746:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601834000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:659467ff-94af-418e-92fe-11e4323a48aa+30:2393:x1875455669023104:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788574242.510767:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574242.510823:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616a00/0x5bf8706fdac8cf91 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6b0d expref: 30 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574242.510844:0:6479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c84c34f0e00) 00010000:00010000:0.0:1788574242.510850:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574242.510941:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601834000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:659467ff-94af-418e-92fe-11e4323a48aa+29:2393:x1875455669023104:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 198us (6922us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574242.510949:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 18 00000100:00100000:0.0:1788574242.512107:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574242.512178:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669023360 00000100:00100000:1.0:1788574242.512220:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669023360 00000100:00100000:1.0:1788574242.512278:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 64 00000100:00100000:1.0:1788574242.512289:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:659467ff-94af-418e-92fe-11e4323a48aa+29:12480:x1875455669023360:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788574242.512954:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:659467ff-94af-418e-92fe-11e4323a48aa+30:12480:x1875455669023360:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 Request processed in 664us (852us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1788574242.512963:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 64 00000040:00080000:1.0:1788574242.833117:0:14685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788574242.833127:0:14685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788574242.833161:0:14685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788574242.833168:0:14685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788574243.064713:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574243.064929:0:11893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669023616 00000100:00100000:3.0:1788574243.064943:0:11893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669023616 00000100:00100000:3.0:1788574243.065040:0:11893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 253 00000100:00100000:3.0:1788574243.065052:0:11893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601834e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:659467ff-94af-418e-92fe-11e4323a48aa+30:12493:x1875455669023616:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:3.0:1788574243.065083:0:11893:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574243.065113:0:11893:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617a00/0x5bf8706fdac8cfa6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6b14 expref: -99 pid: 11893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574243.065295:0:11893:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616000/0x5bf8706fdac8cfad lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574243.065315:0:11893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616000/0x5bf8706fdac8cfad lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574243.065333:0:11893:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616000/0x5bf8706fdac8cfad lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11893 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788574243.065347:0:11893:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788574243.065487:0:11893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2617a00/0x5bf8706fdac8cfa6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6b14 expref: 33 pid: 11893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574243.065508:0:11893:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616000/0x5bf8706fdac8cfad lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6b14 expref: 32 pid: 11893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574243.065518:0:11893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c84c34f0e00) 00010000:00010000:3.0:1788574243.065521:0:11893:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788574243.065526:0:11893:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c84c2616000, rc 0) 00000100:00100000:3.0:1788574243.065602:0:11893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601834e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:659467ff-94af-418e-92fe-11e4323a48aa+32:12493:x1875455669023616:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 552us (915us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1788574243.065610:0:11893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 253 00000100:00100000:2.0:1788574243.079006:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574243.079055:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669023744 00000100:00100000:2.0:1788574243.079081:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669023744 00000100:00100000:2.0:1788574243.079152:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 254 00000100:00100000:2.0:1788574243.079164:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c443dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+32:12493:x1875455669023744:12345-192.168.204.51@tcp:54:lfs.0 00010000:00010000:2.0:1788574243.079286:0:6492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e400/0x5bf8706fdac8cfbb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574243.079325:0:6492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e400/0x5bf8706fdac8cfbb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574243.079341:0:6492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e400/0x5bf8706fdac8cfbb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574243.079389:0:6492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e400/0x5bf8706fdac8cfbb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574243.079397:0:6492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e400/0x5bf8706fdac8cfbb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574243.079405:0:6492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e400/0x5bf8706fdac8cfbb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574243.079412:0:6492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32e400 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:2.0:1788574243.079417:0:6492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e400/0x5bf8706fdac8cfbb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574243.079426:0:6492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e400/0x5bf8706fdac8cfbb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574243.079440:0:6492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c84c34f0e00) 00010000:00010000:2.0:1788574243.079444:0:6492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788574243.079450:0:6492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e400/0x5bf8706fdac8cfbb lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574243.079457:0:6492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e400/0x5bf8706fdac8cfbb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6492 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574243.079542:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c443dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+32:12493:x1875455669023744:12345-192.168.204.51@tcp:54:lfs.0 Request processed in 380us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574243.079557:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 254 00000100:00100000:2.0:1788574243.211100:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574243.211223:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669023872 00000100:00100000:1.0:1788574243.211247:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669023872 00000100:00100000:1.0:1788574243.211358:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 79 00000100:00100000:1.0:1788574243.211390:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c443ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:659467ff-94af-418e-92fe-11e4323a48aa+7:2394:x1875455669023872:12345-192.168.204.51@tcp:101:cat.0 00010000:00010000:1.0:1788574243.211415:0:8410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574243.211441:0:8410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042acfec9/0x5bf8706fdac8cfc2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6b1b expref: -99 pid: 8410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788574243.211474:0:8410:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 13, mtime: 0x6a9b7a1f, atime: 0x6a9b7a1f, ctime: 0x6a9b7a1f, blocks: 0x8 00010000:00010000:1.0:1788574243.211500:0:8410:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=383s v=(0 0) 00010000:00010000:1.0:1788574243.211505:0:8410:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574243.211517:0:8410:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042acfec9/0x5bf8706fdac8cfc2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6b1b expref: 8 pid: 8410 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574243.211542:0:8410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000042acfec9/0x5bf8706fdac8cfc2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6b1b expref: 8 pid: 8410 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574243.211559:0:8410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d08a2400, rc 0) 00000100:00100000:1.0:1788574243.211690:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c443ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:659467ff-94af-418e-92fe-11e4323a48aa+8:2394:x1875455669023872:12345-192.168.204.51@tcp:101:cat.0 Request processed in 303us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574243.211708:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 79 00000100:00080000:3.0:1788574243.212033:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788574243.219460:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574243.219560:0:8414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669024000 00000100:00100000:3.0:1788574243.219577:0:8414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669024000 00002000:00100000:3.0:1788574243.219646:0:8414:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff9c84c443ce00 x1875455669024000/t0(0) o3->659467ff-94af-418e-92fe-11e4323a48aa@192.168.204.51@tcp:394/0 lens 488/0 e 0 to 0 dl 1788574254 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788574243.219659:0:8414:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c84c443ce00 with x1875455669024000 ext(0->4095) 00002000:00010000:3.0:1788574243.219667:0:8414:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c84c443ce00 00000100:00100000:3.0:1788574243.219770:0:8414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 8 00000100:00100000:3.0:1788574243.219781:0:8414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c443ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:659467ff-94af-418e-92fe-11e4323a48aa+8:2396:x1875455669024000:12345-192.168.204.51@tcp:3:cat.0 00000100:00100000:3.0:1788574243.220025:0:8414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c443ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:659467ff-94af-418e-92fe-11e4323a48aa+8:2396:x1875455669024000:12345-192.168.204.51@tcp:3:cat.0 Request processed in 245us (580us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1788574243.220034:0:8414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 8 00002000:00100000:3.0:1788574243.220160:0:8414:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff9c84c443ce00 x1875455669024000/t0(0) o3->659467ff-94af-418e-92fe-11e4323a48aa@192.168.204.51@tcp:394/0 lens 488/4536 e 0 to 0 dl 1788574254 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788574243.220169:0:8414:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c84c443ce00 with x1875455669024000 ext(0->4095) 00002000:00010000:3.0:1788574243.220173:0:8414:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c84c443ce00 00010000:00010000:2.0:1788574243.477392:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788574243.539498:0:13764:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788574243.539511:0:13764:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788574243.539542:0:13764:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788574243.539554:0:13764:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1788574243.991713:0:13768:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788574244.499964:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681656448:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788574244.500060:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788574244.500107:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574244.500138:0:7533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681656448 00000100:00100000:2.0:1788574244.500151:0:7533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681656448 00000100:00100000:2.0:1788574244.500249:0:7533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1788574244.500260:0:7533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681656448:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788574244.500303:0:7533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1788574244.500397:0:7533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681656448:12345-0@lo:41:osp-pre-0-1.0 Request processed in 139us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574244.500404:0:7533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1788574244.500794:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681656448:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788574245.527006:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574246.035540:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681656576:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788574246.035645:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574246.035763:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681656576 00000100:00100000:3.0:1788574246.035774:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681656576 00000100:00100000:3.0:1788574246.035846:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788574246.035858:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3720e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681656576:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788574246.035911:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1788574246.035969:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3720e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681656576:12345-0@lo:13:osp-pre-0-1.0 Request processed in 113us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574246.035977:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:3.0:1788574246.036005:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788574246.036049:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681656576:0@lo:13:osp-pre-0-1.0 00000004:00080000:2.0:1788574246.036270:0:8811:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 386016079445ns, next at 387016075983ns, rc = 0 00000100:00100000:2.0:1788574246.036537:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788574246.036549:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c443ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681656704:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788574246.036590:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574246.037040:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681656704 00000100:00100000:3.0:1788574246.037048:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681656704 00000100:00100000:3.0:1788574246.037100:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788574246.037108:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffaffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3619:x1875455681656704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788574246.037128:0:14401:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1788574246.037174:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffaffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3619:x1875455681656704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574246.037228:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788574246.037572:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681656832:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788574246.037615:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788574246.037671:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788574246.037708:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c443ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681656704:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788574246.038453:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681656832 00000100:00100000:3.0:1788574246.038462:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681656832 00000100:00100000:3.0:1788574246.038514:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1788574246.038523:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffaff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681656832:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788574246.038559:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788574246.038619:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffaff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681656832:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (1002us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574246.038626:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1788574246.038879:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681656832:0@lo:41:osp-pre-1-0.0 00000001:00080000:0.0:1788574246.042981:0:9487:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000100:00100000:2.0:1788574246.489085:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574246.489145:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574246.489218:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574246.489243:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574246.489262:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574246.489282:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574246.489308:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574246.489352:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669024128 00000100:00100000:2.0:1788574246.489364:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669024128 00000100:00100000:2.0:1788574246.489435:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 398 00000100:00100000:2.0:1788574246.489447:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5677450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+13:2395:x1875455669024128:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1788574246.489532:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5677450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+13:2395:x1875455669024128:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 87us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574246.489541:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 398 00000100:00100000:2.0:1788574246.489580:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669024384 00000100:00100000:2.0:1788574246.489584:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669024384 00000100:00100000:2.0:1788574246.489621:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669024896 00000100:00100000:2.0:1788574246.489624:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669024896 00000100:00100000:2.0:1788574246.489637:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669024256 00000100:00100000:2.0:1788574246.489640:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669024256 00000100:00100000:2.0:1788574246.489654:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669024768 00000100:00100000:2.0:1788574246.489656:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669024768 00000100:00100000:2.0:1788574246.489671:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 362 00000100:00100000:2.0:1788574246.489677:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffafce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+5:2395:x1875455669024384:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1788574246.489709:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffafce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+5:2395:x1875455669024384:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 32us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574246.489715:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 362 00000100:00100000:2.0:1788574246.489726:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 363 00000100:00100000:2.0:1788574246.489732:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffafed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2395:x1875455669024896:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1788574246.489769:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffafed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2395:x1875455669024896:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 38us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574246.489774:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 363 00000100:00100000:2.0:1788574246.489786:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 364 00000100:00100000:2.0:1788574246.489792:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffafdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+32:2395:x1875455669024256:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1788574246.489817:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffafdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+32:2395:x1875455669024256:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 26us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574246.489823:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 364 00000100:00100000:2.0:1788574246.489834:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 365 00000100:00100000:2.0:1788574246.489840:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffaff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2395:x1875455669024768:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1788574246.489878:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffaff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2395:x1875455669024768:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 38us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574246.489884:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 365 00000100:00100000:2.0:1788574246.489906:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669024640 00000100:00100000:2.0:1788574246.489910:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669024640 00000100:00100000:2.0:1788574246.489945:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669024512 00000100:00100000:2.0:1788574246.489948:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669024512 00000100:00100000:2.0:1788574246.489972:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 140 00000100:00100000:2.0:1788574246.489977:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffafe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:659467ff-94af-418e-92fe-11e4323a48aa+5:2395:x1875455669024640:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1788574246.489999:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffafe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:659467ff-94af-418e-92fe-11e4323a48aa+5:2395:x1875455669024640:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 23us (782us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574246.490006:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 140 00000100:00100000:2.0:1788574246.490015:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 141 00000100:00100000:2.0:1788574246.490020:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffafd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:659467ff-94af-418e-92fe-11e4323a48aa+8:2395:x1875455669024512:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1788574246.490046:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffafd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:659467ff-94af-418e-92fe-11e4323a48aa+8:2395:x1875455669024512:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 26us (764us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574246.490052:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 141 00000100:00080000:2.0:1788574246.490282:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788574246.490287:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788574246.490290:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788574246.490292:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788574246.550738:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574247.059836:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3722680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:69505170-06bc-41d1-9626-ab1a3c7f32a0:3618:1875455681656960:0@lo:400:kworker.0 00000100:00100000:3.0:1788574247.059903:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574247.059948:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3720700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681657472:0@lo:400:kworker.0 00000100:00100000:3.0:1788574247.059982:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574247.060001:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3721c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681657984:0@lo:400:kworker.0 00000100:00100000:3.0:1788574247.060309:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574247.060332:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3722a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681658496:0@lo:400:kworker.0 00000100:00100000:3.0:1788574247.060354:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574247.060379:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788574247.060385:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3721880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875455681657344:0@lo:400:kworker.0 00000100:00100000:3.0:1788574247.060409:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574247.060429:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3723800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681657856:0@lo:400:kworker.0 00000100:00100000:3.0:1788574247.060449:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574247.060464:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3721180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681658368:0@lo:400:kworker.0 00000100:00100000:3.0:1788574247.060483:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574247.060514:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3722300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875455681657088:0@lo:400:kworker.0 00000100:00100000:3.0:1788574247.060536:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574247.060554:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3720a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3619:1875455681657600:0@lo:400:kworker.0 00000100:00100000:3.0:1788574247.060574:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574247.060588:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3720000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1875455681658112:0@lo:400:kworker.0 00000100:00100000:3.0:1788574247.060606:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574247.060623:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788574247.060629:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3721f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681657216:0@lo:400:kworker.0 00000100:00100000:2.0:1788574247.062272:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681657344 00000100:00100000:2.0:1788574247.062281:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681657344 00000100:00100000:2.0:1788574247.062329:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681657088 00000100:00100000:2.0:1788574247.062333:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681657088 00000100:00100000:2.0:1788574247.062345:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681657600 00000100:00100000:2.0:1788574247.062348:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681657600 00000100:00100000:2.0:1788574247.062368:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681658112 00000100:00100000:2.0:1788574247.062370:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681658112 00000100:00100000:2.0:1788574247.062389:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1788574247.062399:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3723b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875455681657344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574247.062484:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3723b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875455681657344:12345-0@lo:400:kworker.0 Request processed in 87us (2073us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574247.062492:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1788574247.062509:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:2.0:1788574247.062515:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3da4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875455681657088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574247.062542:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3da4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875455681657088:12345-0@lo:400:kworker.0 Request processed in 27us (2006us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574247.062547:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:2.0:1788574247.062557:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:2.0:1788574247.062562:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3da7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875455681657600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574247.062599:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3da7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875455681657600:12345-0@lo:400:kworker.0 Request processed in 38us (2025us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574247.062605:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:2.0:1788574247.062617:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:2.0:1788574247.062623:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3da4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875455681658112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574247.062661:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3da4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3619:x1875455681658112:12345-0@lo:400:kworker.0 Request processed in 39us (2054us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574247.062667:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00080000:2.0:1788574247.062688:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788574247.062963:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00080000:1.0:1788574247.064471:0:8404:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967325 is committed 00000001:00080000:1.0:1788574247.064484:0:8404:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000100:00100000:0.0:1788574247.065463:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681657472 00000100:00100000:3.0:1788574247.065487:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3723480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1875455681657728:0@lo:400:kworker.0 00000100:00100000:3.0:1788574247.065540:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574247.065544:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681657472 00000100:00100000:3.0:1788574247.065561:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3720380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1875455681658240:0@lo:400:kworker.0 00000100:00100000:0.0:1788574247.065588:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681657216 00000100:00100000:0.0:1788574247.065592:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681657216 00000100:00100000:3.0:1788574247.065594:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574247.065608:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1788574247.065616:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3723100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681657472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574247.065631:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3722300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875455681657088:0@lo:400:kworker.0 00000100:00100000:3.0:1788574247.065657:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3720a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3619:1875455681657600:0@lo:400:kworker.0 00000100:00100000:0.0:1788574247.065665:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3723100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681657472:12345-0@lo:400:kworker.0 Request processed in 50us (5682us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574247.065672:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1788574247.065681:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3720000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3619:1875455681658112:0@lo:400:kworker.0 00000100:00100000:0.0:1788574247.065686:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1788574247.065691:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3da6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681657216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574247.065715:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c8601836300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681658624:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788574247.065720:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3da6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681657216:12345-0@lo:400:kworker.0 Request processed in 28us (2758us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574247.065725:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1788574247.065740:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574247.065763:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3721f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681657216:0@lo:400:kworker.0 00000100:00100000:3.0:1788574247.065775:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788574247.065781:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85ffafc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681658752:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788574247.065803:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574247.065839:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681656960 00000100:00100000:3.0:1788574247.065843:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681656960 00000100:00100000:3.0:1788574247.065872:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:3.0:1788574247.065879:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5676c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:3618:x1875455681656960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574247.065910:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5676c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:3618:x1875455681656960:12345-0@lo:400:kworker.0 Request processed in 31us (6007us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574247.065916:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00100000:0.0:1788574247.065923:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681658624 00000100:00100000:0.0:1788574247.065926:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681658624 00000100:00100000:3.0:1788574247.065947:0:8815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681657984 00000100:00100000:3.0:1788574247.065951:0:8815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681657984 00000100:00100000:0.0:1788574247.065957:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681658752 00000100:00100000:0.0:1788574247.065960:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681658752 00000100:00100000:3.0:1788574247.065971:0:8815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681658496 00000100:00100000:0.0:1788574247.065972:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788574247.065973:0:8815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681658496 00000100:00100000:0.0:1788574247.065977:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3da5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681658624:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788574247.065982:0:8815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681657856 00000100:00100000:3.0:1788574247.065984:0:8815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681657856 00000100:00100000:3.0:1788574247.065993:0:8815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681658368 00000100:00100000:3.0:1788574247.065996:0:8815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681658368 00002000:00000024:0.0:1788574247.065998:0:14401:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788574247.066005:0:8815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788574247.066017:0:8815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3721500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681657984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574247.066047:0:8815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3721500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681657984:12345-0@lo:400:kworker.0 Request processed in 30us (5738us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574247.066053:0:8815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788574247.066064:0:8815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788574247.066069:0:8815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3722d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3618:x1875455681658496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574247.066096:0:8815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3722d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3618:x1875455681658496:12345-0@lo:400:kworker.0 Request processed in 26us (5741us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574247.066101:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3da5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3619:x1875455681658624:12345-0@lo:13:osp-pre-1-1.0 Request processed in 124us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574247.066102:0:8815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788574247.066107:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788574247.066113:0:8815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788574247.066116:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788574247.066118:0:8815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681657856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574247.066120:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3da5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681658752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788574247.066128:0:14401:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788574247.066142:0:8815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681657856:12345-0@lo:400:kworker.0 Request processed in 24us (5692us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574247.066146:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3da5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681658752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 26us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574247.066149:0:8815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788574247.066152:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788574247.066171:0:8815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788574247.066178:0:8815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3da7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681658368:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788574247.066179:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788574247.066213:0:3619:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:0.0:1788574247.066218:0:3619:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000100:00100000:3.0:1788574247.066225:0:8815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3da7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681658368:12345-0@lo:400:kworker.0 Request processed in 44us (5736us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574247.066231:0:8815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000004:00080000:0.0:1788574247.066240:0:3619:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c84c3596300, transno 4294967311 00000100:00100000:3.0:1788574247.066252:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681657728 00000100:00100000:3.0:1788574247.066255:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681657728 00000100:00100000:0.0:1788574247.066257:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85ffafc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681658752:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788574247.066271:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c8601836300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681658624:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788574247.066277:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681658240 00000100:00100000:3.0:1788574247.066279:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681658240 00000100:00100000:3.0:1788574247.066293:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:3.0:1788574247.066298:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3da6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875455681657728:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788574247.066592:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788574247.067602:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3da6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875455681657728:12345-0@lo:400:kworker.0 Request processed in 1298us (2057us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574247.067626:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:3.0:1788574247.067722:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:3.0:1788574247.067732:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3da6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875455681658240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574247.067783:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3da6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875455681658240:12345-0@lo:400:kworker.0 Request processed in 54us (2187us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574247.067789:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:3.0:1788574247.067855:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3721880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875455681657344:0@lo:400:kworker.0 00000100:00100000:3.0:1788574247.067867:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3723800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681657856:0@lo:400:kworker.0 00000100:00100000:3.0:1788574247.067877:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3721180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681658368:0@lo:400:kworker.0 00000100:00100000:3.0:1788574247.067888:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3722680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:69505170-06bc-41d1-9626-ab1a3c7f32a0:3618:1875455681656960:0@lo:400:kworker.0 00000100:00100000:3.0:1788574247.067898:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3720700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681657472:0@lo:400:kworker.0 00000100:00100000:3.0:1788574247.067907:0:3618:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:3.0:1788574247.067912:0:3618:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:3.0:1788574247.067926:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3721c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681657984:0@lo:400:kworker.0 00000100:00100000:3.0:1788574247.067937:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3722a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681658496:0@lo:400:kworker.0 00010000:00080000:0.0:1788574247.069392:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3723480 x1875455681657728/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574263 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574247.069408:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3723480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1875455681657728:0@lo:400:kworker.0 00010000:00080000:0.0:1788574247.069431:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3720380 x1875455681658240/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574263 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574247.069440:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3720380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1875455681658240:0@lo:400:kworker.0 00000004:00080000:3.0:1788574247.070299:0:6471:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 10 committed 00000001:00080000:3.0:1788574247.070347:0:6471:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:3.0:1788574247.070386:0:6471:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c84c353b780 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1788574247.070392:0:6471:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c85fae5d000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c84c353b300 00000020:00080000:3.0:1788574247.070395:0:6471:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c85fae5d500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c84c2596600 00000020:00080000:3.0:1788574247.070411:0:6471:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00010000:00010000:2.0:1788574247.070488:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7c00/0x5bf8706fdac8cf3d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574247.070503:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7c00/0x5bf8706fdac8cf3d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574247.070512:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7c00/0x5bf8706fdac8cf3d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574247.070518:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d7c00 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:2.0:1788574247.070524:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7c00/0x5bf8706fdac8cf3d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574247.070533:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7c00/0x5bf8706fdac8cf3d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574247.070554:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9c85fa28cb00) 00010000:00010000:2.0:1788574247.070557:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788574247.070563:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7c00/0x5bf8706fdac8cf3d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574247.070584:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7c00/0x5bf8706fdac8cf3d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788574247.070626:0:6524:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:2.0:1788574247.070709:0:6524:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:2.0:1788574247.070927:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788574247.070943:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681658880:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788574247.071010:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574247.071110:0:8815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681658880 00000100:00100000:0.0:1788574247.071118:0:8815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681658880 00000100:00100000:0.0:1788574247.071178:0:8815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788574247.071217:0:8815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffaff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681658880:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1788574247.071342:0:8815:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1788574247.071346:0:8815:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 1788574239 -> 1788574239 00002000:00010000:0.0:1788574247.071349:0:8815:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 1788574239 -> 1788574239 00002000:00010000:0.0:1788574247.071351:0:8815:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1788574239 -> 1788574239 00002000:00010000:0.0:1788574247.071353:0:8815:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1788574247.071400:0:8815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffaff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3618:x1875455681658880:12345-0@lo:2:osp-syn-0-0.0 Request processed in 214us (390us total) trans 4294967326 rc 0/0 00000100:00100000:0.0:1788574247.071406:0:8815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000004:00080000:0.0:1788574247.071448:0:3618:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c84c3c09500/2, rc 0, transno 4294967326 00000100:00100000:0.0:1788574247.071454:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681658880:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1788574247.574251:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574248.595619:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574249.364949:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574249.365039:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669025024 00000100:00100000:3.0:1788574249.365050:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669025024 00000100:00100000:3.0:1788574249.365171:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 255 00000100:00100000:3.0:1788574249.365185:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffafc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+18:12153:x1875455669025024:12345-192.168.204.51@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788574249.365320:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffafc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+18:12153:x1875455669025024:12345-192.168.204.51@tcp:60:lhsmtool_posix.0 Request processed in 138us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574249.365329:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 255 00000100:00080000:0.0:1788574249.365385:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788574249.371715:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574249.375145:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669025152 00000100:00100000:3.0:1788574249.375161:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669025152 00000100:00100000:3.0:1788574249.375314:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 256 00000100:00100000:3.0:1788574249.375327:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffafd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+5:12153:x1875455669025152:12345-192.168.204.51@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788574249.375434:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffafd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:659467ff-94af-418e-92fe-11e4323a48aa+5:12153:x1875455669025152:12345-192.168.204.51@tcp:60:lhsmtool_posix.0 Request processed in 111us (3729us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574249.375443:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 256 00000100:00100000:1.0:1788574249.377729:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574249.377814:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669025408 00000100:00100000:2.0:1788574249.377822:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669025408 00000100:00100000:2.0:1788574249.377874:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 65 00000100:00100000:2.0:1788574249.377884:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601836d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:659467ff-94af-418e-92fe-11e4323a48aa+18:12153:x1875455669025408:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788574249.378126:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601836d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:659467ff-94af-418e-92fe-11e4323a48aa+19:12153:x1875455669025408:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 Request processed in 233us (392us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1788574249.378134:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 65 00000100:00080000:0.0:1788574249.378772:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788574249.619451:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788574249.619482:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3da7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681659008:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788574249.619581:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788574249.619637:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574249.620428:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681659008 00000100:00100000:1.0:1788574249.620500:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681659008 00000100:00100000:1.0:1788574249.620613:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1788574249.620635:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3da5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681659008:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788574249.620691:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1788574249.620790:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3da5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681659008:12345-0@lo:41:osp-pre-0-1.0 Request processed in 157us (1209us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574249.620797:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1788574249.620900:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3da7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681659008:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788574249.679107:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574249.679215:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669025536 00000100:00100000:2.0:1788574249.679226:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669025536 00000100:00080000:1.0:1788574249.680021:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788574249.680143:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 257 00000100:00100000:2.0:1788574249.680156:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601835f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38a8b838-f1df-4bf7-be24-5141ce328dae+5:12950:x1875455669025536:12345-192.168.204.51@tcp:101:lsof.0 00010000:00010000:2.0:1788574249.680177:0:6494:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574249.680232:0:6494:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fa00/0x5bf8706fdac8cfc9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6b22 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574249.680427:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e400/0x5bf8706fdac8cfd0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574249.680502:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e400/0x5bf8706fdac8cfd0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574249.680516:0:6494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e400/0x5bf8706fdac8cfd0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788574249.680564:0:6494:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788574249.680568:0:6494:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788574249.680592:0:6494:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e400/0x5bf8706fdac8cfd0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6494 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574249.680747:0:6494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32fa00/0x5bf8706fdac8cfc9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6b22 expref: 7 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574249.680769:0:6494:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e400/0x5bf8706fdac8cfd0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6b22 expref: 6 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574249.680778:0:6494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c85fa28c100) 00010000:00010000:2.0:1788574249.680781:0:6494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788574249.680785:0:6494:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85fa32e400, rc 0) 00000100:00100000:2.0:1788574249.680852:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601835f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38a8b838-f1df-4bf7-be24-5141ce328dae+6:12950:x1875455669025536:12345-192.168.204.51@tcp:101:lsof.0 Request processed in 699us (1755us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574249.680860:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 257 00010000:00010000:2.0:1788574250.643501:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574251.157901:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85ffafc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681659136:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788574251.157976:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574251.158136:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681659136 00000100:00100000:2.0:1788574251.158157:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681659136 00000100:00100000:2.0:1788574251.158251:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788574251.158261:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601836300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681659136:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788574251.158290:0:14401:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788574251.158338:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601836300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681659136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574251.158345:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788574251.158480:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85ffafc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681659136:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788574251.158503:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788574251.159919:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3da7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681659264:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788574251.159985:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574251.161355:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788574251.161378:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681659392:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788574251.161441:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574251.163388:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681659392 00000100:00100000:0.0:1788574251.163402:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681659392 00000100:00100000:0.0:1788574251.163666:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1788574251.163677:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601836a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681659392:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788574251.163715:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788574251.163792:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601836a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681659392:12345-0@lo:41:osp-pre-1-0.0 Request processed in 118us (2350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574251.163885:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1788574251.164009:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681659392:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788574251.175619:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681659264 00000100:00100000:2.0:1788574251.175633:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681659264 00000100:00100000:2.0:1788574251.175759:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00080000:1.0:1788574251.175759:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788574251.175770:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3da5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3620:x1875455681659264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788574251.175794:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788574251.176016:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3da5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3620:x1875455681659264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 247us (16029us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574251.176025:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788574251.176140:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3da7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681659264:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788574251.593607:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574251.593654:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574251.593687:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574251.593723:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574251.593739:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574251.593758:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574251.593775:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574251.593799:0:11893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669025920 00000100:00100000:1.0:1788574251.593816:0:11893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669025920 00000100:00100000:1.0:1788574251.593886:0:11893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669026432 00000100:00100000:1.0:1788574251.593890:0:11893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669026432 00000100:00100000:1.0:1788574251.593905:0:11893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669025792 00000100:00100000:1.0:1788574251.593908:0:11893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669025792 00000100:00100000:1.0:1788574251.593919:0:11893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669026304 00000100:00100000:1.0:1788574251.593934:0:11893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669026304 00000100:00100000:1.0:1788574251.593966:0:11893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 372 00000100:00100000:1.0:1788574251.593976:0:11893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601837100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:659467ff-94af-418e-92fe-11e4323a48aa+5:2396:x1875455669025920:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788574251.594045:0:11893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601837100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:659467ff-94af-418e-92fe-11e4323a48aa+5:2396:x1875455669025920:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 71us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574251.594052:0:11893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 372 00000100:00100000:1.0:1788574251.594081:0:11893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 373 00000100:00100000:1.0:1788574251.594087:0:11893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3594e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2396:x1875455669026432:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788574251.594107:0:11893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3594e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2396:x1875455669026432:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 21us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574251.594113:0:11893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 373 00000100:00100000:1.0:1788574251.594122:0:11893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 374 00000100:00100000:1.0:1788574251.594127:0:11893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3f24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:659467ff-94af-418e-92fe-11e4323a48aa+19:2396:x1875455669025792:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788574251.594150:0:11893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3f24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:659467ff-94af-418e-92fe-11e4323a48aa+19:2396:x1875455669025792:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 23us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574251.594155:0:11893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 374 00000100:00100000:1.0:1788574251.594162:0:11893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 375 00000100:00100000:1.0:1788574251.594167:0:11893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3f25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:38a8b838-f1df-4bf7-be24-5141ce328dae+6:2396:x1875455669026304:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788574251.594182:0:11893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3f25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:38a8b838-f1df-4bf7-be24-5141ce328dae+6:2396:x1875455669026304:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 15us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574251.594220:0:11893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 375 00000100:00080000:1.0:1788574251.594338:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788574251.594343:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788574251.596634:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669026176 00000100:00100000:3.0:1788574251.596650:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669026176 00000100:00100000:3.0:1788574251.596745:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669026048 00000100:00100000:3.0:1788574251.596749:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669026048 00000100:00100000:3.0:1788574251.596796:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 146 00000100:00100000:3.0:1788574251.596805:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3596300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:659467ff-94af-418e-92fe-11e4323a48aa+5:2396:x1875455669026176:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1788574251.596895:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3596300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:659467ff-94af-418e-92fe-11e4323a48aa+5:2396:x1875455669026176:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 91us (3206us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574251.596902:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 146 00000100:00100000:3.0:1788574251.596921:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 147 00000100:00100000:3.0:1788574251.596928:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3f26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:659467ff-94af-418e-92fe-11e4323a48aa+7:2396:x1875455669026048:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1788574251.596956:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3f26a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:659467ff-94af-418e-92fe-11e4323a48aa+7:2396:x1875455669026048:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 29us (3197us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574251.596962:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 147 00000100:00080000:1.0:1788574251.598514:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788574251.598536:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788574251.603039:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669025664 00000100:00100000:2.0:1788574251.603056:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669025664 00000100:00100000:2.0:1788574251.603151:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 400 00000100:00100000:2.0:1788574251.603162:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5674c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+13:2396:x1875455669025664:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1788574251.603280:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5674c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+13:2396:x1875455669025664:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 119us (9680us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574251.603288:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 400 00010000:00010000:1.0:1788574251.667459:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574252.180019:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85ffafd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681659520:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788574252.180100:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574252.180184:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681659520 00000100:00100000:2.0:1788574252.180213:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681659520 00000100:00100000:2.0:1788574252.180275:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788574252.180286:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffafca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681659520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788574252.180315:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788574252.180362:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffafca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681659520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574252.180369:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788574252.180419:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85ffafd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681659520:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788574252.180820:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3da7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875455681659776:0@lo:400:kworker.0 00000100:00100000:3.0:1788574252.180876:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574252.180907:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3da5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3620:1875455681660288:0@lo:400:kworker.0 00000100:00100000:3.0:1788574252.180928:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574252.180946:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3721c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3620:1875455681660800:0@lo:400:kworker.0 00000100:00100000:3.0:1788574252.180966:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574252.180982:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788574252.180987:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3da7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:69505170-06bc-41d1-9626-ab1a3c7f32a0:3620:1875455681659648:0@lo:400:kworker.0 00000100:00100000:3.0:1788574252.181013:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574252.181032:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3da4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681660160:0@lo:400:kworker.0 00000100:00100000:3.0:1788574252.181057:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574252.181084:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3722a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681660672:0@lo:400:kworker.0 00000100:00100000:3.0:1788574252.181106:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574252.181400:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681659776 00000100:00100000:1.0:1788574252.181407:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681659776 00000100:00100000:1.0:1788574252.181437:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681660288 00000100:00100000:1.0:1788574252.181441:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681660288 00000100:00100000:1.0:1788574252.181459:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681660800 00000100:00100000:1.0:1788574252.181461:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681660800 00000100:00100000:1.0:1788574252.181475:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:1.0:1788574252.181482:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3721180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875455681659776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574252.181519:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3721180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875455681659776:12345-0@lo:400:kworker.0 Request processed in 38us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574252.181526:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:1.0:1788574252.181539:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:1.0:1788574252.181545:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3723800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875455681660288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574252.181586:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3723800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875455681660288:12345-0@lo:400:kworker.0 Request processed in 41us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574252.181592:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:1.0:1788574252.181603:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:1.0:1788574252.181609:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3721880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875455681660800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574252.181634:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3721880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875455681660800:12345-0@lo:400:kworker.0 Request processed in 26us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574252.181641:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:1.0:1788574252.181660:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681660160 00000100:00100000:1.0:1788574252.181664:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681660160 00000100:00100000:1.0:1788574252.181691:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1788574252.181697:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3721f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681660160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574252.181739:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3721f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681660160:12345-0@lo:400:kworker.0 Request processed in 42us (681us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574252.181753:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00080000:1.0:1788574252.181773:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788574252.181777:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788574252.182491:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681659648 00000100:00100000:2.0:1788574252.182498:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681659648 00000100:00100000:2.0:1788574252.182543:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 401 00000100:00100000:2.0:1788574252.182550:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5674850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:3620:x1875455681659648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574252.182607:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5674850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:3620:x1875455681659648:12345-0@lo:400:kworker.0 Request processed in 58us (1593us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574252.182614:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 401 00000100:00100000:2.0:1788574252.182647:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681660672 00000100:00100000:2.0:1788574252.182651:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681660672 00000100:00100000:2.0:1788574252.182686:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788574252.182692:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3720000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3620:x1875455681660672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574252.183003:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3720000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3620:x1875455681660672:12345-0@lo:400:kworker.0 Request processed in 311us (1895us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574252.183010:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788574252.183040:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3f24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681661184:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788574252.183086:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574252.183129:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3da4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681659904:0@lo:400:kworker.0 00000100:00100000:2.0:1788574252.183154:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574252.183181:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3720380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1875455681660416:0@lo:400:kworker.0 00000100:00100000:2.0:1788574252.183232:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574252.183247:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3720700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1875455681660928:0@lo:400:kworker.0 00000100:00100000:2.0:1788574252.183264:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574252.183279:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788574252.183285:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3da4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875455681660032:0@lo:400:kworker.0 00000100:00100000:2.0:1788574252.183303:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574252.183315:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3723480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681660544:0@lo:400:kworker.0 00000100:00100000:2.0:1788574252.183333:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574252.183345:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3722680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681661056:0@lo:400:kworker.0 00000100:00100000:2.0:1788574252.183360:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574252.183385:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681661184 00000100:00100000:2.0:1788574252.183389:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681661184 00000100:00100000:2.0:1788574252.183422:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788574252.183428:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffafd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681661184:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788574252.183443:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788574252.183480:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffafd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681661184:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574252.183486:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788574252.183529:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3f24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681661184:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788574252.183551:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681660416 00000100:00100000:2.0:1788574252.183555:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681660416 00000100:00100000:2.0:1788574252.183593:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681660928 00000100:00100000:2.0:1788574252.183596:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681660928 00000100:00100000:2.0:1788574252.183610:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681660032 00000100:00100000:2.0:1788574252.183613:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681660032 00000100:00100000:2.0:1788574252.183624:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:2.0:1788574252.183639:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffafc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875455681660416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574252.183676:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffafc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875455681660416:12345-0@lo:400:kworker.0 Request processed in 38us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574252.183683:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:2.0:1788574252.183695:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:2.0:1788574252.183701:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffafc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875455681660928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574252.185214:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3da7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:69505170-06bc-41d1-9626-ab1a3c7f32a0:3620:1875455681659648:0@lo:400:kworker.0 00000100:00100000:3.0:1788574252.185249:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3da4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681660160:0@lo:400:kworker.0 00000100:00100000:3.0:1788574252.185263:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3722a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681660672:0@lo:400:kworker.0 00000100:00100000:3.0:1788574252.185274:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3da7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875455681659776:0@lo:400:kworker.0 00000100:00100000:3.0:1788574252.185284:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3da5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3620:1875455681660288:0@lo:400:kworker.0 00000100:00100000:3.0:1788574252.185294:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3721c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3620:1875455681660800:0@lo:400:kworker.0 00000100:00100000:3.0:1788574252.185361:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:3.0:1788574252.185371:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c443e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875455681660032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574252.185431:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c443e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875455681660032:12345-0@lo:400:kworker.0 Request processed in 63us (2127us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574252.185439:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:3.0:1788574252.185480:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3da4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875455681660032:0@lo:400:kworker.0 00010000:00080000:3.0:1788574252.185497:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3720380 x1875455681660416/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574268 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574252.185508:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3720380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1875455681660416:0@lo:400:kworker.0 00000100:00100000:0.0:1788574252.185816:0:8815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681660544 00000100:00100000:0.0:1788574252.185823:0:8815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681660544 00000100:00100000:0.0:1788574252.185877:0:8815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681661056 00000100:00100000:0.0:1788574252.185881:0:8815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681661056 00000100:00100000:0.0:1788574252.185904:0:8815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788574252.185911:0:8815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c443ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681660544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574252.185955:0:8815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c443ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681660544:12345-0@lo:400:kworker.0 Request processed in 45us (2621us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574252.185961:0:8815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788574252.185973:0:8815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788574252.185979:0:8815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2f46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681661056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574252.186004:0:8815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2f46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681661056:12345-0@lo:400:kworker.0 Request processed in 25us (2642us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574252.186009:0:8815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788574252.186331:0:7533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681659904 00000100:00100000:1.0:1788574252.186337:0:7533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681659904 00000100:00100000:1.0:1788574252.186380:0:7533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1788574252.186387:0:7533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffafea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681659904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574252.186423:0:7533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffafea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681659904:12345-0@lo:400:kworker.0 Request processed in 37us (3269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574252.186429:0:7533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00080000:1.0:1788574252.186460:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788574252.186464:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788574252.186727:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3723480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681660544:0@lo:400:kworker.0 00000100:00100000:3.0:1788574252.186742:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3722680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681661056:0@lo:400:kworker.0 00000100:00100000:3.0:1788574252.186752:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3da4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681659904:0@lo:400:kworker.0 00000100:00100000:2.0:1788574252.187740:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffafc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875455681660928:12345-0@lo:400:kworker.0 Request processed in 4034us (4469us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574252.187753:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00010000:00080000:3.0:1788574252.197324:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3720700 x1875455681660928/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574268 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574252.197344:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3720700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1875455681660928:0@lo:400:kworker.0 00010000:00010000:2.0:1788574252.692848:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788574253.204151:0:13768:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00080000:1.0:1788574253.208847:0:8404:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967326 is committed 00000001:00080000:3.0:1788574253.209824:0:6471:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967523 is committed 00000020:00080000:3.0:1788574253.209837:0:6471:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:2.0:1788574253.209909:0:6524:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1788574253.209926:0:6524:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:2.0:1788574253.720043:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788574253.779789:0:13764:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788574253.779803:0:13764:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788574253.779946:0:13764:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1788574253.779956:0:13764:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788574254.739535:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574254.739571:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788574254.739602:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3720700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681661312:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788574254.739702:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574254.739912:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681661312 00000100:00100000:1.0:1788574254.739922:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681661312 00000100:00100000:1.0:1788574254.740059:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1788574254.740073:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2f47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681661312:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788574254.740137:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1788574254.740248:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2f47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681661312:12345-0@lo:41:osp-pre-0-1.0 Request processed in 178us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574254.740257:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1788574254.750500:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3720700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681661312:0@lo:41:osp-pre-0-1.0 00000001:02000400:1.0:1788574254.990732:0:14883:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 22:10:52 (1788574252) 00010000:00010000:2.0:1788574255.763394:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574256.275710:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3720700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681661440:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788574256.275798:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574256.275898:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681661440 00000100:00100000:0.0:1788574256.275906:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681661440 00000100:00100000:0.0:1788574256.275959:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788574256.275978:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681661440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788574256.276021:0:14401:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788574256.276064:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681661440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574256.276071:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00080000:0.0:1788574256.276091:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788574256.276118:0:3617:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967326 gen 2 00000004:00080000:0.0:1788574256.276124:0:3617:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c84c3c09500, transno 4294967326 00000100:00100000:0.0:1788574256.276138:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3720700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681661440:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788574256.276737:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788574256.276747:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3722680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681661568:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788574256.276787:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574256.276815:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681661568 00000100:00100000:3.0:1788574256.276819:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681661568 00000100:00100000:3.0:1788574256.276845:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1788574256.276850:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3723480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681661568:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788574256.276871:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788574256.276900:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3723480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681661568:12345-0@lo:41:osp-pre-1-0.0 Request processed in 50us (112us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574256.276905:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1788574256.276934:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3722680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681661568:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788574256.277439:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788574256.277452:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681661696:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788574256.277487:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574256.277694:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681661696 00000100:00100000:0.0:1788574256.277700:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681661696 00000100:00100000:0.0:1788574256.277750:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788574256.277768:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3f27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681661696:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788574256.277783:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788574256.277823:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3f27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681661696:12345-0@lo:13:osp-pre-0-1.0 Request processed in 56us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574256.277829:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788574256.277862:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681661696:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788574256.278720:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788574256.712105:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574256.712163:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574256.712836:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669026560 00000100:00100000:0.0:1788574256.712851:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669026560 00000100:00100000:0.0:1788574256.712922:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 402 00000100:00100000:0.0:1788574256.712933:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5677c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+13:2395:x1875455669026560:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1788574256.713032:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5677c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+13:2395:x1875455669026560:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 100us (950us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574256.713040:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 402 00000100:00100000:3.0:1788574256.713408:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574256.713495:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574256.713519:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574256.713543:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574256.713562:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574256.713583:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669026688 00000100:00100000:3.0:1788574256.713588:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669026688 00000100:00100000:3.0:1788574256.713632:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669026816 00000100:00100000:3.0:1788574256.713634:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669026816 00000100:00100000:3.0:1788574256.713645:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669027200 00000100:00100000:3.0:1788574256.713654:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669027200 00000100:00100000:2.0:1788574256.714902:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669027328 00000100:00100000:2.0:1788574256.714918:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669027328 00000100:00100000:2.0:1788574256.714988:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 382 00000100:00100000:2.0:1788574256.715000:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3722680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+18:2395:x1875455669026688:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1788574256.715108:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3722680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+18:2395:x1875455669026688:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 110us (2944us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574256.715116:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 382 00000100:00100000:2.0:1788574256.715136:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 383 00000100:00100000:2.0:1788574256.715142:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3720380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+5:2395:x1875455669026816:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1788574256.715181:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3720380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+5:2395:x1875455669026816:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 39us (1775us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574256.715203:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 383 00000100:00100000:2.0:1788574256.715215:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 384 00000100:00100000:2.0:1788574256.715222:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3720a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38a8b838-f1df-4bf7-be24-5141ce328dae+6:2395:x1875455669027200:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1788574256.715255:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3720a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38a8b838-f1df-4bf7-be24-5141ce328dae+6:2395:x1875455669027200:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 33us (1711us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574256.715261:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 384 00000100:00100000:2.0:1788574256.715272:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 385 00000100:00100000:2.0:1788574256.715277:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3722300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2395:x1875455669027328:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1788574256.715295:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3722300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2395:x1875455669027328:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 18us (1733us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574256.715300:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 385 00000100:00100000:3.0:1788574256.715619:0:8815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669026944 00000100:00100000:3.0:1788574256.715625:0:8815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669026944 00000100:00100000:3.0:1788574256.715663:0:8815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669027072 00000100:00100000:3.0:1788574256.715665:0:8815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669027072 00000100:00100000:3.0:1788574256.718217:0:8815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 151 00000100:00100000:3.0:1788574256.718247:0:8815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3721c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:659467ff-94af-418e-92fe-11e4323a48aa+7:2395:x1875455669026944:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1788574256.718362:0:8815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3721c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:659467ff-94af-418e-92fe-11e4323a48aa+7:2395:x1875455669026944:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 130us (4865us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574256.718372:0:8815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 151 00000100:00100000:3.0:1788574256.718398:0:8815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 152 00000100:00100000:3.0:1788574256.718405:0:8815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3722a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:659467ff-94af-418e-92fe-11e4323a48aa+5:2395:x1875455669027072:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1788574256.718435:0:8815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3722a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:659467ff-94af-418e-92fe-11e4323a48aa+5:2395:x1875455669027072:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 30us (4915us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574256.718441:0:8815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 152 00000100:00080000:3.0:1788574256.718477:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788574256.718482:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788574256.718486:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788574256.718490:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788574256.787548:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574257.300981:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3da5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875455681662208:0@lo:400:kworker.0 00000100:00100000:3.0:1788574257.301079:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574257.301150:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85de939f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681662720:0@lo:400:kworker.0 00000100:00100000:3.0:1788574257.301178:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574257.301221:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85de93b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681663232:0@lo:400:kworker.0 00000100:00100000:3.0:1788574257.301244:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574257.301271:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1788574257.301277:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3720700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69505170-06bc-41d1-9626-ab1a3c7f32a0:3619:1875455681661824:0@lo:400:kworker.0 00000100:00100000:3.0:1788574257.301323:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574257.301350:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3da7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681662336:0@lo:400:kworker.0 00000100:00100000:3.0:1788574257.301377:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574257.301396:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85de93a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681662848:0@lo:400:kworker.0 00000100:00100000:3.0:1788574257.301418:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574257.301434:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85de93a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681663360:0@lo:400:kworker.0 00000100:00100000:3.0:1788574257.301680:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574257.301754:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3da4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875455681661952:0@lo:400:kworker.0 00000100:00100000:3.0:1788574257.301784:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574257.301803:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3da4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1875455681662464:0@lo:400:kworker.0 00000100:00100000:3.0:1788574257.301824:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574257.301841:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85de938e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3617:1875455681662976:0@lo:400:kworker.0 00000100:00100000:3.0:1788574257.301862:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574257.301882:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788574257.301891:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3da4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681662080:0@lo:400:kworker.0 00000100:00100000:3.0:1788574257.301915:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574257.301932:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3da7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1875455681662592:0@lo:400:kworker.0 00000100:00100000:3.0:1788574257.301952:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574257.301982:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85de939500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1875455681663104:0@lo:400:kworker.0 00000100:00100000:3.0:1788574257.302009:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574257.302044:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681662208 00000100:00100000:3.0:1788574257.302054:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681662208 00000100:00100000:3.0:1788574257.302104:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681661952 00000100:00100000:3.0:1788574257.302107:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681661952 00000100:00100000:3.0:1788574257.302121:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681662464 00000100:00100000:3.0:1788574257.302132:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681662464 00000100:00100000:3.0:1788574257.302161:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681662976 00000100:00100000:3.0:1788574257.302164:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681662976 00000100:00100000:3.0:1788574257.302177:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681662592 00000100:00100000:3.0:1788574257.302179:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681662592 00000100:00100000:3.0:1788574257.302230:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681663104 00000100:00100000:3.0:1788574257.302234:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681663104 00000100:00100000:3.0:1788574257.302254:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:3.0:1788574257.302263:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de939880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875455681662208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574257.302328:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de939880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875455681662208:12345-0@lo:400:kworker.0 Request processed in 65us (1249us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574257.302335:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:3.0:1788574257.302359:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:3.0:1788574257.302366:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de93b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875455681661952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574257.302403:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de93b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875455681661952:12345-0@lo:400:kworker.0 Request processed in 37us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574257.302408:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:3.0:1788574257.302420:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:3.0:1788574257.302427:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de938700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875455681662464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574257.302470:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de938700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875455681662464:12345-0@lo:400:kworker.0 Request processed in 43us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574257.302476:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:3.0:1788574257.302487:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:3.0:1788574257.302492:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de938380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875455681662976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574257.304653:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:2.0:1788574257.304676:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de939180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875455681662592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574257.304771:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de939180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875455681662592:12345-0@lo:400:kworker.0 Request processed in 104us (2817us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574257.304780:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:2.0:1788574257.304808:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:2.0:1788574257.304815:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875455681663104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574257.304846:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875455681663104:12345-0@lo:400:kworker.0 Request processed in 32us (2836us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574257.304852:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:0.0:1788574257.304944:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681662720 00000100:00100000:0.0:1788574257.304955:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681662720 00000100:00100000:0.0:1788574257.305014:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681663232 00000100:00100000:0.0:1788574257.305018:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681663232 00000100:00100000:0.0:1788574257.305034:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681662848 00000100:00100000:3.0:1788574257.308133:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de938380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875455681662976:12345-0@lo:400:kworker.0 Request processed in 5627us (6256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574257.308152:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:3.0:1788574257.308252:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681662336 00000100:00100000:3.0:1788574257.308264:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681662336 00000100:00100000:3.0:1788574257.308312:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681662080 00000100:00100000:3.0:1788574257.308316:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681662080 00000100:00100000:3.0:1788574257.308333:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1788574257.308341:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de93ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681662336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574257.308448:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de93ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681662336:12345-0@lo:400:kworker.0 Request processed in 107us (7069us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574257.308456:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1788574257.308469:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1788574257.308476:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de939c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681662080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574257.308505:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de939c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681662080:12345-0@lo:400:kworker.0 Request processed in 30us (6589us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574257.308858:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00080000:3.0:1788574257.308891:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788574257.308899:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788574257.308902:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788574257.308932:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c2f44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681663616:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788574257.308998:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574257.309052:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788574257.309060:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c2f47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681663488:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788574257.309087:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574257.309120:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681663616 00000100:00100000:3.0:1788574257.309125:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681663616 00000100:00100000:3.0:1788574257.309164:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681663488 00000100:00100000:3.0:1788574257.309167:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681663488 00000100:00100000:3.0:1788574257.309180:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788574257.309210:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681663616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788574257.309262:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788574257.309305:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681663616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574257.309312:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788574257.309325:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788574257.309331:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3618:x1875455681663488:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788574257.309341:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788574257.309364:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3618:x1875455681663488:12345-0@lo:13:osp-pre-1-1.0 Request processed in 33us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574257.309370:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00080000:3.0:1788574257.309386:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788574257.309431:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c2f47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681663488:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788574257.309448:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c2f44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681663616:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788574257.309488:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3da4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681662080:0@lo:400:kworker.0 00010000:00080000:3.0:1788574257.309507:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3da7100 x1875455681662592/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574273 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574257.309631:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3da7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1875455681662592:0@lo:400:kworker.0 00010000:00080000:3.0:1788574257.309648:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85de939500 x1875455681663104/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574273 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574257.309657:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85de939500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1875455681663104:0@lo:400:kworker.0 00000100:00100000:3.0:1788574257.309671:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3da4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875455681661952:0@lo:400:kworker.0 00000100:00100000:3.0:1788574257.309684:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3da4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1875455681662464:0@lo:400:kworker.0 00000100:00100000:3.0:1788574257.309707:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85de938e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3617:1875455681662976:0@lo:400:kworker.0 00000100:00100000:3.0:1788574257.309764:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3da7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681662336:0@lo:400:kworker.0 00000100:00100000:3.0:1788574257.309780:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3da5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875455681662208:0@lo:400:kworker.0 00000100:00100000:0.0:1788574257.309898:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681662848 00000100:00100000:0.0:1788574257.309940:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681663360 00000100:00100000:0.0:1788574257.309943:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681663360 00000100:00100000:0.0:1788574257.309959:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788574257.309978:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de93bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681662720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574257.310032:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de93bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681662720:12345-0@lo:400:kworker.0 Request processed in 56us (8853us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574257.310050:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788574257.310065:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788574257.310072:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de938000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681663232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574257.310099:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de938000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681663232:12345-0@lo:400:kworker.0 Request processed in 28us (8855us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574257.310105:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788574257.310115:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788574257.310120:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de938a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681662848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574257.310142:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de938a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681662848:12345-0@lo:400:kworker.0 Request processed in 23us (8725us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574257.310147:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788574257.310155:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788574257.310160:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de93aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681663360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574257.310183:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de93aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681663360:12345-0@lo:400:kworker.0 Request processed in 24us (8503us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574257.310219:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788574257.315100:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85de93a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681662848:0@lo:400:kworker.0 00000100:00100000:3.0:1788574257.315124:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85de93a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681663360:0@lo:400:kworker.0 00000100:00100000:3.0:1788574257.315139:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85de939f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681662720:0@lo:400:kworker.0 00000100:00100000:3.0:1788574257.315152:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85de93b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681663232:0@lo:400:kworker.0 00000100:00100000:2.0:1788574257.315835:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681661824 00000100:00100000:2.0:1788574257.315847:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681661824 00000100:00100000:2.0:1788574257.315926:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 403 00000100:00100000:2.0:1788574257.315938:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5673850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:3619:x1875455681661824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574257.316067:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5673850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:3619:x1875455681661824:12345-0@lo:400:kworker.0 Request processed in 131us (14743us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574257.316075:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 403 00000100:00100000:2.0:1788574257.316145:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3720700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69505170-06bc-41d1-9626-ab1a3c7f32a0:3619:1875455681661824:0@lo:400:kworker.0 00010000:00010000:1.0:1788574257.811886:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574258.835904:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574259.860796:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574259.864946:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788574259.864978:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681663744:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788574259.865079:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574259.865210:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681663744 00000100:00100000:0.0:1788574259.865221:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681663744 00000100:00100000:0.0:1788574259.865284:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1788574259.865294:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681663744:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788574259.865353:0:6498:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1788574259.865411:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681663744:12345-0@lo:41:osp-pre-0-1.0 Request processed in 118us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574259.865420:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1788574259.865483:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681663744:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788574259.903433:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574259.903553:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669027584 00000100:00100000:3.0:1788574259.903568:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669027584 00000100:00100000:3.0:1788574259.903666:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 66 00000100:00100000:3.0:1788574259.903680:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:659467ff-94af-418e-92fe-11e4323a48aa+18:13175:x1875455669027584:12345-192.168.204.51@tcp:35:umount.0 00000100:00100000:3.0:1788574259.904109:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:659467ff-94af-418e-92fe-11e4323a48aa+19:13175:x1875455669027584:12345-192.168.204.51@tcp:35:umount.0 Request processed in 430us (694us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1788574259.904118:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 66 00000100:00080000:0.0:1788574259.904450:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788574259.922407:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574259.922511:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669027840 00000100:00100000:3.0:1788574259.922526:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669027840 00000100:00100000:3.0:1788574259.922602:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 67 00000100:00100000:3.0:1788574259.922614:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2f45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:659467ff-94af-418e-92fe-11e4323a48aa+19:13175:x1875455669027840:12345-192.168.204.51@tcp:35:umount.0 00000100:00100000:3.0:1788574259.923009:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2f45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:659467ff-94af-418e-92fe-11e4323a48aa+20:13175:x1875455669027840:12345-192.168.204.51@tcp:35:umount.0 Request processed in 396us (616us total) trans 4294967525 rc 0/0 00000100:00100000:3.0:1788574259.923019:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 67 00000100:00100000:2.0:1788574259.934082:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574259.934306:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669028096 00000100:00100000:3.0:1788574259.934343:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669028096 00000100:00100000:3.0:1788574259.934430:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 68 00000100:00100000:3.0:1788574259.934443:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85d01f6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:659467ff-94af-418e-92fe-11e4323a48aa+20:13175:x1875455669028096:12345-192.168.204.51@tcp:35:umount.0 00000100:00100000:3.0:1788574259.934794:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85d01f6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:659467ff-94af-418e-92fe-11e4323a48aa+21:13175:x1875455669028096:12345-192.168.204.51@tcp:35:umount.0 Request processed in 353us (732us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1788574259.934805:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 68 00000100:00100000:0.0:1788574259.939879:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574259.940002:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669028352 00000100:00100000:3.0:1788574259.940017:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669028352 00000100:00100000:3.0:1788574259.940155:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 69 00000100:00100000:3.0:1788574259.940169:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:659467ff-94af-418e-92fe-11e4323a48aa+21:13175:x1875455669028352:12345-192.168.204.51@tcp:35:umount.0 00000100:00100000:3.0:1788574259.940644:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:659467ff-94af-418e-92fe-11e4323a48aa+22:13175:x1875455669028352:12345-192.168.204.51@tcp:35:umount.0 Request processed in 476us (785us total) trans 4294967527 rc 0/0 00000100:00100000:3.0:1788574259.940655:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 69 00000100:00100000:2.0:1788574259.956565:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574259.956611:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574259.956647:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574259.956680:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574259.956840:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669028480 00000100:00100000:3.0:1788574259.956854:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669028480 00000100:00100000:3.0:1788574259.956944:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669028736 00000100:00100000:3.0:1788574259.956947:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669028736 00000100:00100000:3.0:1788574259.956961:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669028608 00000100:00100000:3.0:1788574259.956963:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669028608 00000100:00100000:3.0:1788574259.956980:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 19 00000100:00100000:3.0:1788574259.956992:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2f46300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+15:2396:x1875455669028480:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788574259.957014:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574259.957042:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85c152f200/0x5bf8706fdac8bfa7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6675 expref: 15 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574259.957065:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788574259.957147:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2f46300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+14:2396:x1875455669028480:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 157us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574259.957175:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 19 00000100:00100000:3.0:1788574259.957230:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 20 00000100:00100000:3.0:1788574259.957238:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2f45f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+13:2396:x1875455669028736:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788574259.957246:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574259.957256:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85faea2800/0x5bf8706fdac8c1fa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d674e expref: 13 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574259.957266:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788574259.957284:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2f45f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+12:2396:x1875455669028736:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 47us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574259.957291:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 20 00000100:00100000:3.0:1788574259.957302:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 21 00000100:00100000:3.0:1788574259.957308:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2f47100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+11:2396:x1875455669028608:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788574259.957315:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574259.957325:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85fa32e200/0x5bf8706fdac8beea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6636 expref: 11 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574259.957334:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788574259.957351:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2f47100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+10:2396:x1875455669028608:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 44us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574259.957358:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 21 00000100:00100000:0.0:1788574259.960487:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669028864 00000100:00100000:0.0:1788574259.960519:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669028864 00000100:00100000:0.0:1788574259.960643:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 81 00000100:00100000:0.0:1788574259.960655:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2f45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:659467ff-94af-418e-92fe-11e4323a48aa+5:2392:x1875455669028864:12345-192.168.204.51@tcp:9:umount.0 00000020:00000080:0.0:1788574259.960697:0:8409:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8c2c5 00000100:00080000:0.0:1788574259.960709:0:8409:0:(import.c:65:import_set_state_nolock()) ffff9c85ffb67800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788574259.960783:0:8409:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:0.0:1788574259.961009:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2f45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:659467ff-94af-418e-92fe-11e4323a48aa+2:2392:x1875455669028864:12345-192.168.204.51@tcp:9:umount.0 Request processed in 354us (4324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574259.961018:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 81 00000100:00080000:3.0:1788574259.961430:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788574259.962615:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574259.969537:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574259.969856:0:13791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669029248 00000100:00100000:3.0:1788574259.969870:0:13791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669029248 00000100:00100000:3.0:1788574259.969980:0:13791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 82 00000100:00100000:3.0:1788574259.969993:0:13791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2f45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:659467ff-94af-418e-92fe-11e4323a48aa+7:2392:x1875455669029248:12345-192.168.204.51@tcp:9:umount.0 00000020:00000080:3.0:1788574259.970059:0:13791:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8c53b 00000020:00010000:3.0:1788574259.970069:0:13791:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9c85ffb5e000: total 0 00000100:00080000:3.0:1788574259.970075:0:13791:0:(import.c:65:import_set_state_nolock()) ffff9c85ffb5b800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788574259.970162:0:13791:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967326 00000020:00010000:1.0:1788574259.970681:0:7444:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9c85ffb5e000: total 0 00010000:00010000:1.0:1788574259.970739:0:7444:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9c85ffb5e000, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1788574259.970819:0:7444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042acfec9/0x5bf8706fdac8cfc2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6b1b expref: 5 pid: 8410 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574259.970865:0:7444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6d2d339/0x5bf8706fdac8c8f3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6938 expref: 4 pid: 8410 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574259.970882:0:7444:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9c85ffb5e000, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1788574259.970895:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574259.970898:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574259.970900:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574259.971064:0:13791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2f45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:659467ff-94af-418e-92fe-11e4323a48aa+2:2392:x1875455669029248:12345-192.168.204.51@tcp:9:umount.0 Request processed in 1072us (1541us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574259.971075:0:13791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 82 00000100:00080000:0.0:1788574259.973350:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788574259.981358:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574259.981621:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669030272 00000100:00100000:2.0:1788574259.981635:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669030272 00000100:00100000:2.0:1788574259.981722:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 258 00000100:00100000:2.0:1788574259.981734:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+22:2392:x1875455669030272:12345-192.168.204.51@tcp:39:umount.0 00000020:00000080:2.0:1788574259.981781:0:7439:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8bef8 00000020:00010000:2.0:1788574259.981804:0:7439:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9c84c1bef000: total 0 00000100:00080000:2.0:1788574259.981810:0:7439:0:(import.c:65:import_set_state_nolock()) ffff9c84c1be9800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788574259.981851:0:7439:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:2.0:1788574259.982077:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:659467ff-94af-418e-92fe-11e4323a48aa+21:2392:x1875455669030272:12345-192.168.204.51@tcp:39:umount.0 Request processed in 345us (734us total) trans 4294967528 rc 0/0 00000100:00100000:2.0:1788574259.982104:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 258 00000020:00010000:0.0:1788574259.986588:0:6480:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9c84c1bef000: total 0 00010000:00010000:0.0:1788574259.986689:0:6480:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9c84c1bef000, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1788574259.986734:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c85d07b8d00) 00010000:00010000:0.0:1788574259.986739:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788574259.986754:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f400/0x5bf8706fdac8cc65 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6a34 expref: 20 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574259.986780:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c85fa28c100) 00010000:00010000:0.0:1788574259.986782:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788574259.986787:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616400/0x5bf8706fdac8c95c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6954 expref: 19 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574259.986800:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c84c34f0e00) 00010000:00010000:0.0:1788574259.986802:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788574259.986806:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616000/0x5bf8706fdac8cfad lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6b14 expref: 18 pid: 11893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574259.986820:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c85ec19ac00) 00010000:00010000:0.0:1788574259.986822:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788574259.986826:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7400/0x5bf8706fdac8c29b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6778 expref: 17 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574259.986837:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c84c34f0e00) 00010000:00010000:0.0:1788574259.986839:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788574259.986842:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a3000/0x5bf8706fdac8cea3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ace expref: 16 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574259.986878:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c85fa28c700) 00010000:00010000:0.0:1788574259.986881:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788574259.986885:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6800/0x5bf8706fdac8c8de lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6931 expref: 15 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574259.986897:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9c85ec19ac00) 00010000:00010000:0.0:1788574259.986899:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788574259.986902:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c84c2616800/0x5bf8706fdac8c596 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6851 expref: 14 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574259.986932:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c85c90c8800) 00010000:00010000:0.0:1788574259.986934:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574259.986938:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32f800/0x5bf8706fdac8c240 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6763 expref: 13 pid: 6492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574259.986953:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c85fa28c700) 00010000:00010000:0.0:1788574259.986955:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788574259.986958:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6a00/0x5bf8706fdac8c8b4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6923 expref: 12 pid: 11893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574259.986969:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9c85d07b8d00) 00010000:00010000:0.0:1788574259.986971:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788574259.986974:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e200/0x5bf8706fdac8c978 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d695b expref: 11 pid: 11893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574259.986989:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9c85c6b83800) 00010000:00010000:0.0:1788574259.986991:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788574259.987000:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6e00/0x5bf8706fdac8c224 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d675c expref: 10 pid: 11893 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574259.987018:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9c84c34f0e00) 00010000:00010000:0.0:1788574259.987021:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788574259.987024:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2600/0x5bf8706fdac8cf83 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6b06 expref: 9 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574259.987040:0:6480:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9c85fa28c700) 00010000:00010000:0.0:1788574259.987042:0:6480:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788574259.987046:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3600/0x5bf8706fdac8c7d4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d68eb expref: 8 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574259.987063:0:6480:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9c84c1bef000, canceled 13 locks, left on hash table 0. 00010000:00010000:0.0:1788574259.987080:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574259.987082:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574259.987084:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574260.001738:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574260.001846:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669030400 00000100:00100000:3.0:1788574260.001861:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669030400 00000100:00100000:3.0:1788574260.001969:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 259 00000100:00100000:3.0:1788574260.001982:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3f26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+5:2392:x1875455669030400:12345-192.168.204.51@tcp:39:umount.0 00000020:00000080:3.0:1788574260.002031:0:6493:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8beff 00000100:00080000:3.0:1788574260.002055:0:6493:0:(import.c:65:import_set_state_nolock()) ffff9c85faf2e000 : changing import state from FULL to CLOSED 00000100:00080000:0.0:1788574260.002173:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00000004:3.0:1788574260.003262:0:6493:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1788574260.003530:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3f26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:659467ff-94af-418e-92fe-11e4323a48aa+3:2392:x1875455669030400:12345-192.168.204.51@tcp:39:umount.0 Request processed in 1545us (1802us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788574260.003541:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 259 00010000:00010000:2.0:1788574260.006397:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574260.889110:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574261.395645:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788574261.396316:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c2f46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681664000:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788574261.396418:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574261.396695:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681664000 00000100:00100000:1.0:1788574261.396701:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681663872:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788574261.396708:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681664000 00000100:00100000:1.0:1788574261.396750:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574261.396802:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788574261.396813:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681663872 00000100:00100000:2.0:1788574261.396817:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681664000:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788574261.396819:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681663872 00000100:00100000:1.0:1788574261.396859:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00002000:00000024:2.0:1788574261.396864:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1788574261.396872:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3f24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681663872:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788574261.396920:0:6497:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788574261.396944:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681664000:12345-0@lo:13:osp-pre-0-1.0 Request processed in 131us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574261.396953:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788574261.397007:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c2f46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681664000:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788574261.397039:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3f24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681663872:12345-0@lo:41:osp-pre-1-0.0 Request processed in 170us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574261.397048:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1788574261.397085:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681663872:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788574261.397273:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681664128:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788574261.397312:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574261.397349:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681664128 00000100:00100000:3.0:1788574261.397353:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681664128 00000100:00100000:3.0:1788574261.397384:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788574261.397392:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681664128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788574261.397405:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1788574261.397439:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681664128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 48us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574261.397457:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788574261.397504:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681664128:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788574261.397766:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788574261.831997:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574261.832057:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574261.832099:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574261.832241:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669030528 00000100:00100000:2.0:1788574261.832255:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669030528 00000100:00100000:2.0:1788574261.832336:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 404 00000100:00100000:2.0:1788574261.832357:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5672050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+10:2394:x1875455669030528:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1788574261.832453:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5672050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+10:2394:x1875455669030528:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 100us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574261.832461:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 404 00000100:00100000:2.0:1788574261.832517:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669030784 00000100:00100000:2.0:1788574261.832521:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669030784 00000100:00100000:2.0:1788574261.832571:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669030656 00000100:00100000:2.0:1788574261.832575:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669030656 00000100:00100000:2.0:1788574261.832601:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 392 00000100:00100000:2.0:1788574261.832620:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c335f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2394:x1875455669030784:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1788574261.832656:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c335f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2394:x1875455669030784:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 48us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574261.832682:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 392 00000100:00100000:2.0:1788574261.832695:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 393 00000100:00100000:2.0:1788574261.832701:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c335dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38a8b838-f1df-4bf7-be24-5141ce328dae+6:2394:x1875455669030656:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1788574261.832727:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c335dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38a8b838-f1df-4bf7-be24-5141ce328dae+6:2394:x1875455669030656:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 26us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574261.832744:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 393 00000100:00080000:2.0:1788574261.832762:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788574261.832767:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1788574261.909601:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574262.420039:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788574262.420071:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681664256:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788574262.420172:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574262.420304:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681664256 00000100:00100000:3.0:1788574262.420326:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681664256 00000100:00100000:3.0:1788574262.420427:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788574262.420440:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681664256:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788574262.420485:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788574262.420539:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681664256:12345-0@lo:13:osp-pre-1-1.0 Request processed in 102us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574262.420546:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00080000:3.0:1788574262.420570:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788574262.420618:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681664256:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788574262.420969:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681664640:0@lo:400:kworker.0 00000100:00100000:3.0:1788574262.421009:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574262.421102:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875455681664768:0@lo:400:kworker.0 00000100:00100000:1.0:1788574262.421140:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574262.421168:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681665280:0@lo:400:kworker.0 00000100:00100000:1.0:1788574262.421227:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574262.421246:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681665792:0@lo:400:kworker.0 00000100:00100000:1.0:1788574262.421270:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574262.421293:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788574262.421298:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69505170-06bc-41d1-9626-ab1a3c7f32a0:3619:1875455681664384:0@lo:400:kworker.0 00000100:00100000:3.0:1788574262.421399:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3618:1875455681665152:0@lo:400:kworker.0 00000100:00100000:3.0:1788574262.421421:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574262.421434:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3618:1875455681665664:0@lo:400:kworker.0 00000100:00100000:3.0:1788574262.421451:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574262.421482:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788574262.421488:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875455681664512:0@lo:400:kworker.0 00000100:00100000:3.0:1788574262.421509:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574262.421548:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3618:1875455681665024:0@lo:400:kworker.0 00000100:00100000:3.0:1788574262.421570:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574262.421589:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3618:1875455681665536:0@lo:400:kworker.0 00000100:00100000:3.0:1788574262.421609:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574262.421640:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681664768 00000100:00100000:3.0:1788574262.421646:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681664768 00000100:00100000:3.0:1788574262.421685:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681665152 00000100:00100000:3.0:1788574262.421687:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681665152 00000100:00100000:3.0:1788574262.421709:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681665664 00000100:00100000:3.0:1788574262.421712:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681665664 00000100:00100000:3.0:1788574262.421726:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681664512 00000100:00100000:3.0:1788574262.421728:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681664512 00000100:00100000:3.0:1788574262.421739:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681665024 00000100:00100000:3.0:1788574262.421741:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681665024 00000100:00100000:3.0:1788574262.421753:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681665536 00000100:00100000:3.0:1788574262.421755:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681665536 00000100:00100000:3.0:1788574262.421770:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:3.0:1788574262.421777:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c335c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875455681664768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574262.421824:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c335c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875455681664768:12345-0@lo:400:kworker.0 Request processed in 47us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574262.421831:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:3.0:1788574262.421846:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:3.0:1788574262.421852:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875455681665152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574262.421896:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875455681665152:12345-0@lo:400:kworker.0 Request processed in 44us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574262.421903:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:3.0:1788574262.421914:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:3.0:1788574262.421920:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875455681665664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574262.421954:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875455681665664:12345-0@lo:400:kworker.0 Request processed in 35us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574262.421960:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:3.0:1788574262.421971:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:3.0:1788574262.421977:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875455681664512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574262.422004:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875455681664512:12345-0@lo:400:kworker.0 Request processed in 27us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574262.422010:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:3.0:1788574262.422020:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:3.0:1788574262.422026:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875455681665024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574262.422050:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875455681665024:12345-0@lo:400:kworker.0 Request processed in 24us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574262.422055:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00000100:00100000:3.0:1788574262.422063:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:3.0:1788574262.422068:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875455681665536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574262.422089:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875455681665536:12345-0@lo:400:kworker.0 Request processed in 22us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574262.422095:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00080000:3.0:1788574262.422110:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788574262.422114:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788574262.422140:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875455681664512:0@lo:400:kworker.0 00000100:00100000:3.0:1788574262.422151:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3618:1875455681665024:0@lo:400:kworker.0 00000100:00100000:3.0:1788574262.422158:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3618:1875455681665536:0@lo:400:kworker.0 00010000:00080000:3.0:1788574262.422171:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3c0bb80 x1875455681665152/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574278 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574262.422211:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3618:1875455681665152:0@lo:400:kworker.0 00010000:00080000:3.0:1788574262.422226:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c36dea00 x1875455681665664/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574278 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574262.422236:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3618:1875455681665664:0@lo:400:kworker.0 00000100:00100000:3.0:1788574262.422307:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681665280 00000100:00100000:3.0:1788574262.422311:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681665280 00000100:00100000:3.0:1788574262.422357:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681665792 00000100:00100000:3.0:1788574262.422360:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681665792 00000100:00100000:3.0:1788574262.422398:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788574262.422405:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c335e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681665280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574262.422442:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c335e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681665280:12345-0@lo:400:kworker.0 Request processed in 38us (1216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574262.422448:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788574262.422460:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788574262.422466:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c335e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681665792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574262.422493:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c335e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681665792:12345-0@lo:400:kworker.0 Request processed in 28us (1222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574262.422498:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00080000:3.0:1788574262.422513:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788574262.423182:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574262.423254:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681664896:0@lo:400:kworker.0 00000100:00100000:1.0:1788574262.423290:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574262.423488:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c2f46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681665920:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788574262.423526:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574262.423576:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681665920 00000100:00100000:2.0:1788574262.423583:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681665920 00000100:00100000:2.0:1788574262.423624:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788574262.423632:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2f47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681665920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788574262.423655:0:14401:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788574262.423698:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2f47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681665920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574262.423705:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788574262.423751:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c2f46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681665920:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788574262.424063:0:6486:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681664384 00000100:00100000:3.0:1788574262.424069:0:6486:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681664384 00000100:00100000:3.0:1788574262.424110:0:6486:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 405 00000100:00100000:3.0:1788574262.424118:0:6486:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5671050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:3619:x1875455681664384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574262.424161:0:6486:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5671050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:3619:x1875455681664384:12345-0@lo:400:kworker.0 Request processed in 45us (982us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574262.424212:0:6486:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 405 00000100:00100000:1.0:1788574262.437809:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681665408:0@lo:400:kworker.0 00000100:00100000:1.0:1788574262.437921:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574262.437987:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875455681664768:0@lo:400:kworker.0 00000100:00100000:1.0:1788574262.438004:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681665280:0@lo:400:kworker.0 00000100:00100000:1.0:1788574262.438018:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681665792:0@lo:400:kworker.0 00000100:00100000:1.0:1788574262.438051:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69505170-06bc-41d1-9626-ab1a3c7f32a0:3619:1875455681664384:0@lo:400:kworker.0 00000100:00100000:1.0:1788574262.438100:0:8815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681665408 00000100:00100000:1.0:1788574262.438109:0:8815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681665408 00000100:00100000:1.0:1788574262.438211:0:8815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788574262.438241:0:8815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c335d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681665408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574262.438303:0:8815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c335d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681665408:12345-0@lo:400:kworker.0 Request processed in 65us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574262.438311:0:8815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788574262.438370:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681665408:0@lo:400:kworker.0 00000100:00100000:0.0:1788574262.442073:0:7533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681664640 00000100:00100000:0.0:1788574262.442096:0:7533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681664640 00000100:00100000:1.0:1788574262.442834:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681664896 00000100:00100000:1.0:1788574262.442845:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681664896 00000100:00100000:1.0:1788574262.442902:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1788574262.442915:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681664640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574262.443905:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681664640:12345-0@lo:400:kworker.0 Request processed in 985us (22887us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574262.443920:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1788574262.443956:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1788574262.443965:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c335f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681664896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574262.444568:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c335f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681664896:12345-0@lo:400:kworker.0 Request processed in 600us (21273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574262.444579:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1788574262.444645:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681664896:0@lo:400:kworker.0 00000100:00100000:3.0:1788574262.446055:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c09180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681664640:0@lo:400:kworker.0 00000100:00100000:0.0:1788574262.526503:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574262.526560:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574262.526623:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574262.526797:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669031040 00000100:00100000:3.0:1788574262.526814:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669031040 00000100:00100000:3.0:1788574262.527002:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669030912 00000100:00100000:3.0:1788574262.527007:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669030912 00000100:00100000:2.0:1788574262.532160:0:6477:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669031168 00000100:00100000:2.0:1788574262.532186:0:6477:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669031168 00000100:00100000:2.0:1788574262.533512:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 22 00000100:00100000:2.0:1788574262.533546:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+12:2394:x1875455669031040:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788574262.533571:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1788574262.533599:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 23 00010000:00010000:2.0:1788574262.533624:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85c0030e00/0x5bf8706fdac8c002 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d66bb expref: 12 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574262.533649:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788574262.533749:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+11:2394:x1875455669031040:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 220us (7262us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574262.533855:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e0bdc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+11:2394:x1875455669030912:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788574262.533887:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574262.533912:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85c0031c00/0x5bf8706fdac8bffb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d668a expref: 11 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574262.533932:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574262.533996:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e0bdc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+10:2394:x1875455669030912:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 153us (7435us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574262.534068:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 22 00000100:00100000:2.0:1788574262.534119:0:6477:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 24 00000100:00100000:2.0:1788574262.534130:0:6477:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+9:2394:x1875455669031168:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788574262.534144:0:6477:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788574262.534160:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85faea3200/0x5bf8706fdac8c1f3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6747 expref: 9 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574262.534173:0:6477:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574262.534185:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 23 00000100:00100000:2.0:1788574262.534246:0:6477:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+7:2394:x1875455669031168:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 116us (7624us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574262.534255:0:6477:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 24 00000100:00100000:3.0:1788574262.541546:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574262.541633:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669031424 00000100:00100000:0.0:1788574262.541643:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669031424 00000100:00100000:0.0:1788574262.541703:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 260 00000100:00100000:0.0:1788574262.541713:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38a8b838-f1df-4bf7-be24-5141ce328dae+6:2392:x1875455669031424:12345-192.168.204.51@tcp:39:umount.0 00000020:00000080:0.0:1788574262.541750:0:6493:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8c017 00000020:00010000:0.0:1788574262.541759:0:6493:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9c85ffb14000: total 0 00000100:00080000:0.0:1788574262.541764:0:6493:0:(import.c:65:import_set_state_nolock()) ffff9c85ffb11800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788574262.541788:0:6493:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00100000:0.0:1788574262.541947:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2392:x1875455669031424:12345-192.168.204.51@tcp:39:umount.0 Request processed in 236us (410us total) trans 4294967529 rc 0/0 00000100:00100000:0.0:1788574262.541956:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 260 00000020:00010000:2.0:1788574262.542606:0:6481:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9c85ffb14000: total 0 00010000:00010000:2.0:1788574262.542612:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574262.542658:0:6481:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9c85ffb14000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1788574262.542689:0:6481:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c85fa28c100) 00010000:00010000:2.0:1788574262.542693:0:6481:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788574262.542702:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85fa32e400/0x5bf8706fdac8cfd0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6b22 expref: 4 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574262.542725:0:6481:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9c85ffb14000, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1788574262.542734:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574262.542736:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574262.542749:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574262.551323:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574262.551510:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669031552 00000100:00100000:2.0:1788574262.551522:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669031552 00000100:00100000:2.0:1788574262.551607:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 261 00000100:00100000:2.0:1788574262.551620:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38a8b838-f1df-4bf7-be24-5141ce328dae+5:2392:x1875455669031552:12345-192.168.204.51@tcp:39:umount.0 00000020:00000080:2.0:1788574262.551793:0:7439:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8c010 00000100:00080000:2.0:1788574262.551806:0:7439:0:(import.c:65:import_set_state_nolock()) ffff9c85ffb1c800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788574262.551839:0:7439:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1788574262.552011:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38a8b838-f1df-4bf7-be24-5141ce328dae+3:2392:x1875455669031552:12345-192.168.204.51@tcp:39:umount.0 Request processed in 393us (699us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788574262.552021:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 261 00010000:00010000:1.0:1788574262.552361:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574262.598856:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574262.598943:0:6485:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669031808 00000100:00100000:2.0:1788574262.598956:0:6485:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669031808 00000100:00100000:2.0:1788574262.599030:0:6485:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 406 00000100:00100000:2.0:1788574262.599041:0:6485:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e5671c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+7:2392:x1875455669031808:12345-192.168.204.51@tcp:251:umount.0 00000020:00000080:2.0:1788574262.599099:0:6485:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8bed5 00000020:00010000:2.0:1788574262.599107:0:6485:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9c84c3285800: total 0 00000100:00080000:2.0:1788574262.599112:0:6485:0:(import.c:65:import_set_state_nolock()) ffff9c84c3285000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788574262.599223:0:6485:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e5671c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0aa00de1-a4b8-4ab8-ae12-895c156dafdd+3:2392:x1875455669031808:12345-192.168.204.51@tcp:251:umount.0 Request processed in 183us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574262.599232:0:6485:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 406 00000020:00010000:0.0:1788574262.599459:0:6480:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9c84c3285800: total 0 00010000:00010000:0.0:1788574262.599517:0:6480:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9c84c3285800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788574262.599556:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85faea3000/0x5bf8706fdac8bfae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d667c expref: 2 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574262.599570:0:6480:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9c84c3285800, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1788574262.599581:0:6480:0:(genops.c:885:class_export_put()) final put ffff9c84c3285800/0aa00de1-a4b8-4ab8-ae12-895c156dafdd 00010000:00010000:0.0:1788574262.599617:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574262.599619:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574262.599621:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788574262.599725:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c84c3285800/0aa00de1-a4b8-4ab8-ae12-895c156dafdd for MGS 00000020:00000080:2.0:1788574262.599833:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c84c3285000 for MGS 00010000:00010000:2.0:1788574262.938091:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788574263.444422:0:13768:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788574263.957824:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788574264.019430:0:13764:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788574264.019441:0:13764:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788574264.019968:0:13764:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1788574264.019980:0:13764:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000020:01000004:3.0:1788574264.707183:0:15078:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1788574264.723592:0:15078:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1788574264.723656:0:15078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c860217f200/0x5bf8706fdac8bf7d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bf84 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574264.723673:0:15078:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c860217f200/0x5bf8706fdac8bf7d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8bf84 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574264.723680:0:15078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c860217f200/0x5bf8706fdac8bf7d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x5bf8706fdac8bf84 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574264.723703:0:15078:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.151@tcp lock: ffff9c860217f200/0x5bf8706fdac8bf7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x5bf8706fdac8bf84 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574264.723720:0:15078:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788574264.723726:0:15078:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788574264.723753:0:15078:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788574264.723758:0:15078:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788574264.723763:0:15078:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788574264.723791:0:15078:0:(import.c:65:import_set_state_nolock()) ffff9c85fa1f8000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1788574264.723888:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788574264.723971:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c860217f200/0x5bf8706fdac8bf7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x5bf8706fdac8bf84 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574264.723980:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c860217f200 already unused, calling callback (ffffffffc1472c20) 10000000:00010000:0.0:1788574264.723985:0:6480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c860217f200/0x5bf8706fdac8bf7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x5bf8706fdac8bf84 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574264.723995:0:6480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c860217f200/0x5bf8706fdac8bf7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x5bf8706fdac8bf84 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788574264.724002:0:6480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c860217f200/0x5bf8706fdac8bf7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x5bf8706fdac8bf84 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788574264.724009:0:6480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788574264.724011:0:6480:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788574264.724014:0:6480:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788574264.724043:0:6480:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9c860217f200/0x5bf8706fdac8bf7d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x5bf8706fdac8bf84 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574264.724050:0:6480:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788574264.724075:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c860217f200/0x5bf8706fdac8bf7d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x5bf8706fdac8bf84 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574264.724083:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c860217f200/0x5bf8706fdac8bf7d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x5bf8706fdac8bf84 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574264.724109:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574264.724111:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574264.724112:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574264.724167:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875455681666048:0@lo:39:umount.0 00000100:00100000:3.0:1788574264.724265:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574264.724324:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788574264.724331:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:69505170-06bc-41d1-9626-ab1a3c7f32a0:3618:1875455681666176:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788574264.724355:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574264.724391:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681666176 00000100:00100000:3.0:1788574264.724397:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681666176 00000100:00100000:3.0:1788574264.724445:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788574264.724454:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf5df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:3618:x1875455681666176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788574264.724468:0:6479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574264.724483:0:6479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c860204ba00/0x5bf8706fdac8bf84 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5bf8706fdac8bf7d expref: 24 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574264.724497:0:6479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788574264.724530:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf5df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69505170-06bc-41d1-9626-ab1a3c7f32a0+23:3618:x1875455681666176:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574264.724537:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788574264.724574:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:69505170-06bc-41d1-9626-ab1a3c7f32a0:3618:1875455681666176:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788574264.724673:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681666048 00000100:00100000:0.0:1788574264.724677:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681666048 00000100:00100000:0.0:1788574264.724708:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1788574264.724715:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875455681666048:12345-0@lo:39:umount.0 00000020:00000080:0.0:1788574264.724736:0:6492:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8baec 00000100:00080000:0.0:1788574264.724744:0:6492:0:(import.c:65:import_set_state_nolock()) ffff9c85ca1c9800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788574264.724794:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3616:x1875455681666048:12345-0@lo:39:umount.0 Request processed in 79us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574264.724800:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000020:00000080:0.0:1788574264.724806:0:6492:0:(genops.c:885:class_export_put()) final put ffff9c85ca1cc000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:0.0:1788574264.724843:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788574264.724853:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85ca1cc000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1788574264.724895:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c85ca1c9800 for lustre-MDT0000 00000100:00080000:3.0:1788574264.725397:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c85fa1f8000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788574264.725446:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875455681666048:0@lo:39:umount.0 00000100:00080000:1.0:1788574264.725500:0:15078:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788574264.725503:0:15078:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788574264.725507:0:15078:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788574264.729714:0:15078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c860217ee00/0x5bf8706fdac8bf8b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bf92 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574264.729734:0:15078:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c860217ee00/0x5bf8706fdac8bf8b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8bf92 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574264.729741:0:15078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c860217ee00/0x5bf8706fdac8bf8b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x5bf8706fdac8bf92 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574264.729747:0:15078:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.151@tcp lock: ffff9c860217ee00/0x5bf8706fdac8bf8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x5bf8706fdac8bf92 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574264.729808:0:15078:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788574264.729815:0:15078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7800/0x5bf8706fdac8be8f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8be96 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574264.729845:0:15078:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7800/0x5bf8706fdac8be8f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8be96 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574264.729851:0:15078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7800/0x5bf8706fdac8be8f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5bf8706fdac8be96 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574264.729856:0:15078:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7800/0x5bf8706fdac8be8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5bf8706fdac8be96 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574264.734492:0:7444:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788574264.734544:0:15078:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788574264.734571:0:15078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7a00/0x5bf8706fdac8c1e5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8c1ec expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574264.734583:0:15078:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7a00/0x5bf8706fdac8c1e5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8c1ec expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574264.734591:0:15078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7a00/0x5bf8706fdac8c1e5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x5bf8706fdac8c1ec expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574264.734599:0:15078:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7a00/0x5bf8706fdac8c1e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x5bf8706fdac8c1ec expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574264.734690:0:15078:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788574264.734694:0:7444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c860217ee00/0x5bf8706fdac8bf8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x5bf8706fdac8bf92 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574264.734698:0:15078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7600/0x5bf8706fdac8ba4b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8ba52 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574264.734701:0:7444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c860217ee00 already unused, calling callback (ffffffffc1472c20) 00010000:00010000:1.0:1788574264.734706:0:15078:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7600/0x5bf8706fdac8ba4b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8ba52 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788574264.734706:0:7444:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c860217ee00/0x5bf8706fdac8bf8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x5bf8706fdac8bf92 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574264.734716:0:7444:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c860217ee00/0x5bf8706fdac8bf8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x5bf8706fdac8bf92 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788574264.734723:0:7444:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c860217ee00/0x5bf8706fdac8bf8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x5bf8706fdac8bf92 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574264.734733:0:15078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7600/0x5bf8706fdac8ba4b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5bf8706fdac8ba52 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788574264.734735:0:7444:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788574264.734737:0:7444:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1788574264.734740:0:15078:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7600/0x5bf8706fdac8ba4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5bf8706fdac8ba52 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574264.734746:0:15078:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:1.0:1788574264.734750:0:15078:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1788574264.734759:0:15078:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:0.0:1788574264.734777:0:7444:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9c860217ee00/0x5bf8706fdac8bf8b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x5bf8706fdac8bf92 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574264.734782:0:7444:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788574264.734807:0:7444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c860217ee00/0x5bf8706fdac8bf8b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x5bf8706fdac8bf92 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788574264.734810:0:15078:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1788574264.734814:0:15078:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00010000:00010000:0.0:1788574264.734814:0:7444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c860217ee00/0x5bf8706fdac8bf8b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x5bf8706fdac8bf92 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1788574264.734828:0:15078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788574264.734835:0:15078:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:1.0:1788574264.734843:0:15078:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9c84c3021800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:0.0:1788574264.734845:0:7444:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000020:00080000:1.0:1788574264.734848:0:15078:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9c85fad6a800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:0.0:1788574264.734850:0:7444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7800/0x5bf8706fdac8be8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5bf8706fdac8be96 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788574264.734853:0:15078:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9c85fa395000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:0.0:1788574264.734856:0:7444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d7800 already unused, calling callback (ffffffffc1472c20) 00000020:00080000:1.0:1788574264.734858:0:15078:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9c85fa1fd800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 10000000:00010000:0.0:1788574264.734859:0:7444:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7800/0x5bf8706fdac8be8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5bf8706fdac8be96 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574264.734865:0:7444:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7800/0x5bf8706fdac8be8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x5bf8706fdac8be96 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788574264.734866:0:15078:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9c85ffb14000 38a8b838-f1df-4bf7-be24-5141ce328dae 192.168.204.51@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788574264.734871:0:15078:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9c84c1bef000 659467ff-94af-418e-92fe-11e4323a48aa 192.168.204.51@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967523 stale:0 10000000:00010000:0.0:1788574264.734872:0:7444:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7800/0x5bf8706fdac8be8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x5bf8706fdac8be96 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788574264.734876:0:15078:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9c85de9d99c0) has exports, disconnecting them 10000000:01000000:0.0:1788574264.734877:0:7444:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1788574264.734879:0:7444:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00000020:00080000:1.0:1788574264.734881:0:15078:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c84c3021800), last request at 1788574262 10000000:01000000:0.0:1788574264.734882:0:7444:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00000020:00000080:1.0:1788574264.734889:0:15078:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8bdfc 00010000:00010000:0.0:1788574264.734902:0:7444:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7800/0x5bf8706fdac8be8f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5bf8706fdac8be96 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574264.734907:0:7444:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00080000:1.0:1788574264.734918:0:15078:0:(import.c:65:import_set_state_nolock()) ffff9c84c3025800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1788574264.734922:0:7444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7800/0x5bf8706fdac8be8f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5bf8706fdac8be96 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574264.734928:0:7444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7800/0x5bf8706fdac8be8f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5bf8706fdac8be96 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574264.734936:0:7444:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788574264.734939:0:7444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7a00/0x5bf8706fdac8c1e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5bf8706fdac8c1ec expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574264.734945:0:7444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d7a00 already unused, calling callback (ffffffffc1472c20) 10000000:00010000:0.0:1788574264.734948:0:7444:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7a00/0x5bf8706fdac8c1e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5bf8706fdac8c1ec expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574264.734953:0:7444:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7a00/0x5bf8706fdac8c1e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x5bf8706fdac8c1ec expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788574264.734959:0:7444:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7a00/0x5bf8706fdac8c1e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x5bf8706fdac8c1ec expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788574264.734962:0:15078:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c84c3021800): rc 0 10000000:01000000:0.0:1788574264.734964:0:7444:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000020:00000080:1.0:1788574264.734965:0:15078:0:(genops.c:885:class_export_put()) final put ffff9c84c3021800/lustre-MDT0000-lwp-OST0001_UUID 10000000:01000000:0.0:1788574264.734966:0:7444:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788574264.734968:0:7444:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000020:00080000:1.0:1788574264.734980:0:15078:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c85fad6a800), last request at 1788574262 00010000:00010000:0.0:1788574264.734980:0:7444:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7a00/0x5bf8706fdac8c1e5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5bf8706fdac8c1ec expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1788574264.734984:0:15078:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8bcd6 00010000:00010000:0.0:1788574264.734985:0:7444:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00080000:1.0:1788574264.734989:0:15078:0:(import.c:65:import_set_state_nolock()) ffff9c85fad6f800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1788574264.734991:0:7444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7a00/0x5bf8706fdac8c1e5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5bf8706fdac8c1ec expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788574264.734997:0:15078:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c85fad6a800): rc 0 00000020:00000080:1.0:1788574264.734999:0:15078:0:(genops.c:885:class_export_put()) final put ffff9c85fad6a800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:1.0:1788574264.735003:0:15078:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c85fa395000), last request at 1788574013 00010000:00010000:0.0:1788574264.735003:0:7444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7a00/0x5bf8706fdac8c1e5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5bf8706fdac8c1ec expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1788574264.735005:0:15078:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8bbd3 00000100:00080000:1.0:1788574264.735008:0:15078:0:(import.c:65:import_set_state_nolock()) ffff9c85fa396800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1788574264.735011:0:7444:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000020:00080000:1.0:1788574264.735013:0:15078:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c85fa395000): rc 0 00000020:00000080:1.0:1788574264.735015:0:15078:0:(genops.c:885:class_export_put()) final put ffff9c85fa395000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:1.0:1788574264.735018:0:15078:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c85fa1fd800), last request at 1788574013 00000020:00000080:1.0:1788574264.735021:0:15078:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8bba2 00000100:00080000:1.0:1788574264.735024:0:15078:0:(import.c:65:import_set_state_nolock()) ffff9c85f6f45800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1788574264.735026:0:7444:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7600/0x5bf8706fdac8ba4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5bf8706fdac8ba52 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:1.0:1788574264.735031:0:15078:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967529 00010000:00010000:0.0:1788574264.735031:0:7444:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d7600 already unused, calling callback (ffffffffc1472c20) 10000000:00010000:0.0:1788574264.735034:0:7444:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7600/0x5bf8706fdac8ba4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5bf8706fdac8ba52 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574264.735040:0:7444:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7600/0x5bf8706fdac8ba4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x5bf8706fdac8ba52 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788574264.735045:0:7444:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7600/0x5bf8706fdac8ba4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x5bf8706fdac8ba52 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788574264.735049:0:7444:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1788574264.735051:0:7444:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1788574264.735053:0:7444:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1788574264.735066:0:7444:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7600/0x5bf8706fdac8ba4b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5bf8706fdac8ba52 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574264.735072:0:7444:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788574264.735077:0:7444:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7600/0x5bf8706fdac8ba4b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5bf8706fdac8ba52 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574264.735082:0:7444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7600/0x5bf8706fdac8ba4b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5bf8706fdac8ba52 expref: -99 pid: 6469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574264.735099:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574264.735101:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1788574264.735102:0:15078:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c85fa1fd800): rc 0 00010000:00010000:0.0:1788574264.735103:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000080:1.0:1788574264.735108:0:15078:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb4d281cbbae0 00000100:00100000:0.0:1788574264.735120:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:69505170-06bc-41d1-9626-ab1a3c7f32a0:3617:1875455681666688:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1788574264.735125:0:15078:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788574264.735128:0:15078:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00000100:00100000:0.0:1788574264.735205:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574264.735253:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788574264.735259:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:69505170-06bc-41d1-9626-ab1a3c7f32a0:3617:1875455681666304:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788574264.735296:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574264.735320:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69505170-06bc-41d1-9626-ab1a3c7f32a0:3619:1875455681666432:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788574264.735343:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574264.735356:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788574264.735360:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69505170-06bc-41d1-9626-ab1a3c7f32a0:3619:1875455681666560:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1788574264.735889:0:15078:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1788574264.735905:0:15078:0:(import.c:65:import_set_state_nolock()) ffff9c85fad6c800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788574264.735907:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574264.735949:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681666688 00000100:00100000:0.0:1788574264.735955:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681666688 00000100:00100000:0.0:1788574264.735997:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681666304 00000100:00100000:0.0:1788574264.736000:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681666304 00000100:00100000:0.0:1788574264.736011:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681666432 00000100:00100000:0.0:1788574264.736065:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681666432 00000100:00100000:0.0:1788574264.736082:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681666560 00000100:00100000:0.0:1788574264.736085:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681666560 00000100:00100000:0.0:1788574264.736101:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788574264.736109:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:69505170-06bc-41d1-9626-ab1a3c7f32a0+26:3617:x1875455681666688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788574264.736122:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574264.736138:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85c152e200/0x5bf8706fdac8ba52 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5bf8706fdac8ba4b expref: 26 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574264.736166:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574264.736222:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:69505170-06bc-41d1-9626-ab1a3c7f32a0+25:3617:x1875455681666688:12345-0@lo:103:ldlm_bl.0 Request processed in 113us (1033us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574264.736230:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788574264.736247:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788574264.736253:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:69505170-06bc-41d1-9626-ab1a3c7f32a0+24:3617:x1875455681666304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788574264.736262:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574264.736270:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c860204a000/0x5bf8706fdac8bf92 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5bf8706fdac8bf8b expref: 24 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574264.736280:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574264.736301:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:69505170-06bc-41d1-9626-ab1a3c7f32a0+23:3617:x1875455681666304:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (1005us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574264.736306:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788574264.736318:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788574264.736323:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:69505170-06bc-41d1-9626-ab1a3c7f32a0+22:3619:x1875455681666432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788574264.736329:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574264.736337:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85c152ea00/0x5bf8706fdac8be96 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5bf8706fdac8be8f expref: 22 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574264.736344:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574264.736488:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:69505170-06bc-41d1-9626-ab1a3c7f32a0+21:3619:x1875455681666432:12345-0@lo:103:ldlm_bl.0 Request processed in 164us (1143us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574264.736494:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788574264.736651:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788574264.736658:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:69505170-06bc-41d1-9626-ab1a3c7f32a0+20:3619:x1875455681666560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788574264.736673:0:6478:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574264.736682:0:6478:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c84c2616600/0x5bf8706fdac8c1ec lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5bf8706fdac8c1e5 expref: 20 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574264.736691:0:6478:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574264.736716:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:69505170-06bc-41d1-9626-ab1a3c7f32a0+19:3619:x1875455681666560:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (808us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574264.736722:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000020:00000080:0.0:1788574264.736748:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c84c3021800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1788574264.736795:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85fad6a800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1788574264.736815:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85fa395000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1788574264.736854:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c84c3025800 for lustre-MDT0000 00000020:00000080:0.0:1788574264.736860:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c85fad6f800 for lustre-MDT0000 00000020:00000080:0.0:1788574264.736864:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c85fa396800 for lustre-MDT0000 00000100:00100000:0.0:1788574264.736899:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69505170-06bc-41d1-9626-ab1a3c7f32a0:3619:1875455681666560:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788574264.736908:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69505170-06bc-41d1-9626-ab1a3c7f32a0:3619:1875455681666432:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788574264.736937:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:69505170-06bc-41d1-9626-ab1a3c7f32a0:3617:1875455681666304:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788574264.736945:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:69505170-06bc-41d1-9626-ab1a3c7f32a0:3617:1875455681666688:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788574264.737110:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788574264.737690:0:15078:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788574264.737697:0:15078:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967326 gen 3 00000004:00080000:1.0:1788574264.737719:0:15078:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788574264.737778:0:15078:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1788574264.737799:0:15078:0:(import.c:65:import_set_state_nolock()) ffff9c85ffa64800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1788574264.737810:0:15078:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788574264.737812:0:15078:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:1.0:1788574264.737836:0:15078:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788574264.737903:0:15078:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1788574264.737915:0:15078:0:(import.c:65:import_set_state_nolock()) ffff9c85ffa60000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1788574264.737941:0:15078:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9c85de9d99c0) has no exports 00010000:00010000:3.0:1788574264.738767:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574264.738792:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875455681666816:0@lo:39:umount.0 00000100:00100000:3.0:1788574264.738872:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574264.738899:0:7533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681666816 00000100:00100000:0.0:1788574264.738907:0:7533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681666816 00000100:00100000:0.0:1788574264.738954:0:7533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1788574264.738963:0:7533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1875455681666816:12345-0@lo:39:umount.0 00000020:00000080:0.0:1788574264.738992:0:7533:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8bc2e 00000100:00080000:0.0:1788574264.739000:0:7533:0:(import.c:65:import_set_state_nolock()) ffff9c85fac6e000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788574264.739032:0:7533:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:0.0:1788574264.739176:0:7533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+3:3616:x1875455681666816:12345-0@lo:39:umount.0 Request processed in 214us (303us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788574264.739183:0:7533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00010000:00010000:0.0:1788574264.739231:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788574264.741238:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c85fad6c800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788574264.741253:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875455681666816:0@lo:39:umount.0 00000100:00100000:3.0:1788574264.741265:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875455681666944:0@lo:9:umount.0 00000100:00100000:3.0:1788574264.741323:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574264.741363:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875455681667072:0@lo:9:umount.0 00000100:00100000:3.0:1788574264.741387:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574264.741499:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681666944 00000100:00100000:2.0:1788574264.741506:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681666944 00000100:00100000:2.0:1788574264.741563:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681667072 00000100:00100000:2.0:1788574264.741567:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681667072 00000100:00100000:2.0:1788574264.741592:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788574264.741602:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1875455681666944:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788574264.741627:0:8411:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8bd7e 00000100:00080000:2.0:1788574264.741636:0:8411:0:(import.c:65:import_set_state_nolock()) ffff9c84c1bee000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788574264.741677:0:8411:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967326 00000100:00100000:2.0:1788574264.741809:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3616:x1875455681666944:12345-0@lo:9:umount.0 Request processed in 208us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574264.741817:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788574264.741844:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788574264.741852:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1875455681667072:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788574264.741864:0:8411:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8bec0 00000100:00080000:2.0:1788574264.741870:0:8411:0:(import.c:65:import_set_state_nolock()) ffff9c84c369a000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788574264.741894:0:8411:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:2.0:1788574264.741961:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3616:x1875455681667072:12345-0@lo:9:umount.0 Request processed in 110us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574264.741967:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:00010000:2.0:1788574264.741992:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788574264.742458:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788574264.742463:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788574264.742491:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c85ffa64800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788574264.742509:0:3616:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788574264.742511:0:3616:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788574264.742514:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875455681666944:0@lo:9:umount.0 00000100:00080000:3.0:1788574264.742527:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c85ffa60000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788574264.742542:0:3616:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788574264.742544:0:3616:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788574264.742547:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875455681667072:0@lo:9:umount.0 00010000:00010000:3.0:1788574264.742575:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1788574264.756461:0:15078:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9c85de9d99c0) has no exports 00000020:00000080:1.0:1788574264.794414:0:15078:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8baa6 00000020:00000080:1.0:1788574264.794431:0:15078:0:(genops.c:885:class_export_put()) final put ffff9c85e0a86000/lustre-QMT0000_UUID 00000020:01000000:1.0:1788574264.794454:0:15078:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1788574264.794485:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85e0a86000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1788574264.794542:0:15078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788574264.794552:0:15078:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788574264.794556:0:15078:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9c85fa0bb380) has no exports 00000020:00000080:0.0:1788574264.794859:0:15078:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8ba9f 00000020:00000080:0.0:1788574264.794865:0:15078:0:(genops.c:885:class_export_put()) final put ffff9c85de958800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788574264.794925:0:15078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788574264.794931:0:15078:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788574264.794934:0:15078:0:(genops.c:885:class_export_put()) final put ffff9c85d20ad800/lustre-QMT0000_UUID 00000020:00000080:0.0:1788574264.794935:0:15078:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85d20ad800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1788574264.794938:0:15078:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:1.0:1788574264.795177:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85de958800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:0.0:1788574264.982260:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574264.982456:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681667200:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788574264.982527:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574264.982701:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681667200 00000100:00100000:2.0:1788574264.982710:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681667200 00000100:00100000:2.0:1788574264.982766:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1788574264.982774:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3618:x1875455681667200:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:2.0:1788574264.982798:0:6497:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788574264.982855:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3618:x1875455681667200:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (328us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788574264.982863:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:02020000:3.0:1788574264.983093:0:3618:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:3.0:1788574264.991109:0:3618:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788574264.991118:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9c85f6dec000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788574264.991139:0:3618:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788574264.998361:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9c85f6dec000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788574264.998385:0:3618:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 153 00000100:00080000:3.0:1788574264.998396:0:3618:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9c85f6dec000 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:3.0:1788574264.998469:0:3618:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c84c3c09f80 x1875455681667328/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788574264.998624:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1875455681667328:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1788574264.998697:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574264.999447:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681667328 00000100:00100000:1.0:1788574264.999458:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681667328 00000100:00100000:1.0:1788574265.002265:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1788574265.002285:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3616:x1875455681667328:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:1.0:1788574265.002308:0:6498:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:0.0:1788574265.010228:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c85f6dec000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788574265.010236:0:3616:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788574265.010241:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1875455681667328:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1788574265.010251:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3616:x1875455681667328:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 7825us (11404us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788574265.010267:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00010000:00010000:2.0:1788574266.004904:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788574266.012831:0:6471:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788574266.012845:0:6471:0:(genops.c:885:class_export_put()) final put ffff9c85fa1fd800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1788574266.012878:0:6471:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 38a8b838-f1df-4bf7-be24-5141ce328dae 00000001:00080000:3.0:1788574266.012893:0:6471:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967529 is committed 00000020:00000080:3.0:1788574266.012897:0:6471:0:(genops.c:885:class_export_put()) final put ffff9c85ffb14000/38a8b838-f1df-4bf7-be24-5141ce328dae 00000001:00100000:3.0:1788574266.012905:0:6471:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 659467ff-94af-418e-92fe-11e4323a48aa 00000001:00080000:3.0:1788574266.012911:0:6471:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:3.0:1788574266.012926:0:6471:0:(genops.c:885:class_export_put()) final put ffff9c84c1bef000/659467ff-94af-418e-92fe-11e4323a48aa 00000020:00000080:1.0:1788574266.012962:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85fa1fd800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:1.0:1788574266.013037:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85ffb14000/38a8b838-f1df-4bf7-be24-5141ce328dae for lustre-MDT0000 00000020:00000080:1.0:1788574266.013065:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c84c1bef000/659467ff-94af-418e-92fe-11e4323a48aa for lustre-MDT0000 00000020:00000080:1.0:1788574266.013103:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c85f6f45800 for lustre-MDT0000 00000020:00000080:1.0:1788574266.013108:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c85ffb11800 for lustre-MDT0000 00000020:00000080:1.0:1788574266.013111:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c84c1be9800 for lustre-MDT0000 00000001:00100000:2.0:1788574266.013616:0:8404:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788574266.013622:0:8404:0:(genops.c:885:class_export_put()) final put ffff9c84c1beb800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1788574266.013656:0:8404:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 659467ff-94af-418e-92fe-11e4323a48aa 00000020:00000080:2.0:1788574266.013659:0:8404:0:(genops.c:885:class_export_put()) final put ffff9c85ffb5e000/659467ff-94af-418e-92fe-11e4323a48aa 00000020:00000080:0.0:1788574266.013832:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c84c1beb800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1788574266.013863:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85ffb5e000/659467ff-94af-418e-92fe-11e4323a48aa for lustre-OST0000 00000020:00000080:0.0:1788574266.013884:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c84c1bee000 for lustre-OST0000 00000020:00000080:0.0:1788574266.013888:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c85ffb5b800 for lustre-OST0000 00000001:00100000:1.0:1788574266.013984:0:9487:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788574266.013989:0:9487:0:(genops.c:885:class_export_put()) final put ffff9c84c3698800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1788574266.014011:0:9487:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 659467ff-94af-418e-92fe-11e4323a48aa 00000020:00000080:1.0:1788574266.014014:0:9487:0:(genops.c:885:class_export_put()) final put ffff9c85ffb64800/659467ff-94af-418e-92fe-11e4323a48aa 00000020:00000080:3.0:1788574266.014181:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c84c3698800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1788574266.014238:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85ffb64800/659467ff-94af-418e-92fe-11e4323a48aa for lustre-OST0001 00000020:00000080:3.0:1788574266.014256:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c84c369a000 for lustre-OST0001 00000020:00000080:3.0:1788574266.014261:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c85ffb67800 for lustre-OST0001 00000001:00100000:1.0:1788574266.017900:0:7422:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1788574266.017922:0:7422:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:1.0:1788574266.017947:0:7422:0:(genops.c:885:class_export_put()) final put ffff9c85fa394000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1788574266.017976:0:7422:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 38a8b838-f1df-4bf7-be24-5141ce328dae 00000001:00080000:1.0:1788574266.017982:0:7422:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:1.0:1788574266.017984:0:7422:0:(genops.c:885:class_export_put()) final put ffff9c85ffb1f000/38a8b838-f1df-4bf7-be24-5141ce328dae 00000001:00100000:1.0:1788574266.017989:0:7422:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 659467ff-94af-418e-92fe-11e4323a48aa 00000001:00080000:1.0:1788574266.017993:0:7422:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:1.0:1788574266.017995:0:7422:0:(genops.c:885:class_export_put()) final put ffff9c85ffa67000/659467ff-94af-418e-92fe-11e4323a48aa 00000020:00000080:2.0:1788574266.018471:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85fa394000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:2.0:1788574266.019758:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85ffb1f000/38a8b838-f1df-4bf7-be24-5141ce328dae for lustre-MDT0001 00000020:00000080:2.0:1788574266.020524:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85ffa67000/659467ff-94af-418e-92fe-11e4323a48aa for lustre-MDT0001 00000020:00000080:2.0:1788574266.020584:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c85fac6e000 for lustre-MDT0001 00000020:00000080:2.0:1788574266.020590:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c85ffb1c800 for lustre-MDT0001 00000020:00000080:2.0:1788574266.020594:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c85faf2e000 for lustre-MDT0001 00000100:00100000:1.0:1788574266.516488:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788574266.518579:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681667456:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788574266.518945:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574266.519143:0:8413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681667456 00000100:00100000:3.0:1788574266.519152:0:8413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681667456 00000100:00100000:3.0:1788574266.519245:0:8413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788574266.519255:0:8413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c335ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681667456:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788574266.519287:0:8413:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00080000:0.0:1788574266.519434:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788574266.519476:0:8413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c335ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681667456:12345-0@lo:13:osp-pre-0-1.0 Request processed in 222us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574266.519484:0:8413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788574266.519606:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681667456:0@lo:13:osp-pre-0-1.0 00000020:01000000:2.0:1788574266.839538:0:15078:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c85c8b32e40 - data ffff9c84c1cdf510/ffff9c84c25fd800 00000020:01000000:2.0:1788574266.839708:0:15078:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c85de99bcc0 - data ffff9c85dedb2948/ffff9c85fa024400 00000001:00000004:2.0:1788574266.854270:0:15078:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967529 00000100:00080000:1.0:1788574266.930320:0:15078:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788574266.930340:0:15078:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:1.0:1788574266.930363:0:15078:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9c84c335d180 x1875455681666816/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788574274 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574266.930392:0:15078:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1788574266.934592:0:15078:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788574266.934609:0:15078:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967326 gen 4 00000004:00080000:1.0:1788574266.934625:0:15078:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788574266.934628:0:15078:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788574266.935418:0:8810:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788574266.935424:0:8810:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:2.0:1788574266.935438:0:8810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:1.0:1788574266.936027:0:15078:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788574266.936033:0:15078:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:1.0:1788574266.936054:0:15078:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788574266.936056:0:15078:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788574266.936692:0:9902:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788574266.936699:0:9902:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:3.0:1788574266.936712:0:9902:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1788574266.938315:0:15078:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8ba6e 00000020:00000080:1.0:1788574266.938327:0:15078:0:(genops.c:885:class_export_put()) final put ffff9c85de9d3000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788574266.939084:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85de9d3000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788574266.940962:0:15078:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8ba83 00000020:00000080:1.0:1788574266.940974:0:15078:0:(genops.c:885:class_export_put()) final put ffff9c85de9d2800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788574266.941018:0:15078:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1788574266.941031:0:15078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788574266.941039:0:15078:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788574266.941044:0:15078:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9c85de9dcd40) has no exports 00000004:01000000:1.0:1788574266.941246:0:15078:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788574266.941256:0:15078:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8beb9 00000020:00000080:1.0:1788574266.941261:0:15078:0:(genops.c:885:class_export_put()) final put ffff9c84c369e000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788574266.941334:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85de9d2800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1788574266.941395:0:15078:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788574266.941399:0:15078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788574266.941413:0:15078:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788574266.941416:0:15078:0:(genops.c:1558:class_disconnect_exports()) OBD device 28 (ffff9c84c3038000) has no exports 00000020:00000080:1.0:1788574266.941439:0:15078:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8beb2 00000020:00000080:1.0:1788574266.941444:0:15078:0:(genops.c:885:class_export_put()) final put ffff9c85ffa64000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788574266.941479:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c84c369e000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:1.0:1788574266.945324:0:15078:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788574266.945334:0:15078:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788574266.945339:0:15078:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:1.0:1788574266.945348:0:15078:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788574266.945351:0:15078:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788574266.945425:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85ffa64000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788574266.945508:0:15078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788574266.945525:0:15078:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788574266.945537:0:15078:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8bd77 00000020:00000080:1.0:1788574266.945546:0:15078:0:(genops.c:885:class_export_put()) final put ffff9c85fadd7000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788574266.945550:0:15078:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788574266.945555:0:15078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788574266.945560:0:15078:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788574266.945564:0:15078:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff9c85faf499c0) has no exports 00000020:00000080:1.0:1788574266.945572:0:15078:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8bd70 00000020:00000080:1.0:1788574266.945576:0:15078:0:(genops.c:885:class_export_put()) final put ffff9c85fad6e800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788574266.945727:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c85ffa60000 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788574266.945736:0:36:0:(genops.c:885:class_export_put()) final put ffff9c85fadd1800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788574266.945738:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85fadd1800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1788574266.945743:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788574266.945833:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85fadd7000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788574266.945838:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85fad6e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1788574266.945976:0:15078:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788574266.945978:0:15078:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788574266.945980:0:15078:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967326 gen 5 00000004:00080000:1.0:1788574266.945983:0:15078:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788574266.945984:0:15078:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788574266.946022:0:15078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788574266.946024:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c85ffa64800 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788574266.946028:0:15078:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788574266.946031:0:15078:0:(genops.c:885:class_export_put()) final put ffff9c85fae32000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788574266.946034:0:15078:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85fae32000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1788574266.946039:0:15078:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1788574266.946097:0:15078:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1788574266.946104:0:15078:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8bc27 00000020:00000080:1.0:1788574266.946108:0:15078:0:(genops.c:885:class_export_put()) final put ffff9c85fad3e000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788574266.946122:0:15078:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1788574266.946126:0:15078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788574266.946131:0:15078:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788574266.946133:0:15078:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9c8600d58000) has no exports 00000020:00000080:1.0:1788574266.946137:0:15078:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8bc20 00000020:00000080:1.0:1788574266.946140:0:15078:0:(genops.c:885:class_export_put()) final put ffff9c85fad6c000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788574266.946141:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85fad3e000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1788574266.946157:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85fad6c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1788574266.955771:0:15078:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:1.0:1788574266.955791:0:15078:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788574266.955796:0:15078:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:1.0:1788574266.955806:0:15078:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788574266.955871:0:15078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788574266.955886:0:15078:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788574266.955918:0:15078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788574266.955921:0:15078:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788574266.955926:0:15078:0:(genops.c:885:class_export_put()) final put ffff9c85de9d1800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788574266.955931:0:15078:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85de9d1800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1788574266.955938:0:15078:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788574266.956054:0:15078:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8ba8a 00000020:00000080:1.0:1788574266.956062:0:15078:0:(genops.c:885:class_export_put()) final put ffff9c85de9d6800/lustre-MDD0000_UUID 00000020:01000000:1.0:1788574266.956067:0:15078:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1788574266.956072:0:15078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788574266.956077:0:15078:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788574266.956081:0:15078:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9c85de9d8000) has no exports 00000020:00000080:1.0:1788574266.956110:0:15078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788574266.956113:0:15078:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1788574266.956117:0:15078:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8ba91 00000020:00000080:1.0:1788574266.956121:0:15078:0:(genops.c:885:class_export_put()) final put ffff9c85de9d2000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788574266.956129:0:15078:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c85c2bfb800 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1788574266.956132:0:15078:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c85c2bfb800 3 00000020:01000004:1.0:1788574266.956135:0:15078:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c85c2bfb800 from lustre-MDT0000 00000020:00000080:1.0:1788574266.956152:0:15078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788574266.956155:0:15078:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1788574266.956157:0:15078:0:(genops.c:885:class_export_put()) final put ffff9c85de9d7000/lustre-MDT0000_UUID 00000020:00000080:1.0:1788574266.956159:0:15078:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85de9d7000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1788574266.956166:0:15078:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1788574266.956216:0:15078:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:1.0:1788574266.956221:0:15078:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1788574266.956224:0:15078:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1788574266.956227:0:15078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788574266.956230:0:15078:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788574266.956237:0:15078:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9c85e0a85000 69505170-06bc-41d1-9626-ab1a3c7f32a0 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788574266.956242:0:15078:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9c85d00c0000) has exports, disconnecting them 00000020:00080000:1.0:1788574266.956246:0:15078:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9c85e0a85000), last request at 1788573996 00000020:00000080:1.0:1788574266.956260:0:15078:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8ba2f 00000020:00000080:2.0:1788574266.956262:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c85fad6c800 for lustre-MDT0001-osp-MDT0000 00000020:00010000:1.0:1788574266.956264:0:15078:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9c85e0a85000: total 2 00000100:00080000:1.0:1788574266.956268:0:15078:0:(import.c:65:import_set_state_nolock()) ffff9c85e0a83800 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1788574266.956269:0:8:0:(genops.c:885:class_export_put()) final put ffff9c8600d48000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788574266.956271:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c8600d48000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:2.0:1788574266.956275:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00080000:1.0:1788574266.956285:0:15078:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c85e0a85000): rc 0 00000020:00080000:1.0:1788574266.956289:0:15078:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9c85d00c0000) has no exports 00000020:00000080:2.0:1788574266.956327:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85de9d6800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1788574266.956331:0:8:0:(genops.c:885:class_export_put()) final put ffff9c85de9d5000/lustre-MDD0000_UUID 00000020:00000080:2.0:1788574266.956338:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85de9d5000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1788574266.956343:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1788574266.956370:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85de9d2000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:2.0:1788574266.956413:0:6487:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9c85d506b800:6487] 2 exiting: rc = 0 00000100:00100000:3.0:1788574266.956515:0:6486:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9c8600247800:6486] 1 exiting: rc = 0 00000020:00010000:3.0:1788574266.956599:0:6481:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9c85e0a85000: total 0 00010000:00010000:3.0:1788574266.956639:0:6481:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9c85e0a85000, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1788574266.956672:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c860217ea00/0x5bf8706fdac8bb39 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5bf8706fdac8bb32 expref: 14 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574266.956697:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85faea3400/0x5bf8706fdac8c1c2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5bf8706fdac8c1bb expref: 13 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574266.956708:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c84c2617c00/0x5bf8706fdac8c1d0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5bf8706fdac8c1c9 expref: 12 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574266.956792:0:6485:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9c85ec292800:6485] 0 exiting: rc = 1 00000100:00100000:1.0:1788574266.956832:0:15078:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574266.956841:0:15078:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574266.956847:0:15078:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574266.956853:0:15078:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574266.956858:0:15078:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574266.956866:0:15078:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574266.956873:0:15078:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1788574266.956879:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85c152fc00/0x5bf8706fdac8bb2b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5bf8706fdac8bb24 expref: 11 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574266.956884:0:15078:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574266.956890:0:15078:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1788574266.956893:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85c152fe00/0x5bf8706fdac8be50 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5bf8706fdac8be49 expref: 10 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574266.956898:0:15078:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1788574266.956905:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c860204b000/0x5bf8706fdac8bfa0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5bf8706fdac8bf99 expref: 9 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574266.956905:0:15078:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574266.956911:0:15078:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1788574266.956916:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c860204ac00/0x5bf8706fdac8bf30 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5bf8706fdac8bf29 expref: 8 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574266.956918:0:15078:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574266.956923:0:15078:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1788574266.956927:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c84c2616c00/0x5bf8706fdac8c1de lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5bf8706fdac8c1d7 expref: 7 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574266.956930:0:15078:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574266.956935:0:15078:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1788574266.956939:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c860217e400/0x5bf8706fdac8bf3e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5bf8706fdac8bf37 expref: 6 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574266.956941:0:15078:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574266.956946:0:15078:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1788574266.956949:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c860217ec00/0x5bf8706fdac8bf4c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5bf8706fdac8bf45 expref: 5 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574266.956952:0:15078:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1788574266.956959:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c860204a200/0x5bf8706fdac8bf5a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5bf8706fdac8bf53 expref: 4 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574266.956959:0:15078:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574266.956966:0:15078:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1788574266.956968:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c860217fe00/0x5bf8706fdac8bf68 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5bf8706fdac8bf61 expref: 3 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574266.956972:0:15078:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1788574266.956978:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c860217e000/0x5bf8706fdac8bf76 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5bf8706fdac8bf6f expref: 2 pid: 6486 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574266.956979:0:15078:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574266.956985:0:15078:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574266.956991:0:15078:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574266.956997:0:15078:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1788574266.956998:0:6481:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9c85e0a85000, canceled 13 locks, left on hash table 0. 00000100:00100000:1.0:1788574266.957004:0:15078:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574266.957010:0:15078:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788574266.957012:0:6481:0:(genops.c:885:class_export_put()) final put ffff9c85e0a85000/69505170-06bc-41d1-9626-ab1a3c7f32a0 00000100:00100000:1.0:1788574266.957017:0:15078:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574266.957025:0:15078:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1788574266.957029:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574266.957031:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574266.957031:0:15078:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1788574266.957033:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574266.957037:0:15078:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574266.957042:0:15078:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574266.957048:0:15078:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574266.957054:0:15078:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574266.957060:0:15078:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788574266.957065:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85e0a85000/69505170-06bc-41d1-9626-ab1a3c7f32a0 for MGS 00000100:00100000:1.0:1788574266.957065:0:15078:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574266.957071:0:15078:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574266.957076:0:15078:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574266.957082:0:15078:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574266.957091:0:15078:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574266.957097:0:15078:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788574266.957099:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c85e0a83800 for MGS 00000100:00100000:1.0:1788574266.957110:0:15078:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574266.957116:0:15078:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574266.957122:0:15078:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574266.957128:0:15078:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574266.957134:0:15078:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574266.957140:0:15078:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574266.957146:0:15078:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574266.957152:0:15078:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574266.957158:0:15078:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574266.957163:0:15078:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574266.957169:0:15078:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574266.957175:0:15078:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574266.957181:0:15078:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574266.957185:0:15078:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574266.957212:0:15078:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574266.957219:0:15078:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574266.957225:0:15078:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574266.957232:0:15078:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574266.957239:0:15078:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574266.957247:0:15078:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574266.957254:0:15078:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574266.957262:0:15078:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:1.0:1788574266.958022:0:15078:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c84c33b0420 - data ffff9c85def55510/ffff9c84c3037000 00000020:01000000:1.0:1788574266.958167:0:15078:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c85c88bb000 - data ffff9c85c96b9d80/ffff9c860020ac00 00000020:00000080:1.0:1788574266.958751:0:15078:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8ba13 00000020:00000080:1.0:1788574266.958760:0:15078:0:(genops.c:885:class_export_put()) final put ffff9c85c8a31800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788574266.958770:0:15078:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c85c2bfb800 from MGS, refs=2 00000020:01000004:1.0:1788574266.958774:0:15078:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c85c2bfb800 2 00000020:01000004:1.0:1788574266.958788:0:15078:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c85c2bfb800 from MGS 00000020:00000080:3.0:1788574266.958797:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85c8a31800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788574266.958810:0:15078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788574266.958816:0:15078:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1788574266.958819:0:15078:0:(genops.c:885:class_export_put()) final put ffff9c85c8a33800/MGS 00000020:00000080:1.0:1788574266.958821:0:15078:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85c8a33800/MGS for MGS 00000020:01000000:1.0:1788574266.958827:0:15078:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1788574266.958904:0:15078:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1788574266.958908:0:15078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788574266.958914:0:15078:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788574266.958919:0:15078:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9c85c8a34000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788574266.958924:0:15078:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff9c85d00c4d40) has exports, disconnecting them 00000020:00080000:1.0:1788574266.958928:0:15078:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9c85c8a34000), last request at 1788573996 00000020:00000080:1.0:1788574266.958932:0:15078:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8bade 00000020:00080000:1.0:1788574266.958943:0:15078:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c85c8a34000): rc 0 00000020:00000080:1.0:1788574266.958947:0:15078:0:(genops.c:885:class_export_put()) final put ffff9c85c8a34000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788574266.959225:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85c8a34000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1788574266.966898:0:15078:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1788574266.966910:0:15078:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788574266.966914:0:15078:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788574266.966923:0:15078:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788574266.967006:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c85fa1f8000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788574266.967114:0:15078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788574266.967122:0:15078:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1788574266.967128:0:15078:0:(genops.c:885:class_export_put()) final put ffff9c85fa1fa000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1788574266.967131:0:15078:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85fa1fa000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1788574266.967141:0:15078:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1788574266.967246:0:15078:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c85c2bfb800 1 00000020:00000080:1.0:1788574266.967253:0:15078:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8ba05 00000020:00000080:1.0:1788574266.967262:0:15078:0:(genops.c:885:class_export_put()) final put ffff9c85c8a34800/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1788574266.967277:0:15078:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1788574266.967281:0:15078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788574266.967285:0:15078:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788574266.967289:0:15078:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9c85d00c19c0) has no exports 00000020:00000080:3.0:1788574266.967572:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85c8a34800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788574267.016091:0:15078:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788574267.016170:0:15078:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1788574267.016177:0:15078:0:(genops.c:885:class_export_put()) final put ffff9c85c2bf8800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788574267.016183:0:15078:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85c2bf8800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1788574267.016226:0:15078:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1788574267.016431:0:15078:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9c85c2bfe800 00000020:02000400:3.0:1788574267.017132:0:15078:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1788574267.036507:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788574267.541364:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788574267.541371:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788574267.541375:0:8:0:(import.c:65:import_set_state_nolock()) ffff9c85f6dec000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788574267.541383:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 404 00000100:00080000:2.0:1788574267.541389:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788574267.541396:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9c85f6dec000 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:2.0:1788574267.541418:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c85c2f44a80 x1875455681667712/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788574267.541503:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c2f45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1875455681668096:0@lo:400:kworker.0 00000100:00100000:2.0:1788574267.541577:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574267.541821:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c2f45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681668608:0@lo:400:kworker.0 00000100:00100000:2.0:1788574267.541956:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574267.541993:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788574267.541999:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c2f46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69505170-06bc-41d1-9626-ab1a3c7f32a0:3619:1875455681667584:0@lo:400:kworker.0 00000400:00000100:2.0:1788574267.542021:0:3619:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875455681667584 offset 0 length 224: 4 00000100:00100000:2.0:1788574267.542041:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c2f44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681668224:0@lo:400:kworker.0 00000100:00100000:2.0:1788574267.542061:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574267.542089:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c2f44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1875455681667712:0@lo:38:kworker.0 00000100:00100000:2.0:1788574267.542126:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574267.542158:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c2f44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875455681667840:0@lo:400:kworker.0 00000100:00100000:2.0:1788574267.542184:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574267.542366:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681668608 00000100:00100000:0.0:1788574267.542375:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681668608 00000100:00100000:0.0:1788574267.542427:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681668224 00000100:00100000:0.0:1788574267.542437:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681668224 00000100:00100000:0.0:1788574267.542465:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788574267.542474:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2f45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681668608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574267.542529:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2f45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681668608:12345-0@lo:400:kworker.0 Request processed in 55us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574267.542536:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788574267.542551:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788574267.542557:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2f44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681668224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574267.542585:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2f44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681668224:12345-0@lo:400:kworker.0 Request processed in 28us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574267.542591:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00080000:0.0:1788574267.542620:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788574267.543062:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c2f44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3617:1875455681668352:0@lo:400:kworker.0 00000100:00100000:2.0:1788574267.543094:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574267.543114:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788574267.543121:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c2f46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1875455681667968:0@lo:400:kworker.0 00000100:00100000:2.0:1788574267.543141:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574267.543168:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c2f46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1875455681668480:0@lo:400:kworker.0 00000100:00100000:2.0:1788574267.543212:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574267.543759:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681668096 00000100:00100000:2.0:1788574267.543775:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681668096 00000100:00100000:0.0:1788574267.547843:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681667840 00000100:00100000:0.0:1788574267.547860:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681667840 00000100:00100000:0.0:1788574267.547966:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681668352 00000100:00100000:0.0:1788574267.547970:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681668352 00000100:00100000:0.0:1788574267.547979:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681667968 00000100:00100000:0.0:1788574267.547982:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681667968 00000100:00100000:0.0:1788574267.547990:0:7439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681668480 00000100:00100000:0.0:1788574267.547992:0:7439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681668480 00000100:00100000:1.0:1788574267.548020:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:1.0:1788574267.549592:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2f47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875455681668096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574267.549702:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2f47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875455681668096:12345-0@lo:400:kworker.0 Request processed in 129us (8125us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574267.550021:0:7439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 401 00000100:00100000:2.0:1788574267.550346:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1788574267.550358:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00000100:00100000:2.0:1788574267.550359:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3720700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3617:x1875455681667840:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788574267.550369:0:6494:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788574267.550392:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1788574267.550399:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c300a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3617:x1875455681668352:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788574267.550405:0:6492:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788574267.550436:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3720700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3617:x1875455681667840:12345-0@lo:400:kworker.0 Request processed in 79us (8249us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788574267.550443:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1788574267.550459:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c300a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3617:x1875455681668352:12345-0@lo:400:kworker.0 Request processed in 57us (7361us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788574267.550463:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1788574267.550475:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788574267.550476:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c300b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3617:x1875455681667968:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788574267.550484:0:6494:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788574267.550512:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c300b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3617:x1875455681667968:12345-0@lo:400:kworker.0 Request processed in 39us (7370us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788574267.550514:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681668736:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788574267.550523:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788574267.550553:0:7533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681667712 00000100:00100000:2.0:1788574267.550561:0:7533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681667712 00000100:00100000:1.0:1788574267.550577:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574267.550605:0:7533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1788574267.550611:0:7533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2f47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3616:x1875455681667712:12345-0@lo:38:kworker.0 00000100:00080000:3.0:1788574267.550624:0:3617:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788574267.550631:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9c84c2274000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00010000:00020000:2.0:1788574267.550632:0:7533:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:02000400:3.0:1788574267.550640:0:3617:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:1.0:1788574267.550700:0:7439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3009500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875455681668480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574267.550738:0:7439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3009500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875455681668480:12345-0@lo:400:kworker.0 Request processed in 708us (7550us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574267.550745:0:7439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 401 00000100:00100000:2.0:1788574267.550812:0:7533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2f47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3616:x1875455681667712:12345-0@lo:38:kworker.0 Request processed in 200us (8684us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788574267.550819:0:7533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1788574267.550851:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681668736 00000100:00100000:2.0:1788574267.550855:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681668736 00000100:00100000:2.0:1788574267.550887:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788574267.550893:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c335d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681668736:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788574267.550914:0:8412:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788574267.550946:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c335d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681668736:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574267.550952:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00080000:2.0:1788574267.551034:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788574267.551056:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c85f6dec000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788574267.551060:0:3616:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788574267.551064:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c2f44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1875455681667712:0@lo:38:kworker.0 00000100:00100000:2.0:1788574267.551100:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681668736:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788574267.551126:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c2f44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681668224:0@lo:400:kworker.0 00010000:00080000:2.0:1788574267.551141:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9c85c2f45880 x1875455681668096/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574283 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574267.551152:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c2f45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1875455681668096:0@lo:400:kworker.0 00000100:00100000:2.0:1788574267.551162:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c2f45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681668608:0@lo:400:kworker.0 00000100:00080000:3.0:1788574267.559646:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9c84c2274000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788574267.559658:0:3617:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 172 00000100:00080000:3.0:1788574267.559669:0:3617:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c84c2274000 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:3.0:1788574267.559706:0:3617:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c84c3c09c00 x1875455681668864/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788574267.559780:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1875455681668864:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1788574267.559855:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574267.559938:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681668864 00000100:00100000:0.0:1788574267.559946:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681668864 00000100:00100000:0.0:1788574267.559991:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1788574267.559999:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3008000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1875455681668864:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:0.0:1788574267.560024:0:6492:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788574267.560086:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c2f46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1875455681667968:0@lo:400:kworker.0 00010000:00080000:3.0:1788574267.560122:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9c85c2f46300 x1875455681668480/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574283 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574267.560135:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c2f46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1875455681668480:0@lo:400:kworker.0 00000100:00080000:3.0:1788574267.560150:0:3617:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788574267.560153:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9c85fac6f000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788574267.560157:0:3617:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788574267.560160:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9c85fac6f000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788574267.560164:0:3617:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 153 00000100:00080000:3.0:1788574267.560168:0:3617:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9c85fac6f000 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:3.0:1788574267.560185:0:3617:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c84c3c0bb80 x1875455681668992/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788574267.560335:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875455681668992:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1788574267.560367:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574267.560455:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3008000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1875455681668864:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 455us (600us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788574267.560464:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1788574267.560488:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681668992 00000100:00100000:0.0:1788574267.560492:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681668992 00000100:00100000:0.0:1788574267.560513:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1788574267.560518:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c300bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1875455681668992:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:0.0:1788574267.560529:0:6492:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788574267.560560:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c300bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1875455681668992:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 40us (193us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788574267.560566:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1788574267.560614:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c2f44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875455681667840:0@lo:400:kworker.0 00000100:00080000:3.0:1788574267.560819:0:3617:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788574267.560823:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9c84c3022800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788574267.560827:0:3617:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788574267.560831:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9c84c3022800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788574267.560835:0:3617:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 194 00000100:00080000:3.0:1788574267.560840:0:3617:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c84c3022800 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:3.0:1788574267.560857:0:3617:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c84c3c0a680 x1875455681669120/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788574267.560870:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c2f44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3617:1875455681668352:0@lo:400:kworker.0 00000100:00080000:2.0:1788574267.560924:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c84c2274000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788574267.560929:0:3616:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788574267.560932:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1875455681668864:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1788574267.560948:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1875455681669120:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1788574267.560979:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788574267.561016:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c85fac6f000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788574267.561020:0:3616:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788574267.561023:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875455681668992:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1788574267.561026:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681669120 00000100:00100000:0.0:1788574267.561030:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681669120 00000100:00100000:0.0:1788574267.561062:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1788574267.561067:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c300a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3616:x1875455681669120:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:0.0:1788574267.561080:0:6493:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788574267.561120:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c300a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3616:x1875455681669120:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 51us (140us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788574267.561127:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:0.0:1788574267.561365:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c84c3022800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788574267.561370:0:3616:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788574267.561373:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1875455681669120:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:3.0:1788574268.072720:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574269.079011:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574270.112746:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788574270.999945:0:15280:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788574271.019722:0:15280:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:2.0:1788574271.019785:0:15280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85fa32f600/0x5bf8706fdac8bf61 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bf68 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574271.019803:0:15280:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85fa32f600/0x5bf8706fdac8bf61 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8bf68 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574271.019811:0:15280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85fa32f600/0x5bf8706fdac8bf61 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x5bf8706fdac8bf68 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574271.019818:0:15280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.151@tcp lock: ffff9c85fa32f600/0x5bf8706fdac8bf61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x5bf8706fdac8bf68 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574271.019867:0:15280:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788574271.019874:0:15280:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788574271.019909:0:15280:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788574271.019913:0:15280:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788574271.019919:0:15280:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788574271.019925:0:15280:0:(import.c:65:import_set_state_nolock()) ffff9c85fac6f000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1788574271.019930:0:15280:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788574271.019932:0:15280:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788574271.019934:0:15280:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788574271.022831:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788574271.022847:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c85fa32f600/0x5bf8706fdac8bf61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x5bf8706fdac8bf68 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574271.022859:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32f600 already unused, calling callback (ffffffffc1472c20) 10000000:00010000:3.0:1788574271.022863:0:6480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c85fa32f600/0x5bf8706fdac8bf61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x5bf8706fdac8bf68 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574271.022875:0:6480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c85fa32f600/0x5bf8706fdac8bf61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x5bf8706fdac8bf68 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788574271.022883:0:6480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c85fa32f600/0x5bf8706fdac8bf61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x5bf8706fdac8bf68 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788574271.022888:0:6480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788574271.022891:0:6480:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788574271.022894:0:6480:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788574271.022940:0:6480:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9c85fa32f600/0x5bf8706fdac8bf61 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x5bf8706fdac8bf68 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574271.022946:0:6480:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788574271.022979:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c85fa32f600/0x5bf8706fdac8bf61 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x5bf8706fdac8bf68 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574271.022988:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c85fa32f600/0x5bf8706fdac8bf61 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x5bf8706fdac8bf68 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574271.023012:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574271.023014:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574271.023016:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574271.024520:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:69505170-06bc-41d1-9626-ab1a3c7f32a0:3617:1875455681669248:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788574271.024596:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574271.026516:0:6478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681669248 00000100:00100000:1.0:1788574271.026532:0:6478:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681669248 00000100:00100000:1.0:1788574271.026593:0:6478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788574271.026601:0:6478:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e0bdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3617:x1875455681669248:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788574271.026610:0:6478:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788574271 with bad export cookie 6627170477389953583 00010000:00010000:3.0:1788574271.027471:0:15280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c860204a800/0x5bf8706fdac8bf6f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bf76 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574271.027499:0:15280:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c860204a800/0x5bf8706fdac8bf6f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8bf76 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574271.027508:0:15280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c860204a800/0x5bf8706fdac8bf6f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x5bf8706fdac8bf76 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574271.027518:0:15280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.151@tcp lock: ffff9c860204a800/0x5bf8706fdac8bf6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x5bf8706fdac8bf76 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574271.027550:0:15280:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788574271.027556:0:15280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6200/0x5bf8706fdac8be49 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8be50 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574271.027563:0:15280:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6200/0x5bf8706fdac8be49 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8be50 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574271.027569:0:15280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6200/0x5bf8706fdac8be49 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5bf8706fdac8be50 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574271.027574:0:15280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6200/0x5bf8706fdac8be49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5bf8706fdac8be50 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574271.027587:0:15280:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788574271.027593:0:15280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c84c2617e00/0x5bf8706fdac8c1d7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8c1de expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574271.027600:0:15280:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c84c2617e00/0x5bf8706fdac8c1d7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8c1de expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574271.027615:0:15280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c84c2617e00/0x5bf8706fdac8c1d7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5bf8706fdac8c1de expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574271.027621:0:15280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.151@tcp lock: ffff9c84c2617e00/0x5bf8706fdac8c1d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5bf8706fdac8c1de expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574271.027633:0:15280:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788574271.027643:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788574271.027648:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c860204a800/0x5bf8706fdac8bf6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x5bf8706fdac8bf76 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574271.027655:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c860204a800 already unused, calling callback (ffffffffc1472c20) 10000000:00010000:3.0:1788574271.027660:0:6480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c860204a800/0x5bf8706fdac8bf6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x5bf8706fdac8bf76 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574271.027668:0:6480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c860204a800/0x5bf8706fdac8bf6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x5bf8706fdac8bf76 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788574271.027675:0:6480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c860204a800/0x5bf8706fdac8bf6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x5bf8706fdac8bf76 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788574271.027682:0:6480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788574271.027684:0:6480:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:3.0:1788574271.027735:0:6480:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9c860204a800/0x5bf8706fdac8bf6f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x5bf8706fdac8bf76 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574271.027741:0:6480:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788574271.027759:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c860204a800/0x5bf8706fdac8bf6f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x5bf8706fdac8bf76 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574271.027851:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c860204a800/0x5bf8706fdac8bf6f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x5bf8706fdac8bf76 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574271.027867:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788574271.027870:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6200/0x5bf8706fdac8be49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5bf8706fdac8be50 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574271.027876:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d6200 already unused, calling callback (ffffffffc1472c20) 10000000:00010000:3.0:1788574271.027879:0:6480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6200/0x5bf8706fdac8be49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5bf8706fdac8be50 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574271.027885:0:6480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6200/0x5bf8706fdac8be49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x5bf8706fdac8be50 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788574271.027891:0:6480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6200/0x5bf8706fdac8be49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x5bf8706fdac8be50 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788574271.027896:0:6480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1788574271.027898:0:6480:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1788574271.027901:0:6480:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1788574271.027916:0:6480:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6200/0x5bf8706fdac8be49 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5bf8706fdac8be50 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574271.027922:0:6480:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788574271.027939:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6200/0x5bf8706fdac8be49 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5bf8706fdac8be50 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574271.027946:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6200/0x5bf8706fdac8be49 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5bf8706fdac8be50 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574271.027969:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788574271.027972:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c84c2617e00/0x5bf8706fdac8c1d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5bf8706fdac8c1de expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574271.027977:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c84c2617e00 already unused, calling callback (ffffffffc1472c20) 10000000:00010000:3.0:1788574271.027980:0:6480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c84c2617e00/0x5bf8706fdac8c1d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5bf8706fdac8c1de expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574271.027986:0:6480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c84c2617e00/0x5bf8706fdac8c1d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5bf8706fdac8c1de expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788574271.027993:0:6480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c84c2617e00/0x5bf8706fdac8c1d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5bf8706fdac8c1de expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788574271.027999:0:6480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788574271.028001:0:6480:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:0.0:1788574271.028003:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788574271.028004:0:6480:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788574271.028023:0:6480:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9c84c2617e00/0x5bf8706fdac8c1d7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x5bf8706fdac8c1de expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574271.028028:0:6480:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788574271.028035:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c84c2617e00/0x5bf8706fdac8c1d7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x5bf8706fdac8c1de expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574271.028041:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c84c2617e00/0x5bf8706fdac8c1d7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x5bf8706fdac8c1de expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574271.028049:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574271.028050:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574271.028057:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574271.028069:0:15280:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7000/0x5bf8706fdac8bb32 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bb39 expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574271.028142:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:69505170-06bc-41d1-9626-ab1a3c7f32a0:3618:1875455681669376:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788574271.028153:0:15280:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7000/0x5bf8706fdac8bb32 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8bb39 expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574271.028162:0:15280:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7000/0x5bf8706fdac8bb32 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5bf8706fdac8bb39 expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574271.028168:0:15280:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7000/0x5bf8706fdac8bb32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5bf8706fdac8bb39 expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574271.028181:0:15280:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788574271.028185:0:15280:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:3.0:1788574271.028214:0:15280:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:3.0:1788574271.028246:0:15280:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0001 00000020:01000000:3.0:1788574271.028250:0:15280:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:3.0:1788574271.028254:0:15280:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788574271.028260:0:15280:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1788574271.028266:0:15280:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9c84c3023800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788574271.028272:0:15280:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9c85fad6d800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788574271.028277:0:15280:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff9c85fa0b8000) has exports, disconnecting them 00000020:00080000:3.0:1788574271.028282:0:15280:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9c84c3023800), last request at 1788574267 00000020:00000080:3.0:1788574271.028290:0:15280:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8be11 00000100:00080000:3.0:1788574271.028307:0:15280:0:(import.c:65:import_set_state_nolock()) ffff9c84c3020800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788574271.028313:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788574271.028348:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788574271.028354:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7000/0x5bf8706fdac8bb32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5bf8706fdac8bb39 expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574271.028370:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d7000 already unused, calling callback (ffffffffc1472c20) 10000000:00010000:3.0:1788574271.028374:0:6480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7000/0x5bf8706fdac8bb32 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5bf8706fdac8bb39 expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574271.028375:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574271.028386:0:6479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681669376 00000100:00100000:0.0:1788574271.028397:0:6479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681669376 00000100:00100000:0.0:1788574271.028428:0:6479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788574271.028434:0:6479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3618:x1875455681669376:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788574271.028439:0:6479:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788574271 with bad export cookie 6627170477389953583 00010000:00010000:3.0:1788574271.028459:0:6480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7000/0x5bf8706fdac8bb32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x5bf8706fdac8bb39 expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788574271.028466:0:6480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7000/0x5bf8706fdac8bb32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x5bf8706fdac8bb39 expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788574271.028473:0:6480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1788574271.028476:0:6480:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1788574271.028478:0:6480:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000100:00100000:0.0:1788574271.028483:0:6479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3618:x1875455681669376:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (171us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788574271.028491:0:6479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:3.0:1788574271.028495:0:6480:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7000/0x5bf8706fdac8bb32 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5bf8706fdac8bb39 expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574271.028503:0:6480:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788574271.028512:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7000/0x5bf8706fdac8bb32 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5bf8706fdac8bb39 expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574271.028518:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7000/0x5bf8706fdac8bb32 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5bf8706fdac8bb39 expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788574271.028529:0:3618:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.151@tcp of MGS@0@lo abruptly disconnected: reconnecting 00010000:00010000:3.0:1788574271.028531:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574271.028535:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788574271.028535:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9c85d0f82000 MGS: changing import state from FULL to DISCONN 00010000:00010000:3.0:1788574271.028538:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:02020000:0.0:1788574271.028542:0:3618:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.151@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000020:00080000:3.0:1788574271.028555:0:15280:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c84c3023800): rc 0 00000020:00000080:3.0:1788574271.028558:0:15280:0:(genops.c:885:class_export_put()) final put ffff9c84c3023800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:3.0:1788574271.028569:0:15280:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9c85fad6d800), last request at 1788574267 00000020:00000080:3.0:1788574271.028578:0:15280:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8bceb 00000100:00080000:3.0:1788574271.028584:0:15280:0:(import.c:65:import_set_state_nolock()) ffff9c85fad69800 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1788574271.028598:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c84c3023800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:3.0:1788574271.028646:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c84c3020800 for lustre-MDT0001 00000020:00080000:3.0:1788574271.028660:0:15280:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c85fad6d800): rc 0 00000020:00000080:3.0:1788574271.028662:0:15280:0:(genops.c:885:class_export_put()) final put ffff9c85fad6d800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:3.0:1788574271.028672:0:15280:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffb4d281597ae0 00000020:00000080:3.0:1788574271.028682:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85fad6d800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:3.0:1788574271.028715:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c85fad69800 for lustre-MDT0001 00000100:00080000:3.0:1788574271.028737:0:15280:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788574271.028745:0:15280:0:(client.c:3603:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff9c84c3c08e00 x1875455681667200/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788574280 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574271.028754:0:15280:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00000100:00080000:3.0:1788574271.029566:0:15280:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788574271.029574:0:15280:0:(import.c:65:import_set_state_nolock()) ffff9c85f6dec000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1788574271.045745:0:3618:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.151@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1788574271.045751:0:3618:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788574271.045761:0:3618:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c85c2f46a00 x1875455681667584/t0(0) o400->MGC192.168.204.151@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788574283 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574271.045777:0:3618:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c84c3c0b480 x1875455681669248/t0(0) o103->MGC192.168.204.151@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788574287 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574271.045787:0:3618:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c84c3c0a680 x1875455681669376/t0(0) o103->MGC192.168.204.151@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788574287 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574271.045831:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69505170-06bc-41d1-9626-ab1a3c7f32a0:0:1875455681669504:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788574271.045853:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c2f46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69505170-06bc-41d1-9626-ab1a3c7f32a0:3619:1875455681667584:0@lo:400:kworker.0 10000000:01000000:0.0:1788574271.046409:0:3618:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788574271.046415:0:3618:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788574271.046417:0:3618:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1788574271.046422:0:3618:0:(import.c:65:import_set_state_nolock()) ffff9c85d0f82000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788574271.046428:0:3618:0:(import.c:545:import_select_connection()) MGC192.168.204.151@tcp: connect to NID 0@lo last attempt 136 00000100:00080000:0.0:1788574271.046438:0:3618:0:(import.c:665:import_select_connection()) MGC192.168.204.151@tcp: import ffff9c85d0f82000 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:0.0:1788574271.046477:0:3618:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c84c36dc000 x1875455681669888/t0(0) o250->MGC192.168.204.151@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788574271.046517:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:69505170-06bc-41d1-9626-ab1a3c7f32a0:3616:1875455681669888:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:0.0:1788574271.046581:0:3616:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875455681669888 offset 0 length 520: 4 00010000:00010000:0.0:1788574271.046643:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574271.046745:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:69505170-06bc-41d1-9626-ab1a3c7f32a0:0:1875455681669760:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788574271.046756:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:69505170-06bc-41d1-9626-ab1a3c7f32a0:3617:1875455681669248:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788574271.046781:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681667200:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788574271.046794:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:69505170-06bc-41d1-9626-ab1a3c7f32a0:3618:1875455681669376:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788574271.046819:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788574271.048503:0:15280:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788574271.048511:0:15280:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:2.0:1788574271.048537:0:15280:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788574271.048598:0:15280:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1788574271.048623:0:15280:0:(import.c:65:import_set_state_nolock()) ffff9c85fae37800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1788574271.048636:0:15280:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788574271.048639:0:15280:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:2.0:1788574271.048653:0:15280:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788574271.048721:0:15280:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1788574271.048730:0:15280:0:(import.c:65:import_set_state_nolock()) ffff9c85fae37000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1788574271.048754:0:15280:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9c85fa0b8000) has no exports 00000100:00100000:3.0:1788574271.049325:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:69505170-06bc-41d1-9626-ab1a3c7f32a0:0:1875455681669632:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788574271.049625:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3009880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1875455681670016:0@lo:9:umount.0 00000100:00100000:0.0:1788574271.049695:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574271.049744:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3008700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1875455681670144:0@lo:9:umount.0 00000100:00100000:0.0:1788574271.049766:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574271.049800:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681670016 00000100:00100000:0.0:1788574271.049806:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681670016 00000100:00100000:0.0:1788574271.049852:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681670144 00000100:00100000:0.0:1788574271.049856:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681670144 00000100:00100000:0.0:1788574271.049880:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788574271.049889:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875455681670016:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788574271.049913:0:8409:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8bd38 00000100:00080000:0.0:1788574271.049921:0:8409:0:(import.c:65:import_set_state_nolock()) ffff9c85fadd6000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788574271.049958:0:8409:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967326 00000100:00100000:0.0:1788574271.050177:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3616:x1875455681670016:12345-0@lo:9:umount.0 Request processed in 288us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574271.050185:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788574271.050411:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788574271.050419:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875455681670144:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788574271.050444:0:8409:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8be7a 00000100:00080000:0.0:1788574271.050450:0:8409:0:(import.c:65:import_set_state_nolock()) ffff9c85fae30000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788574271.050472:0:8409:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:0.0:1788574271.050552:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3616:x1875455681670144:12345-0@lo:9:umount.0 Request processed in 135us (784us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574271.050558:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:0.0:1788574271.050575:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788574271.050579:0:6488:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788574271.050593:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788574271.050621:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c85fae37800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788574271.050638:0:3616:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788574271.050640:0:3616:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788574271.050643:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3009880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1875455681670016:0@lo:9:umount.0 00000100:00080000:0.0:1788574271.050655:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c85fae37000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788574271.050662:0:3616:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788574271.050663:0:3616:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788574271.050665:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3008700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1875455681670144:0@lo:9:umount.0 00010000:00010000:2.0:1788574271.053270:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:0.0:1788574271.059285:0:6478:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 18 match 1875455681669248 offset 224 length 224: 4 00000100:00100000:0.0:1788574271.059317:0:6478:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e0bdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3617:x1875455681669248:12345-0@lo:103:ldlm_bl.0 Request processed in 32713us (34719us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788574271.059332:0:6478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000020:00080000:3.0:1788574271.069478:0:15280:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9c85fa0b8000) has no exports 00010000:00010000:0.0:1788574271.124901:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1788574271.128472:0:15280:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c85c8b32300 - data ffff9c84c1cde870/ffff9c84c25fe400 00000020:01000000:2.0:1788574271.128648:0:15280:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c85fad03120 - data ffff9c85ded9e948/ffff9c85fa36e800 00000001:00000004:0.0:1788574271.137890:0:15280:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:3.0:1788574271.235637:0:15280:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788574271.235647:0:15280:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:3.0:1788574271.235656:0:15280:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1788574271.238350:0:15280:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788574271.238357:0:15280:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:3.0:1788574271.238367:0:15280:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788574271.238369:0:15280:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788574271.245181:0:8805:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788574271.245204:0:8805:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:1.0:1788574271.245228:0:8805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1788574271.245846:0:15280:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788574271.245853:0:15280:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:3.0:1788574271.245882:0:15280:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788574271.245884:0:15280:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788574271.246361:0:9892:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788574271.246365:0:9892:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:0.0:1788574271.246374:0:9892:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1788574271.247545:0:15280:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8bb55 00000020:00000080:3.0:1788574271.247555:0:15280:0:(genops.c:885:class_export_put()) final put ffff9c8600d4a800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788574271.248006:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c8600d4a800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788574271.250547:0:15280:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8bb6a 00000020:00000080:3.0:1788574271.250563:0:15280:0:(genops.c:885:class_export_put()) final put ffff9c8600d4b000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1788574271.250624:0:15280:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:3.0:1788574271.250631:0:15280:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788574271.250640:0:15280:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788574271.250645:0:15280:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9c85fa0b99c0) has no exports 00000004:01000000:3.0:1788574271.250844:0:15280:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1788574271.250852:0:15280:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8be73 00000020:00000080:3.0:1788574271.250857:0:15280:0:(genops.c:885:class_export_put()) final put ffff9c85fadd5000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788574271.253806:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c8600d4b000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:3.0:1788574271.258369:0:15280:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:3.0:1788574271.258385:0:15280:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788574271.258400:0:15280:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788574271.258405:0:15280:0:(genops.c:1558:class_disconnect_exports()) OBD device 27 (ffff9c84c2510000) has no exports 00000020:00000080:3.0:1788574271.258415:0:15280:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8be6c 00000020:00000080:3.0:1788574271.258423:0:15280:0:(genops.c:885:class_export_put()) final put ffff9c85fae31000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788574271.265431:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85fadd5000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00010000:01000000:3.0:1788574271.267490:0:15280:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:3.0:1788574271.267501:0:15280:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788574271.267506:0:15280:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:3.0:1788574271.267513:0:15280:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788574271.267515:0:15280:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788574271.276702:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85fae31000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788574271.276969:0:15280:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788574271.276986:0:15280:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788574271.277005:0:15280:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8bd31 00000020:00000080:3.0:1788574271.277017:0:15280:0:(genops.c:885:class_export_put()) final put ffff9c85c8a37800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1788574271.277023:0:15280:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:3.0:1788574271.277032:0:15280:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788574271.277038:0:15280:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788574271.277042:0:15280:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff9c85faf4cd40) has no exports 00000020:00000080:3.0:1788574271.277049:0:15280:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8bd2a 00000020:00000080:3.0:1788574271.277053:0:15280:0:(genops.c:885:class_export_put()) final put ffff9c85fae32800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788574271.277406:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c85fae37000 for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1788574271.277415:0:37:0:(genops.c:885:class_export_put()) final put ffff9c85fadd5800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788574271.277417:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85fadd5800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:1.0:1788574271.277436:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788574271.277514:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85c8a37800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1788574271.277519:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85fae32800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1788574271.277961:0:15280:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:3.0:1788574271.277972:0:15280:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788574271.277976:0:15280:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:3.0:1788574271.277982:0:15280:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788574271.278043:0:15280:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788574271.278089:0:15280:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788574271.278096:0:15280:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:3.0:1788574271.278110:0:15280:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1788574271.278117:0:15280:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8bb8d 00000020:00000080:3.0:1788574271.278123:0:15280:0:(genops.c:885:class_export_put()) final put ffff9c85f6f47800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1788574271.278128:0:15280:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:3.0:1788574271.278132:0:15280:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788574271.278135:0:15280:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788574271.278138:0:15280:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9c85e5698000) has no exports 00000020:00000080:3.0:1788574271.278149:0:15280:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8bb86 00000020:00000080:3.0:1788574271.278152:0:15280:0:(genops.c:885:class_export_put()) final put ffff9c85f6de8000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788574271.278473:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c85fae37800 for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1788574271.278482:0:37:0:(genops.c:885:class_export_put()) final put ffff9c85fae33000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788574271.278484:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85fae33000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:1.0:1788574271.278490:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788574271.278544:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85f6f47800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1788574271.278550:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85f6de8000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1788574271.367240:0:15280:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1788574271.367249:0:15280:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788574271.367254:0:15280:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1788574271.367262:0:15280:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788574271.367320:0:15280:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788574271.367332:0:15280:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788574271.367359:0:15280:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788574271.367363:0:15280:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788574271.367369:0:15280:0:(genops.c:885:class_export_put()) final put ffff9c85c8a32800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788574271.367373:0:15280:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85c8a32800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1788574271.367384:0:15280:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788574271.367638:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c85f6dec000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1788574271.367646:0:8:0:(genops.c:885:class_export_put()) final put ffff9c85f6de8800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788574271.367648:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85f6de8800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:1.0:1788574271.367655:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788574271.367740:0:15280:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8bb71 00000020:00000080:0.0:1788574271.367748:0:15280:0:(genops.c:885:class_export_put()) final put ffff9c8600d4f000/lustre-MDD0001_UUID 00000020:01000000:0.0:1788574271.367758:0:15280:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1788574271.367762:0:15280:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788574271.367768:0:15280:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788574271.367772:0:15280:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff9c8600d599c0) has no exports 00000020:00000080:0.0:1788574271.367792:0:15280:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788574271.367859:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c8600d4f000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:0.0:1788574271.367931:0:15280:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1788574271.367934:0:15280:0:(genops.c:885:class_export_put()) final put ffff9c8600d49800/lustre-MDD0001_UUID 00000020:00000080:0.0:1788574271.367936:0:15280:0:(genops.c:844:class_export_destroy()) destroying export ffff9c8600d49800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:0.0:1788574271.367940:0:15280:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:1.0:1788574271.368293:0:15280:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8bb78 00000020:00000080:1.0:1788574271.368299:0:15280:0:(genops.c:885:class_export_put()) final put ffff9c8600d4c800/lustre-MDT0001-osd_UUID 00000020:01000004:1.0:1788574271.368347:0:15280:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c85fa390800 from lustre-MDT0001, refs=2 00000020:01000004:1.0:1788574271.368351:0:15280:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c85fa390800 2 00000020:01000004:1.0:1788574271.368355:0:15280:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c85fa390800 from lustre-MDT0001 00000020:00000080:1.0:1788574271.368375:0:15280:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788574271.368379:0:15280:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:1.0:1788574271.368381:0:15280:0:(genops.c:885:class_export_put()) final put ffff9c8600d4e800/lustre-MDT0001_UUID 00000020:00000080:1.0:1788574271.368383:0:15280:0:(genops.c:844:class_export_destroy()) destroying export ffff9c8600d4e800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:1.0:1788574271.368389:0:15280:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:1.0:1788574271.368412:0:15280:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:1.0:1788574271.368415:0:15280:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:1.0:1788574271.368417:0:15280:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788574271.368420:0:15280:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788574271.368426:0:15280:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff9c85fa1fe800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788574271.368438:0:15280:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff9c85de9db380) has exports, disconnecting them 00000020:00080000:1.0:1788574271.368442:0:15280:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff9c85fa1fe800), last request at 1788574013 00000020:00000080:1.0:1788574271.368446:0:15280:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8bbcc 00000020:00080000:1.0:1788574271.368456:0:15280:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c85fa1fe800): rc 0 00000020:00000080:1.0:1788574271.368460:0:15280:0:(genops.c:885:class_export_put()) final put ffff9c85fa1fe800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1788574271.368482:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c8600d4c800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1788574271.369309:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85fa1fe800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:0.0:1788574271.369337:0:15280:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:0.0:1788574271.369341:0:15280:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788574271.369345:0:15280:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788574271.369350:0:15280:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788574271.369377:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c85fac6f000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1788574271.369600:0:15280:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788574271.369608:0:15280:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:0.0:1788574271.369612:0:15280:0:(genops.c:885:class_export_put()) final put ffff9c8600d39000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:0.0:1788574271.369614:0:15280:0:(genops.c:844:class_export_destroy()) destroying export ffff9c8600d39000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:0.0:1788574271.369618:0:15280:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:0.0:1788574271.369668:0:15280:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c85fa390800 1 00000020:00000080:0.0:1788574271.369673:0:15280:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8bb08 00000020:00000080:0.0:1788574271.369677:0:15280:0:(genops.c:885:class_export_put()) final put ffff9c85fa228800/lustre-MDT0001-osd_UUID 00000020:01000000:0.0:1788574271.369685:0:15280:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:0.0:1788574271.369701:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85fa228800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1788574271.369710:0:15280:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788574271.369784:0:15280:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788574271.369788:0:15280:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9c85fa0bcd40) has no exports 00000020:00000080:1.0:1788574271.410033:0:15280:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788574271.410048:0:15280:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:1.0:1788574271.410053:0:15280:0:(genops.c:885:class_export_put()) final put ffff9c85fa392000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788574271.410058:0:15280:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85fa392000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:1.0:1788574271.410063:0:15280:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:1.0:1788574271.410183:0:15280:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9c85fa391000 00000020:01000000:1.0:1788574271.410228:0:15280:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1788574271.410232:0:15280:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788574271.410237:0:15280:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788574271.410242:0:15280:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9c85d00c3380) has no exports 00000100:00100000:0.0:1788574271.410734:0:6494:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9c85c36e9800:6494] 2 exiting: rc = 0 00000100:00100000:0.0:1788574271.410859:0:11893:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff9c84c34b2000:11893] 4 exiting: rc = 0 00000100:00100000:0.0:1788574271.410994:0:6493:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9c85c36e8e00:6493] 1 exiting: rc = 0 00000100:00100000:0.0:1788574271.411295:0:7439:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9c85f6dfec00:7439] 3 exiting: rc = 0 00000100:00100000:3.0:1788574271.414628:0:6492:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9c85e57df600:6492] 0 exiting: rc = 1 00000100:00100000:0.0:1788574271.415727:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574271.415742:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574271.415749:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574271.415755:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574271.415762:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574271.415768:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574271.415773:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574271.415779:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574271.415784:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574271.415790:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574271.415797:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574271.415805:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574271.415811:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574271.415816:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574271.415840:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574271.415846:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574271.415852:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574271.415858:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574271.415864:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574271.415869:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574271.415876:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574271.415881:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574271.415887:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574271.415893:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574271.415900:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574271.415905:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574271.415910:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574271.415918:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574271.415924:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574271.415930:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574271.415935:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574271.415942:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574271.415947:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574271.415952:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574271.415958:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574271.415963:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574271.415969:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574271.415976:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574271.415983:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574271.415989:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574271.415995:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574271.416000:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574271.416007:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574271.416013:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574271.416020:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574271.416026:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574271.416032:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574271.416037:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574271.416043:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574271.416055:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574271.416061:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574271.416067:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574271.416072:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574271.416078:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574271.416083:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574271.416089:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574271.416094:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574271.416100:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574271.416105:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574271.416110:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574271.416116:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574271.416121:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574271.416127:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574271.416132:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574271.421011:0:6495:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9c85e09db200:6495] 0 exiting: rc = 1 00000100:00100000:3.0:1788574271.421172:0:6496:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9c85e09dbe00:6496] 1 exiting: rc = 0 00000100:00100000:1.0:1788574271.421288:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.421297:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.421304:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.421311:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.421316:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.421322:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.421329:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.421335:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.421341:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.421349:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.421356:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.421377:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.421386:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.421392:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.421400:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.421406:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.421413:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.421433:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.421440:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.421447:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.421455:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.421461:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.421468:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.421476:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.421484:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.421494:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.421500:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.421506:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.421516:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.421524:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.421532:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.421542:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.421546:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.421552:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.421556:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.421568:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.421826:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.421832:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.421837:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.421843:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.421848:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.421853:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.421858:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.421863:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.421867:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.421872:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.421877:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.421882:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.421887:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.421891:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.421897:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.421906:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.421918:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.421923:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.421929:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.421934:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.421939:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.421945:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.421950:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.421955:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.421961:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.421967:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.421972:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.421978:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574271.422933:0:7533:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff9c8600cdb800:7533] 2 exiting: rc = 0 00000100:00100000:1.0:1788574271.423078:0:6498:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9c85c3934400:6498] 1 exiting: rc = 0 00000100:00100000:3.0:1788574271.423361:0:6497:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9c85c6bd2000:6497] 0 exiting: rc = 1 00000100:00100000:1.0:1788574271.423563:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.423574:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.423584:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.423594:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.423616:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.423627:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.423638:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.423649:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.423659:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.423672:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.423683:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.423748:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.423757:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.423782:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.423792:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.423801:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.423808:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.423817:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.423825:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.423833:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.423842:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.423850:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.423872:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.423881:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.423893:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.423928:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.423942:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.423948:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.423954:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.423960:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.424012:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.424023:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.424031:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.424040:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.424049:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.424058:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.424066:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.424099:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.424108:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.424115:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.424122:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.424131:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.424140:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.424149:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.424159:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.424173:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.424185:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.428421:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.428438:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.428490:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.428500:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.428509:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.428521:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.428530:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.428538:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.428547:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.428555:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.428581:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.428590:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.428599:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.428606:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.428613:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.428621:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.428642:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574271.445448:0:6499:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9c85c823ec00:6499] 0 exiting: rc = 1 00000100:00100000:0.0:1788574271.446713:0:6500:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9c85c823f200:6500] 1 exiting: rc = 0 00000100:00100000:1.0:1788574271.452283:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.452296:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.452304:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.452312:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.452320:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.452326:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.452333:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.452340:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.452346:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.452354:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.452361:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.452383:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.452390:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.452400:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.452411:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.452420:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.452425:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.452430:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.452435:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.452448:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.452453:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.452458:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.452463:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.452468:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.452473:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.452477:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.452482:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.452486:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.452503:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.452508:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.452513:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.452518:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.452523:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.452527:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.452532:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.452537:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.452542:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.452547:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.452552:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.452557:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.452562:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.452568:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.452573:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.452578:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.452584:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.452589:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.452594:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.452599:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.452604:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.452608:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.452613:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.452618:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.452623:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.452627:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.452631:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.452636:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.452641:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.452646:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.452651:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.452656:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.452660:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.452665:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.452670:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.452682:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.453112:0:6501:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9c85c823f600:6501] 0 exiting: rc = 1 00000100:00100000:0.0:1788574271.453706:0:6502:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9c85c823ea00:6502] 1 exiting: rc = 0 00000100:00100000:1.0:1788574271.453850:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.453860:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.453868:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.453876:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.453883:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.453890:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.453897:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.453903:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.453909:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.453915:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.453921:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.453928:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.453935:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.453941:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.453948:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.453954:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.453961:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.453967:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.453973:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.453980:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.453987:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.453993:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.454000:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.454008:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.454016:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.454026:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.454037:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.454045:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.454050:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.454054:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.454069:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.454074:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.454079:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.454094:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.454100:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.454105:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.454110:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.454115:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.454119:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.454124:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.454130:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.454134:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.454139:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.454144:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.454149:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.454156:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.454161:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.454166:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.454172:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.454177:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.454182:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.454343:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.454354:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.454360:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.454479:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.454487:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.454493:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.454501:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.454508:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.454515:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.454521:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.454529:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.454536:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.454543:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574271.458725:0:6503:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9c85c823f400:6503] 0 exiting: rc = 1 00000100:00100000:0.0:1788574271.458904:0:6504:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9c85c823ee00:6504] 1 exiting: rc = 0 00000100:00100000:1.0:1788574271.460076:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.460088:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.460096:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.460103:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.460124:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.460131:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.460138:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.460145:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.460151:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.460158:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.460167:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.460175:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.460183:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.460443:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.460453:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.460460:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.460467:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.460475:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.460483:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.460491:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.460498:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.460504:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.460512:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.460519:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.460525:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.460533:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.460542:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.460551:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.460562:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.460572:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.460578:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.460584:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.460589:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.460597:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.460603:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.460610:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.460616:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.460621:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.460635:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.460649:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.460654:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.460659:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.460664:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.460668:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.460673:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.460678:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.460683:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.460741:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.460752:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.460760:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.460767:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.460774:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.460781:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.460788:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.460795:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.460802:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.460809:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.460817:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.460825:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.460832:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.460838:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.460845:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.460851:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.460859:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574271.465657:0:6505:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9c85c823e400:6505] 0 exiting: rc = 1 00000100:00100000:0.0:1788574271.465943:0:6506:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9c85c823fa00:6506] 1 exiting: rc = 0 00000100:00100000:0.0:1788574271.466141:0:6507:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9c85c823e600:6507] 2 exiting: rc = 0 00000100:00100000:1.0:1788574271.466397:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.466408:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.466415:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.466423:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.466430:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.466438:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.466447:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.466481:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.466491:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.466498:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.466521:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.466532:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.466543:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.466551:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.466562:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.466572:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.466577:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.466583:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.466590:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.466595:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.466600:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.466605:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.466611:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.466617:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.466622:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.466627:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.466632:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.466637:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.466644:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.466650:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.466656:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.466677:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.466684:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.466702:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.466709:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.466714:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.466720:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.466725:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.466731:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.466737:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.466742:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.466748:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.466754:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.466761:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.466766:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.466780:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.466786:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.466792:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.466797:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.466802:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.466807:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.466812:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.466817:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.466823:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.466829:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.466848:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.466855:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.466861:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.466866:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.466871:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.466876:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.466882:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.466888:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574271.466904:0:15280:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788574271.472124:0:15280:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788574271.472137:0:15280:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1788574271.472143:0:15280:0:(genops.c:885:class_export_put()) final put ffff9c85c8a32000/MDS_uuid 00000020:00000080:1.0:1788574271.472147:0:15280:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85c8a32000/MDS_uuid for MDS 00000020:01000000:1.0:1788574271.472153:0:15280:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1788574271.472568:0:15280:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:0.0:1788574272.147606:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788574272.665204:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 69505170-06bc-41d1-9626-ab1a3c7f32a0->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788574272.665215:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 69505170-06bc-41d1-9626-ab1a3c7f32a0->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788574272.665218:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788574272.665222:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788574272.665226:0:37:0:(import.c:65:import_set_state_nolock()) ffff9c84c2274000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788574272.665234:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 407 00000100:00080000:1.0:1788574272.665241:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788574272.665264:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c84c2274000 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:1.0:1788574272.665301:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c84c335df80 x1875455681670272/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788574272.665350:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788574272.665354:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788574272.665355:0:37:0:(import.c:65:import_set_state_nolock()) ffff9c84c3022800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788574272.665359:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 407 00000100:00080000:1.0:1788574272.665363:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788574272.665366:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c84c3022800 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:1.0:1788574272.665378:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c84c335f800 x1875455681670528/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788574272.665424:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788574272.665442:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1875455681670400:0@lo:400:kworker.0 00000400:00000100:1.0:1788574272.665494:0:3617:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875455681670400 offset 0 length 224: 4 00000100:00100000:1.0:1788574272.665555:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1875455681670656:0@lo:400:kworker.0 00000400:00000100:1.0:1788574272.665574:0:3619:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875455681670656 offset 0 length 224: 4 00000100:00100000:2.0:1788574272.665754:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1875455681670272:0@lo:38:kworker.0 00000400:00000100:2.0:1788574272.665783:0:3616:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875455681670272 offset 0 length 520: 4 00000100:00100000:2.0:1788574272.665799:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1875455681670528:0@lo:38:kworker.0 00000400:00000100:2.0:1788574272.665813:0:3616:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875455681670528 offset 0 length 520: 4 00010000:00010000:3.0:1788574273.172023:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574274.206957:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574275.219419:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788574275.560795:0:15481:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788574275.577383:0:15481:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1788574275.577438:0:15481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c860204bc00/0x5bf8706fdac8bf45 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bf4c expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574275.577454:0:15481:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c860204bc00/0x5bf8706fdac8bf45 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8bf4c expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574275.577463:0:15481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c860204bc00/0x5bf8706fdac8bf45 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x5bf8706fdac8bf4c expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574275.577490:0:15481:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.151@tcp lock: ffff9c860204bc00/0x5bf8706fdac8bf45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x5bf8706fdac8bf4c expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574275.577872:0:15481:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788574275.577880:0:15481:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788574275.577909:0:15481:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788574275.577921:0:15481:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c84c335df80 x1875455681670272/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788574287 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574275.577945:0:15481:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788574275.577952:0:15481:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788574275.577958:0:15481:0:(import.c:65:import_set_state_nolock()) ffff9c84c2274000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1788574275.577974:0:15481:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788574275.577978:0:15481:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c84c335df80 x1875455681670272/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788574287 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574275.577986:0:15481:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788574275.577989:0:15481:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 16s for inflight to error out 00000100:00100000:1.0:1788574275.578285:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1875455681670272:0@lo:38:kworker.0 00000100:00080000:3.0:1788574275.579755:0:15481:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788574275.579771:0:15481:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c84c335ca80 x1875455681670400/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574288 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574275.579798:0:15481:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788574275.579804:0:15481:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788574275.579827:0:15481:0:(import.c:65:import_set_state_nolock()) ffff9c84c2270800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1788574275.579880:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788574275.579890:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c860204bc00/0x5bf8706fdac8bf45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x5bf8706fdac8bf4c expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574275.579900:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c860204bc00 already unused, calling callback (ffffffffc1472c20) 10000000:00010000:0.0:1788574275.579905:0:6480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c860204bc00/0x5bf8706fdac8bf45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x5bf8706fdac8bf4c expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574275.579936:0:6480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c860204bc00/0x5bf8706fdac8bf45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x5bf8706fdac8bf4c expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788574275.579942:0:6480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c860204bc00/0x5bf8706fdac8bf45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x5bf8706fdac8bf4c expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788574275.579948:0:6480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788574275.579950:0:6480:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788574275.579953:0:6480:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788574275.579979:0:6480:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c85d0f82000 00010000:00010000:0.0:1788574275.579983:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c860204bc00/0x5bf8706fdac8bf45 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x5bf8706fdac8bf4c expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574275.579990:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c860204bc00/0x5bf8706fdac8bf45 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x5bf8706fdac8bf4c expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574275.580178:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1875455681670400:0@lo:400:kworker.0 00000100:00100000:0.0:1788574275.580289:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3616:1875455681670784:0@lo:39:umount.0 00000400:00000100:0.0:1788574275.580337:0:3616:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875455681670784 offset 0 length 224: 4 00010000:00010000:2.0:1788574275.580521:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574275.580524:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574275.580526:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574276.243435:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788574276.691299:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 69505170-06bc-41d1-9626-ab1a3c7f32a0->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788574276.691308:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 69505170-06bc-41d1-9626-ab1a3c7f32a0->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788574276.691311:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788574276.691315:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788574276.691460:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3620:1875455681670912:0@lo:400:kworker.0 00000400:00000100:3.0:1788574276.691517:0:3620:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875455681670912 offset 0 length 224: 4 00000001:00100000:0.0:1788574276.760917:0:9487:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788574276.760927:0:9487:0:(genops.c:885:class_export_put()) final put ffff9c85fae34000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788574276.761015:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85fae34000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1788574276.761096:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c85fae30000 for lustre-OST0001 00000001:00100000:0.0:1788574276.761448:0:8404:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788574276.761452:0:8404:0:(genops.c:885:class_export_put()) final put ffff9c8600d3b000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788574276.761503:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c8600d3b000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1788574276.761596:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c85fadd6000 for lustre-OST0000 00010000:00010000:2.0:1788574277.267956:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788574277.715377:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 69505170-06bc-41d1-9626-ab1a3c7f32a0->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788574277.715390:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 69505170-06bc-41d1-9626-ab1a3c7f32a0->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788574277.715394:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788574277.715398:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788574277.716250:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788574277.716288:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3618:1875455681671040:0@lo:400:kworker.0 00000400:00000100:0.0:1788574277.716344:0:3618:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875455681671040 offset 0 length 224: 4 00010000:00010000:2.0:1788574278.292460:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574279.315422:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574280.339414:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574281.363426:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574281.747312:0:3616:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788574271/real 1788574271] req@ffff9c84c36dc000 x1875455681669888/t0(0) o250->MGC192.168.204.151@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788574281 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574281.747344:0:3616:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c84c36dc000 x1875455681669888/t0(0) o250->MGC192.168.204.151@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788574281 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788574281.747365:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c85d0f82000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788574281.747391:0:3616:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1788574281.747395:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:69505170-06bc-41d1-9626-ab1a3c7f32a0:3616:1875455681669888:0@lo:250:ptlrpcd_00_01.0 00000100:00080000:3.0:1788574281.747485:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 69505170-06bc-41d1-9626-ab1a3c7f32a0->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788574281.747499:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788574281.747502:0:37:0:(import.c:65:import_set_state_nolock()) ffff9c85d0f82000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788574281.747508:0:37:0:(import.c:545:import_select_connection()) MGC192.168.204.151@tcp: connect to NID 0@lo last attempt 411 00000100:00080000:3.0:1788574281.747512:0:37:0:(import.c:630:import_select_connection()) MGC192.168.204.151@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788574281.747519:0:37:0:(import.c:665:import_select_connection()) MGC192.168.204.151@tcp: import ffff9c85d0f82000 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:3.0:1788574281.747551:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c84c3c09880 x1875455681671168/t0(0) o250->MGC192.168.204.151@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788574281.747575:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788574281.747579:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788574281.747712:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3618:1875455681671296:0@lo:400:kworker.0 00000400:00000100:0.0:1788574281.747760:0:3618:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875455681671296 offset 0 length 224: 4 00000100:00100000:1.0:1788574281.748211:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:69505170-06bc-41d1-9626-ab1a3c7f32a0:3616:1875455681671168:0@lo:250:kworker.0 00000400:00000100:1.0:1788574281.748236:0:3616:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875455681671168 offset 0 length 520: 4 00010000:00010000:0.0:1788574282.391285:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574283.411409:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574284.440768:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574285.459418:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574285.843539:0:3616:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788574275/real 1788574275] req@ffff9c84c3c09c00 x1875455681670784/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788574285 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574285.843574:0:3616:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c84c3c09c00 x1875455681670784/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788574285 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788574285.843594:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c84c2270800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788574285.843623:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3616:1875455681670784:0@lo:39:umount.0 00000100:00080000:3.0:1788574285.844596:0:15481:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788574285.844603:0:15481:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788574285.844608:0:15481:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788574285.845531:0:15481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85fa32fc00/0x5bf8706fdac8bf53 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bf5a expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574285.845547:0:15481:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85fa32fc00/0x5bf8706fdac8bf53 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8bf5a expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574285.845555:0:15481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85fa32fc00/0x5bf8706fdac8bf53 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x5bf8706fdac8bf5a expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574285.845576:0:15481:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.151@tcp lock: ffff9c85fa32fc00/0x5bf8706fdac8bf53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x5bf8706fdac8bf5a expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574285.845610:0:15481:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788574285.845618:0:15481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c84c2616e00/0x5bf8706fdac8c1c9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8c1d0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574285.845624:0:15481:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c84c2616e00/0x5bf8706fdac8c1c9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8c1d0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574285.845629:0:15481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c84c2616e00/0x5bf8706fdac8c1c9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5bf8706fdac8c1d0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574285.845635:0:15481:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.151@tcp lock: ffff9c84c2616e00/0x5bf8706fdac8c1c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5bf8706fdac8c1d0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574285.845658:0:15481:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1788574285.845663:0:15481:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00010000:00010000:2.0:1788574285.845685:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000020:01000004:3.0:1788574285.845691:0:15481:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00010000:00010000:2.0:1788574285.845694:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c85fa32fc00/0x5bf8706fdac8bf53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5bf8706fdac8bf5a expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:3.0:1788574285.845697:0:15481:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1788574285.845703:0:15481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00010000:00010000:2.0:1788574285.845706:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32fc00 already unused, calling callback (ffffffffc1472c20) 00000020:00000080:3.0:1788574285.845710:0:15481:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 10000000:00010000:2.0:1788574285.845712:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c85fa32fc00/0x5bf8706fdac8bf53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5bf8706fdac8bf5a expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788574285.845715:0:15481:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff9c8600d5cd40) has no exports 00010000:00010000:2.0:1788574285.845725:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c85fa32fc00/0x5bf8706fdac8bf53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x5bf8706fdac8bf5a expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788574285.845734:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c85fa32fc00/0x5bf8706fdac8bf53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x5bf8706fdac8bf5a expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788574285.845740:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000020:00080000:3.0:1788574285.845744:0:15481:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff9c8600d5cd40) has no exports 10000000:01000000:2.0:1788574285.845751:0:6481:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:2.0:1788574285.845753:0:6481:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:2.0:1788574285.845769:0:6481:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c85d0f82000 00010000:00010000:2.0:1788574285.845773:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c85fa32fc00/0x5bf8706fdac8bf53 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x5bf8706fdac8bf5a expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574285.845780:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c85fa32fc00/0x5bf8706fdac8bf53 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x5bf8706fdac8bf5a expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574285.845794:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788574285.845797:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c84c2616e00/0x5bf8706fdac8c1c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5bf8706fdac8c1d0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574285.845802:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c84c2616e00 already unused, calling callback (ffffffffc1472c20) 10000000:00010000:2.0:1788574285.845805:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c84c2616e00/0x5bf8706fdac8c1c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5bf8706fdac8c1d0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574285.845811:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c84c2616e00/0x5bf8706fdac8c1c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x5bf8706fdac8c1d0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788574285.845818:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c84c2616e00/0x5bf8706fdac8c1c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x5bf8706fdac8c1d0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788574285.845824:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788574285.845826:0:6481:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788574285.845828:0:6481:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788574285.845833:0:6481:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c85d0f82000 00010000:00010000:2.0:1788574285.845836:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c84c2616e00/0x5bf8706fdac8c1c9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x5bf8706fdac8c1d0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574285.845843:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c84c2616e00/0x5bf8706fdac8c1c9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x5bf8706fdac8c1d0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574285.845859:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574285.845861:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574285.845862:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574285.848153:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788574285.849718:0:15481:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c84c3311f00 - data ffff9c84c1c096c0/ffff9c85fafe6c00 00000020:01000000:3.0:1788574285.850147:0:15481:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c84c10bcd20 - data ffff9c85dec3dca8/ffff9c85f7fc0800 00100000:10000000:3.0:1788574285.865338:0:15481:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788574285.885387:0:15481:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8bca5 00000020:00000080:2.0:1788574285.885402:0:15481:0:(genops.c:885:class_export_put()) final put ffff9c84c1be9000/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1788574285.885424:0:15481:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c85fad3f000 from lustre-OST0000, refs=2 00000020:01000004:2.0:1788574285.885428:0:15481:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c85fad3f000 2 00000020:01000004:2.0:1788574285.885432:0:15481:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c85fad3f000 from lustre-OST0000 00000020:00000080:2.0:1788574285.885456:0:15481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788574285.885467:0:15481:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1788574285.885470:0:15481:0:(genops.c:885:class_export_put()) final put ffff9c84c1bec800/lustre-OST0000_UUID 00000020:00000080:2.0:1788574285.885473:0:15481:0:(genops.c:844:class_export_destroy()) destroying export ffff9c84c1bec800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1788574285.885480:0:15481:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1788574285.885538:0:15481:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1788574285.885542:0:15481:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1788574285.885546:0:15481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788574285.885550:0:15481:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788574285.885556:0:15481:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9c84c2273800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788574285.885562:0:15481:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff9c85e569b380) has exports, disconnecting them 00000020:00080000:2.0:1788574285.885567:0:15481:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9c84c2273800), last request at 1788574032 00000020:00000080:2.0:1788574285.885572:0:15481:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8bccf 00000020:00080000:2.0:1788574285.885581:0:15481:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c84c2273800): rc 0 00000020:00000080:2.0:1788574285.885586:0:15481:0:(genops.c:885:class_export_put()) final put ffff9c84c2273800/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788574285.885990:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c84c1be9000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788574285.886003:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c84c2273800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1788574285.888872:0:15481:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1788574285.888883:0:15481:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788574285.888887:0:15481:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788574285.888897:0:15481:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788574285.889096:0:15481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788574285.889104:0:15481:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:0.0:1788574285.889111:0:15481:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1788574285.889119:0:15481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788574285.889123:0:15481:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788574285.889130:0:15481:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff9c84c2272000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788574285.889136:0:15481:0:(genops.c:1553:class_disconnect_exports()) OBD device 20 (ffff9c85e569cd40) has exports, disconnecting them 00000020:00080000:0.0:1788574285.889141:0:15481:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff9c84c2272000), last request at 1788574032 00000020:00000080:0.0:1788574285.889145:0:15481:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8bce4 00000020:00080000:0.0:1788574285.889159:0:15481:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c84c2272000): rc 0 00000020:00000080:0.0:1788574285.889165:0:15481:0:(genops.c:885:class_export_put()) final put ffff9c84c2272000/lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1788574285.889456:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c84c2274000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788574285.889465:0:8:0:(genops.c:885:class_export_put()) final put ffff9c85f7fb3800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1788574285.889469:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85f7fb3800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1788574285.889476:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1788574285.889550:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c84c2272000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:1.0:1788574285.890783:0:15481:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:1.0:1788574285.890804:0:15481:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788574285.890808:0:15481:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788574285.890815:0:15481:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788574285.890851:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c84c2270800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1788574285.891032:0:15481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788574285.891040:0:15481:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:1.0:1788574285.891045:0:15481:0:(genops.c:885:class_export_put()) final put ffff9c84c2275000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:1.0:1788574285.891049:0:15481:0:(genops.c:844:class_export_destroy()) destroying export ffff9c84c2275000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:1.0:1788574285.891054:0:15481:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:1.0:1788574285.891112:0:15481:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c85fad3f000 1 00000020:00000080:1.0:1788574285.891118:0:15481:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8bc6d 00000020:00000080:1.0:1788574285.891123:0:15481:0:(genops.c:885:class_export_put()) final put ffff9c85faec3800/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1788574285.891132:0:15481:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1788574285.891141:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85faec3800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788574285.891150:0:15481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788574285.891155:0:15481:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788574285.891158:0:15481:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff9c85faf4b380) has no exports 00000020:00000080:0.0:1788574286.067615:0:15481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788574286.067631:0:15481:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1788574286.067636:0:15481:0:(genops.c:885:class_export_put()) final put ffff9c85fad39800/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1788574286.067641:0:15481:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85fad39800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1788574286.067653:0:15481:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1788574286.067772:0:15481:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9c85fad3d000 00000020:02000400:0.0:1788574286.067819:0:15481:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1788574286.484285:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788574286.997258:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 69505170-06bc-41d1-9626-ab1a3c7f32a0->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788574286.997266:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 69505170-06bc-41d1-9626-ab1a3c7f32a0->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788574286.997269:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788574286.997273:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788574286.997341:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788574286.997359:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3620:1875455681671424:0@lo:400:kworker.0 00000400:00000100:1.0:1788574286.997420:0:3620:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875455681671424 offset 0 length 224: 4 00010000:00010000:2.0:1788574287.507411:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574287.891413:0:3616:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788574272/real 1788574272] req@ffff9c84c335f800 x1875455681670528/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1788574287 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574287.891443:0:3616:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c84c335f800 x1875455681670528/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1788574287 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788574287.891477:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c84c3022800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788574287.891530:0:3616:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788574287.891535:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1875455681670528:0@lo:38:kworker.0 00000100:00080000:0.0:1788574287.895049:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 69505170-06bc-41d1-9626-ab1a3c7f32a0->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788574287.895065:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 69505170-06bc-41d1-9626-ab1a3c7f32a0->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788574287.895068:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788574287.895072:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788574287.895075:0:8:0:(import.c:65:import_set_state_nolock()) ffff9c84c3022800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788574287.895083:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 412 00000100:00080000:0.0:1788574287.895090:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788574287.895096:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c84c3022800 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:0.0:1788574287.895132:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c84c36dc380 x1875455681671552/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788574287.895233:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1875455681671552:0@lo:38:kworker.0 00000400:00000100:1.0:1788574287.895289:0:3616:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875455681671552 offset 0 length 520: 4 00000100:00100000:3.0:1788574287.895532:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3620:1875455681671680:0@lo:400:kworker.0 00000400:00000100:3.0:1788574287.895562:0:3620:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875455681671680 offset 0 length 224: 4 00000100:00000400:2.0:1788574288.003289:0:3619:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788574272/real 1788574272] req@ffff9c84c335d880 x1875455681670656/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788574288 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574288.038224:0:3619:0:(client.c:2548:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9c84c335d880 x1875455681670656/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788574288 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788574288.038240:0:3619:0:(import.c:65:import_set_state_nolock()) ffff9c84c3283800 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788574288.038244:0:3619:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788574288.054102:0:3619:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00080000:1.0:1788574288.054143:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 69505170-06bc-41d1-9626-ab1a3c7f32a0->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:2.0:1788574288.054150:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1875455681670656:0@lo:400:kworker.0 00000100:00080000:1.0:1788574288.054156:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 69505170-06bc-41d1-9626-ab1a3c7f32a0->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788574288.054159:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788574288.054162:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788574288.054164:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788574288.054166:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788574288.054169:0:8:0:(import.c:65:import_set_state_nolock()) ffff9c84c3283800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788574288.054174:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 194 00000100:00080000:1.0:1788574288.054182:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9c84c3283800 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:1.0:1788574288.055670:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c84c335c000 x1875455681671808/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788574288.055715:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3616:1875455681671808:0@lo:38:kworker.0 00000400:00000100:1.0:1788574288.055763:0:3616:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875455681671808 offset 0 length 520: 4 00010000:00010000:1.0:1788574288.531506:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574289.556850:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788574289.847424:0:15683:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788574289.854436:0:15683:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1788574289.854873:0:15683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85faea3c00/0x5bf8706fdac8bf29 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bf30 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574289.854890:0:15683:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85faea3c00/0x5bf8706fdac8bf29 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8bf30 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574289.854898:0:15683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85faea3c00/0x5bf8706fdac8bf29 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5bf8706fdac8bf30 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574289.854905:0:15683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.151@tcp lock: ffff9c85faea3c00/0x5bf8706fdac8bf29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5bf8706fdac8bf30 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574289.855137:0:15683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788574289.855144:0:15683:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788574289.855171:0:15683:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788574289.855181:0:15683:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c84c36dc380 x1875455681671552/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788574307 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574289.855224:0:15683:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788574289.855230:0:15683:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788574289.855237:0:15683:0:(import.c:65:import_set_state_nolock()) ffff9c84c3022800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1788574289.855244:0:15683:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788574289.855248:0:15683:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c84c36dc380 x1875455681671552/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788574307 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574289.855255:0:15683:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788574289.855259:0:15683:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 24s for inflight to error out 00000100:00100000:1.0:1788574289.859016:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1875455681671552:0@lo:38:kworker.0 00000100:00080000:2.0:1788574289.860641:0:15683:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788574289.860656:0:15683:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c84c335df80 x1875455681670912/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574292 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574289.860753:0:15683:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c84c3c09f80 x1875455681671040/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574293 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574289.861021:0:15683:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c84c3c0b800 x1875455681671296/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574297 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574289.861031:0:15683:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c84c335c380 x1875455681671424/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574302 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574289.861040:0:15683:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c84c36dd500 x1875455681671680/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574303 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574289.861047:0:15683:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c84c335c000 x1875455681671808/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788574298 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574289.861080:0:15683:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788574289.861087:0:15683:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788574289.861093:0:15683:0:(import.c:65:import_set_state_nolock()) ffff9c84c3283800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1788574289.861099:0:15683:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788574289.861104:0:15683:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c84c335df80 x1875455681670912/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574292 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574289.861153:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3618:1875455681671296:0@lo:400:kworker.0 00010000:00010000:0.0:1788574289.864027:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788574289.864043:0:6481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c85faea3c00/0x5bf8706fdac8bf29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5bf8706fdac8bf30 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574289.864055:0:6481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85faea3c00 already unused, calling callback (ffffffffc1472c20) 10000000:00010000:0.0:1788574289.864059:0:6481:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c85faea3c00/0x5bf8706fdac8bf29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5bf8706fdac8bf30 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574289.864070:0:6481:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c85faea3c00/0x5bf8706fdac8bf29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5bf8706fdac8bf30 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788574289.864077:0:6481:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c85faea3c00/0x5bf8706fdac8bf29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5bf8706fdac8bf30 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788574289.864083:0:6481:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788574289.864086:0:6481:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788574289.864089:0:6481:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788574289.864110:0:6481:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c85d0f82000 00010000:00010000:0.0:1788574289.864114:0:6481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c85faea3c00/0x5bf8706fdac8bf29 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5bf8706fdac8bf30 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574289.864142:0:6481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c85faea3c00/0x5bf8706fdac8bf29 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5bf8706fdac8bf30 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574289.864157:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574289.864159:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574289.864161:0:6481:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574289.864521:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3620:1875455681670912:0@lo:400:kworker.0 00000100:00100000:2.0:1788574289.864599:0:15683:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c84c3c09f80 x1875455681671040/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574293 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574289.864611:0:15683:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c84c3c0b800 x1875455681671296/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574297 ref 1 fl Complete:ENQU/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574289.864620:0:15683:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c84c335c380 x1875455681671424/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574302 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574289.864629:0:15683:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c84c36dd500 x1875455681671680/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574303 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574289.864636:0:15683:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c84c335c000 x1875455681671808/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788574298 ref 1 fl Interpret:ENQU/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574289.864644:0:15683:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788574289.864682:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3618:1875455681671040:0@lo:400:kworker.0 00000100:00100000:0.0:1788574289.867774:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3616:1875455681671808:0@lo:38:kworker.0 00000100:00100000:1.0:1788574289.868125:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3620:1875455681671680:0@lo:400:kworker.0 00000100:00100000:1.0:1788574289.868136:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3620:1875455681671424:0@lo:400:kworker.0 00000100:00100000:2.0:1788574289.868455:0:15683:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788574289.878121:0:15683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85faea2a00/0x5bf8706fdac8bf37 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8bf3e expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574289.878141:0:15683:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85faea2a00/0x5bf8706fdac8bf37 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8bf3e expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574289.878149:0:15683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85faea2a00/0x5bf8706fdac8bf37 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5bf8706fdac8bf3e expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574289.878155:0:15683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.151@tcp lock: ffff9c85faea2a00/0x5bf8706fdac8bf37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5bf8706fdac8bf3e expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574289.878182:0:15683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788574289.878208:0:15683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85fa32e800/0x5bf8706fdac8c1bb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8c1c2 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574289.878216:0:15683:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85fa32e800/0x5bf8706fdac8c1bb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8c1c2 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574289.878222:0:15683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85fa32e800/0x5bf8706fdac8c1bb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5bf8706fdac8c1c2 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574289.878228:0:15683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.151@tcp lock: ffff9c85fa32e800/0x5bf8706fdac8c1bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5bf8706fdac8c1c2 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574289.878268:0:15683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1788574289.878273:0:15683:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1788574289.878299:0:15683:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1788574289.878303:0:15683:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1788574289.878308:0:15683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788574289.878313:0:15683:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788574289.878317:0:15683:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff9c84c30399c0) has no exports 00000020:00080000:3.0:1788574289.878352:0:15683:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff9c84c30399c0) has no exports 00010000:00010000:1.0:1788574289.879564:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788574289.879577:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c85faea2a00/0x5bf8706fdac8bf37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5bf8706fdac8bf3e expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574289.879589:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85faea2a00 already unused, calling callback (ffffffffc1472c20) 10000000:00010000:1.0:1788574289.879592:0:6480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c85faea2a00/0x5bf8706fdac8bf37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5bf8706fdac8bf3e expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574289.879615:0:6480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c85faea2a00/0x5bf8706fdac8bf37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x5bf8706fdac8bf3e expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788574289.879622:0:6480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c85faea2a00/0x5bf8706fdac8bf37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x5bf8706fdac8bf3e expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788574289.879628:0:6480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788574289.879630:0:6480:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:1.0:1788574289.879633:0:6480:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:1.0:1788574289.879649:0:6480:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c85d0f82000 00010000:00010000:1.0:1788574289.879652:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c85faea2a00/0x5bf8706fdac8bf37 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x5bf8706fdac8bf3e expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574289.879658:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c85faea2a00/0x5bf8706fdac8bf37 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x5bf8706fdac8bf3e expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574289.879671:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788574289.879675:0:6480:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c85fa32e800/0x5bf8706fdac8c1bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5bf8706fdac8c1c2 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574289.879680:0:6480:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32e800 already unused, calling callback (ffffffffc1472c20) 10000000:00010000:1.0:1788574289.879683:0:6480:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c85fa32e800/0x5bf8706fdac8c1bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5bf8706fdac8c1c2 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574289.879689:0:6480:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c85fa32e800/0x5bf8706fdac8c1bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x5bf8706fdac8c1c2 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788574289.879695:0:6480:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c85fa32e800/0x5bf8706fdac8c1bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x5bf8706fdac8c1c2 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788574289.879709:0:6480:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788574289.879711:0:6480:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788574289.879713:0:6480:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788574289.879719:0:6480:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c85d0f82000 00010000:00010000:1.0:1788574289.879722:0:6480:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c85fa32e800/0x5bf8706fdac8c1bb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x5bf8706fdac8c1c2 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574289.879727:0:6480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c85fa32e800/0x5bf8706fdac8c1bb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x5bf8706fdac8c1c2 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574289.879740:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574289.879742:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574289.879743:0:6480:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574289.882854:0:7444:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788574289.886061:0:15683:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c84c33110c0 - data ffff9c84c1c09000/ffff9c85fafe7000 00000020:01000000:3.0:1788574289.890204:0:15683:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c84c10bcea0 - data ffff9c85def52360/ffff9c85f7fc2800 00100000:10000000:1.0:1788574289.907147:0:15683:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788574289.936519:0:15683:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8bdcb 00000020:00000080:0.0:1788574289.936534:0:15683:0:(genops.c:885:class_export_put()) final put ffff9c84c2384000/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1788574289.936561:0:15683:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c85f7fb1000 from lustre-OST0001, refs=2 00000020:01000004:0.0:1788574289.936565:0:15683:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c85f7fb1000 2 00000020:01000004:0.0:1788574289.936569:0:15683:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c85f7fb1000 from lustre-OST0001 00000020:00000080:0.0:1788574289.936600:0:15683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788574289.936612:0:15683:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1788574289.936615:0:15683:0:(genops.c:885:class_export_put()) final put ffff9c84c2381800/lustre-OST0001_UUID 00000020:00000080:0.0:1788574289.936618:0:15683:0:(genops.c:844:class_export_destroy()) destroying export ffff9c84c2381800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1788574289.936624:0:15683:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000020:00000080:3.0:1788574289.936873:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c84c2384000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00080000:0.0:1788574289.940445:0:15683:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 69505170-06bc-41d1-9626-ab1a3c7f32a0->MGS 00010000:00010000:0.0:1788574289.940469:0:15683:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6c00/0x5bf8706fdac8bb24 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5bf8706fdac8bb2b expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788574289.940485:0:15683:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6c00/0x5bf8706fdac8bb24 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5bf8706fdac8bb2b expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788574289.940491:0:15683:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1788574289.940494:0:15683:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1788574289.940498:0:15683:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1788574289.940514:0:15683:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c85d0f82000 00010000:00010000:0.0:1788574289.940519:0:15683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6c00/0x5bf8706fdac8bb24 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5bf8706fdac8bb2b expref: -99 pid: 7421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574289.940556:0:15683:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c85faea2400/0x5bf8706fdac8bf99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5bf8706fdac8bfa0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788574289.940562:0:15683:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c85faea2400/0x5bf8706fdac8bf99 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5bf8706fdac8bfa0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788574289.940567:0:15683:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788574289.940570:0:15683:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1788574289.940571:0:15683:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1788574289.940592:0:15683:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c85d0f82000 00010000:00010000:0.0:1788574289.940595:0:15683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c85faea2400/0x5bf8706fdac8bf99 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5bf8706fdac8bfa0 expref: -99 pid: 6490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788574289.940613:0:15683:0:(import.c:65:import_set_state_nolock()) ffff9c85d0f82000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1788574289.940617:0:15683:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788574289.940620:0:15683:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788574289.940621:0:15683:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1788574289.940626:0:15683:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788574289.940637:0:15683:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c84c3c09880 x1875455681671168/t0(0) o250->MGC192.168.204.151@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788574296 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1788574289.940660:0:15683:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1788574289.940663:0:15683:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000100:00100000:2.0:1788574289.940744:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c09880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:69505170-06bc-41d1-9626-ab1a3c7f32a0:3616:1875455681671168:0@lo:250:kworker.0 10000000:01000000:0.0:1788574289.941386:0:15683:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1788574289.941399:0:15683:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8ba21 00000020:00000080:0.0:1788574289.941408:0:15683:0:(genops.c:885:class_export_put()) final put ffff9c85c8a35000/69505170-06bc-41d1-9626-ab1a3c7f32a0 00000020:01000000:0.0:1788574289.941428:0:15683:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.204.151@tcp (flags='') 00000020:00000080:0.0:1788574289.941436:0:15683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788574289.941444:0:15683:0:(obd_config.c:956:class_cleanup()) MGC192.168.204.151@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788574289.941448:0:15683:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9c85e56999c0) has no exports 00000020:00000080:3.0:1788574289.941608:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85c8a35000/69505170-06bc-41d1-9626-ab1a3c7f32a0 for MGC192.168.204.151@tcp 10000000:01000000:2.0:1788574289.942079:0:6490:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1788574289.942315:0:15683:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.204.151@tcp: client import never connected 00000100:00080000:0.0:1788574289.942345:0:15683:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1788574289.942349:0:15683:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1788574289.942352:0:15683:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1788574289.942355:0:15683:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788574289.942404:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c85d0f82000 for MGC192.168.204.151@tcp 00000020:00000080:0.0:1788574289.942407:0:15683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788574289.942416:0:15683:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.151@tcp (uuid 69505170-06bc-41d1-9626-ab1a3c7f32a0) 00000020:00000080:0.0:1788574289.942421:0:15683:0:(genops.c:885:class_export_put()) final put ffff9c85d0f83800/69505170-06bc-41d1-9626-ab1a3c7f32a0 00000020:00000080:0.0:1788574289.942424:0:15683:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85d0f83800/69505170-06bc-41d1-9626-ab1a3c7f32a0 for MGC192.168.204.151@tcp 00000020:01000000:0.0:1788574289.942435:0:15683:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.151@tcp (69505170-06bc-41d1-9626-ab1a3c7f32a0) 00000020:01000000:0.0:1788574289.942700:0:15683:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1788574289.942705:0:15683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788574289.942710:0:15683:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788574289.942716:0:15683:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9c84c3027800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788574289.942720:0:15683:0:(genops.c:1553:class_disconnect_exports()) OBD device 25 (ffff9c85faf48000) has exports, disconnecting them 00000020:00080000:0.0:1788574289.942725:0:15683:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9c84c3027800), last request at 1788574054 00000020:00000080:0.0:1788574289.942729:0:15683:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8bdf5 00000020:00080000:0.0:1788574289.942740:0:15683:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c84c3027800): rc 0 00000020:00000080:0.0:1788574289.942744:0:15683:0:(genops.c:885:class_export_put()) final put ffff9c84c3027800/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1788574289.944922:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c84c3027800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1788574289.948347:0:15683:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1788574289.948355:0:15683:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788574289.948360:0:15683:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788574289.948368:0:15683:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788574289.948429:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c84c3022800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1788574289.948613:0:15683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788574289.948634:0:15683:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1788574289.948640:0:15683:0:(genops.c:885:class_export_put()) final put ffff9c84c3025000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1788574289.948645:0:15683:0:(genops.c:844:class_export_destroy()) destroying export ffff9c84c3025000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1788574289.948658:0:15683:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:2.0:1788574289.948729:0:15683:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1788574289.948734:0:15683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788574289.948739:0:15683:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788574289.948745:0:15683:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff9c84c3286000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788574289.948751:0:15683:0:(genops.c:1553:class_disconnect_exports()) OBD device 26 (ffff9c84c2708000) has exports, disconnecting them 00000020:00080000:2.0:1788574289.948756:0:15683:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff9c84c3286000), last request at 1788574054 00000020:00000080:2.0:1788574289.948760:0:15683:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8be0a 00000020:00080000:2.0:1788574289.948775:0:15683:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c84c3286000): rc 0 00000020:00000080:2.0:1788574289.948780:0:15683:0:(genops.c:885:class_export_put()) final put ffff9c84c3286000/lustre-MDT0001-lwp-OST0001 00000020:00000080:3.0:1788574289.948907:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c84c3286000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:3.0:1788574289.949586:0:15683:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:3.0:1788574289.949591:0:15683:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788574289.949594:0:15683:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788574289.949599:0:15683:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788574289.949618:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c84c3283800 for lustre-MDT0001-lwp-OST0001 00010000:00010000:3.0:1788574289.960353:0:6481:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1788574289.960970:0:6480:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:3.0:1788574289.962250:0:7444:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:3.0:1788574289.962558:0:6476:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9c8600247600:6476] 1 exiting: rc = 0 00000100:00100000:3.0:1788574289.962618:0:6475:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9c8600246800:6475] 0 exiting: rc = 1 00000100:00100000:3.0:1788574289.964323:0:10311:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff9c84c36e9e00:10311] 2 exiting: rc = 0 00000100:00100000:3.0:1788574289.964522:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574289.964827:0:7433:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9c85fa288000:7433] 3 exiting: rc = 0 00000100:00100000:0.0:1788574289.965379:0:6479:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9c8600247c00:6479] 2 exiting: rc = 0 00000100:00100000:0.0:1788574289.965970:0:6477:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9c8600247a00:6477] 0 exiting: rc = 1 00000100:00100000:0.0:1788574289.966114:0:6478:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9c8600246400:6478] 1 exiting: rc = 0 00000100:00100000:3.0:1788574289.966248:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574289.966256:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574289.966261:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574289.966267:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574289.966276:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574289.966283:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574289.966290:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574289.966297:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574289.966302:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574289.966307:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574289.966312:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574289.966319:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574289.966324:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574289.966331:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574289.966566:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574289.966572:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574289.966577:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574289.966583:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574289.966589:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574289.966594:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574289.966600:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574289.966605:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574289.966609:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574289.966615:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574289.966619:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574289.966624:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574289.966629:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574289.966633:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574289.966638:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574289.966643:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574289.966648:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574289.966653:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574289.966658:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574289.966663:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574289.966677:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574289.966682:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574289.966687:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574289.966691:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574289.966696:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574289.966702:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574289.966707:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574289.966712:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574289.966717:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574289.966722:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574289.966727:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574289.966732:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574289.966737:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574289.966743:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574289.966748:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574289.966753:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574289.966758:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574289.966764:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574289.966768:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574289.966773:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574289.966777:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574289.966783:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574289.966788:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574289.966793:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574289.966798:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574289.966803:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574289.966808:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574289.966812:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574289.966817:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788574289.966822:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788574289.967972:0:15683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788574289.967984:0:15683:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:3.0:1788574289.967989:0:15683:0:(genops.c:885:class_export_put()) final put ffff9c84c3281000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:3.0:1788574289.967993:0:15683:0:(genops.c:844:class_export_destroy()) destroying export ffff9c84c3281000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:3.0:1788574289.968000:0:15683:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:3.0:1788574289.968057:0:15683:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c85f7fb1000 1 00000020:00000080:3.0:1788574289.968063:0:15683:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5bf8706fdac8bd9a 00000020:00000080:3.0:1788574289.968070:0:15683:0:(genops.c:885:class_export_put()) final put ffff9c85fadd3800/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1788574289.968083:0:15683:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1788574289.968095:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85fadd3800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1788574289.968116:0:15683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788574289.968122:0:15683:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788574289.968126:0:15683:0:(genops.c:1558:class_disconnect_exports()) OBD device 23 (ffff9c84c27099c0) has no exports 00000020:00000080:3.0:1788574290.019749:0:15683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788574290.019765:0:15683:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1788574290.019771:0:15683:0:(genops.c:885:class_export_put()) final put ffff9c85f7fb4000/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1788574290.019776:0:15683:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85f7fb4000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1788574290.019788:0:15683:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1788574290.020131:0:15683:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9c85f7fb4800 00000020:01000000:3.0:1788574290.020156:0:15683:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1788574290.020161:0:15683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788574290.020165:0:15683:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788574290.020168:0:15683:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9c8600d5b380) has no exports 00000020:00000080:3.0:1788574290.020233:0:15683:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788574290.020239:0:15683:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1788574290.020242:0:15683:0:(genops.c:885:class_export_put()) final put ffff9c85faec6000/OSS_uuid 00000020:00000080:3.0:1788574290.020245:0:15683:0:(genops.c:844:class_export_destroy()) destroying export ffff9c85faec6000/OSS_uuid for OSS 00000020:01000000:3.0:1788574290.020250:0:15683:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:1.0:1788574290.020417:0:8409:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9c85f6f37800:8409] 0 exiting: rc = 1 00000100:00080000:0.0:1788574290.020434:0:6488:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1788574290.020484:0:8411:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9c85fad14600:8411] 2 exiting: rc = 0 00000100:00100000:0.0:1788574290.020563:0:8410:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9c85fa25bc00:8410] 1 exiting: rc = 0 00000100:00100000:3.0:1788574290.024466:0:13791:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff9c84c24e7600:13791] 4 exiting: rc = 0 00000100:00100000:2.0:1788574290.024766:0:8815:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9c85f6f36e00:8815] 3 exiting: rc = 0 00000100:00100000:1.0:1788574290.024863:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.024872:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.024878:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.024884:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.024890:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.024894:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.024900:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.024905:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.024909:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.024915:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.024920:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.024925:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.024930:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.024935:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.024940:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.024962:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.024966:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.024971:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.024977:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.024983:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.024988:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.024993:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.024998:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.025003:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.025009:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.025015:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.025021:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.025027:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.025032:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.025036:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.025041:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.025046:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.025051:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.025056:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.025062:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.025069:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.025074:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.025079:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.025085:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.025090:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.025094:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.025100:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.025105:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.025110:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.025115:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.025120:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.025125:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.025130:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.025136:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.025140:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.025154:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.025159:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.025164:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.025170:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.025175:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.025181:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.025186:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.025214:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.025220:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.025226:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.025231:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.025236:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.025241:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.025254:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.030182:0:8412:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9c8600174a00:8412] 0 exiting: rc = 1 00000100:00100000:1.0:1788574290.031441:0:8413:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9c85fa0e3000:8413] 1 exiting: rc = 0 00000100:00100000:2.0:1788574290.038777:0:14401:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9c84c2388e00:14401] 2 exiting: rc = 0 00000100:00100000:0.0:1788574290.040765:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.040779:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.040788:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.040795:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.040800:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.040805:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.040827:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.040833:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.040839:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.040844:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.040849:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.040854:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.040859:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.040864:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.040870:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.040876:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.041103:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.041113:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.041118:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.041123:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.041128:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.041132:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.041137:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.041141:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.041145:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.041149:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.041155:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.041159:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.041164:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.041169:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.041174:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.041179:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.041184:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.041208:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.041215:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.041219:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.041223:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.041228:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.041233:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.041238:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.041243:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.041257:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.041262:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.041268:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.041272:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.041277:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.041282:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.041289:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.041294:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.041298:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.041303:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.041308:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.041313:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.041318:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.041323:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.041328:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.041350:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.041356:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.041360:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.041364:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.041369:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.041374:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.041378:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.041385:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788574290.042553:0:8415:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9c8600ccc600:8415] 1 exiting: rc = 0 00000100:00100000:1.0:1788574290.042797:0:8416:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9c8600ccc200:8416] 2 exiting: rc = 0 00000100:00100000:0.0:1788574290.043678:0:8414:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9c8600ccc800:8414] 0 exiting: rc = 1 00000100:00100000:1.0:1788574290.049597:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.049610:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.049617:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.049622:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.049628:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.049648:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.049656:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.049662:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.049668:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.049673:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.049679:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.049685:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.049692:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.049698:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.049703:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.049709:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.049714:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.049720:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.049725:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.049746:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.049753:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.049760:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.049766:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.049771:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.049776:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.049782:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.049788:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.049794:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.049801:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.049821:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.049829:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.049834:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.049839:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.049845:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.049851:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.049857:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.049862:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.049868:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.049874:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.049880:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.049886:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.049892:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.049897:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.049903:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.049908:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.049913:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.049918:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.049924:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.049929:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.049934:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.049940:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.049949:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.049954:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.049975:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.049990:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.049996:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.050002:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.050007:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.050012:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.050017:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.050023:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.050038:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.050046:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.050058:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.063019:0:8418:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9c85ec19ea00:8418] 1 exiting: rc = 0 00000100:00100000:3.0:1788574290.063101:0:8417:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9c8600ccd200:8417] 0 exiting: rc = 1 00000100:00100000:1.0:1788574290.064407:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.064417:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.064422:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.064428:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.064434:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.064439:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.064445:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.064512:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.064522:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.064560:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.064566:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.064572:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.064577:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.064582:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.064586:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.064591:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.064595:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.064600:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.064605:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.064610:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.064614:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.064619:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.064623:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.064628:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.064633:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.064658:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.064663:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.064668:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.064673:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.064677:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.064682:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.064688:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.064694:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.064700:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.064707:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.064715:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.064724:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.064729:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.064742:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.064749:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.064755:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.064765:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.064772:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.064777:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.064783:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.064788:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.064794:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.064800:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.064805:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.064810:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.064814:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.064819:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.064825:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.064830:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.064834:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.064839:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.064849:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.064855:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.064860:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.064865:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.064877:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.064882:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.064888:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788574290.064894:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.070743:0:8420:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9c85f6f3b000:8420] 1 exiting: rc = 0 00000100:00100000:3.0:1788574290.074640:0:8419:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9c85f6f3a400:8419] 0 exiting: rc = 1 00000100:00100000:0.0:1788574290.075073:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.075082:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.075090:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.075096:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.075102:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.075109:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.075129:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.075137:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.075156:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.075162:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.075168:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.075186:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.075211:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.075218:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.075225:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.075235:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.075250:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.075256:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.075277:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.075284:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.075290:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.075296:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.075302:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.075307:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.075314:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.075322:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.075329:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.075348:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.075357:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.075366:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.075396:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.075404:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.075410:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.075415:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.075421:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.075427:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.075432:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.075437:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.075443:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.075449:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.075465:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.075470:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.075490:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.075503:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.075509:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.075515:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.075520:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.075526:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.075532:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.075537:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.075543:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.075548:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.075553:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.075559:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.075577:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.075583:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.075589:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.075595:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.075601:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.075608:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.075614:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.075620:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.075626:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788574290.075645:0:15683:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1788574290.084090:0:15683:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1788574309.448834:0:16446:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg451-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1788574319.858229:0:17046:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788574319.858236:0:17046:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1788574319.858238:0:17046:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1788574319.858350:0:17046:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9c84c3fd7800 00000020:01000004:3.0:1788574319.858366:0:17046:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1788574319.858375:0:17046:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788574319.858403:0:17046:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9c84c27099c0) 00000020:00000080:3.0:1788574319.858418:0:17046:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788574319.950976:0:17046:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788574319.957272:0:17046:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1788574319.969649:0:17046:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788574319.970265:0:17046:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1788574319.970667:0:17046:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788574319.971118:0:17046:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1788574319.971599:0:17046:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788574319.971981:0:17046:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1788574319.972297:0:17046:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1788574319.972611:0:17046:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1788574319.973043:0:17046:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1788574319.973452:0:17046:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1788574319.973669:0:17046:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1788574319.974058:0:17046:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1788574319.977875:0:17046:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1788574319.981999:0:17046:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1788574319.982790:0:17046:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:1.0:1788574319.983027:0:17046:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1788574319.983302:0:17046:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1788574319.983616:0:17046:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1788574319.983871:0:17046:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:1.0:1788574319.984071:0:17046:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1788574319.984443:0:17046:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1788574319.984640:0:17046:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1788574319.984886:0:17046:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1788574319.985071:0:17046:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1788574319.985426:0:17046:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1788574319.985631:0:17046:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:1.0:1788574319.985879:0:17046:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1788574319.986069:0:17046:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:1.0:1788574319.986493:0:17046:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1788574319.986773:0:17046:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1788574319.986990:0:17046:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:1.0:1788574319.988808:0:17046:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:1.0:1788574319.989886:0:17046:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1788574319.991287:0:17046:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:1.0:1788574319.993901:0:17046:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:1.0:1788574319.995260:0:17046:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:1.0:1788574319.996306:0:17046:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:1.0:1788574319.997358:0:17046:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1788574319.998272:0:17046:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1788574319.999244:0:17046:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1788574320.001456:0:17046:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1788574320.002525:0:17046:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:1.0:1788574320.003122:0:17046:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:1.0:1788574320.003511:0:17046:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:1.0:1788574320.004657:0:17046:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:1.0:1788574320.009957:0:17046:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:1.0:1788574320.011028:0:17046:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:1.0:1788574320.011370:0:17046:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:1.0:1788574320.012170:0:17046:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:1.0:1788574320.012414:0:17046:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:1.0:1788574320.012605:0:17046:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00080000:01000000:0.0:1788574320.021278:0:17046:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788574320.023722:0:17046:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1788574320.023733:0:17046:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788574320.023747:0:17046:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5bf8706fdac8cfde 00000020:01000004:0.0:1788574320.024269:0:17046:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1788574320.024277:0:17046:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1788574320.024283:0:17046:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c84c3fd7800 from MGS 00000020:01000004:0.0:1788574320.024287:0:17046:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1788574320.024301:0:17046:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9c85faf4b380) 00000020:00000080:0.0:1788574320.024314:0:17046:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1788574320.024891:0:17046:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c84c3fd7800 from MGS, refs=2 00080000:01000000:0.0:1788574320.024899:0:17046:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788574320.024906:0:17046:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5bf8706fdac8cfec 00000100:00100000:0.0:1788574320.025041:0:17046:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1788574320.025932:0:17046:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1788574320.025943:0:17046:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1788574320.030897:0:17046:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1788574320.030913:0:17046:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1788574320.037027:0:17046:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788574320.038684:0:17046:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1788574320.038699:0:17046:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1788574320.039683:0:17046:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1788574320.039693:0:17046:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1788574320.040430:0:17046:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1788574320.040438:0:17046:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1788574320.041741:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574320.041747:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574320.041749:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574320.045970:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574320.045977:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574320.045980:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574320.051421:0:17046:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1788574320.053412:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1788574320.059230:0:17046:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1788574320.061013:0:17058:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788574320.061095:0:17046:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788574320.061133:0:17046:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788574320.062040:0:17046:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788574320.062717:0:17046:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788574320.063649:0:17046:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788574320.063657:0:17046:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1788574320.072455:0:17046:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788574320.094944:0:17046:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788574320.095675:0:17046:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788574320.095686:0:17046:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1788574320.098883:0:17046:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788574320.098912:0:17046:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.151@tcp' 00000020:01000004:0.0:1788574320.098914:0:17046:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1788574320.098948:0:17046:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.151@tcp (typ=mgc) 00000020:00000080:0.0:1788574320.098963:0:17046:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.151@tcp (ffff9c85faf48000) 00000020:00000080:0.0:1788574320.098978:0:17046:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1788574320.099114:0:17046:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c84c446a000@MGC192.168.204.151@tcp: add connection 192.168.204.151@tcp at head 00010000:00010000:0.0:1788574320.099337:0:17046:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.151@tcp-0 is initialized 00000040:01000000:0.0:1788574320.099344:0:17046:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.151@tcp ctxt 1 is initialized 10000000:01000000:3.0:1788574320.102614:0:17064:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1788574320.102778:0:17046:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.151@tcp (uuid f73678fb-d8c0-450f-a73b-e6565942045e) 00000020:00000080:0.0:1788574320.102803:0:17046:0:(genops.c:1385:class_connect()) connect: client f73678fb-d8c0-450f-a73b-e6565942045e, cookie 0x5bf8706fdac8cffa 00000100:00080000:0.0:1788574320.103078:0:17046:0:(import.c:545:import_select_connection()) MGC192.168.204.151@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788574320.103087:0:17046:0:(import.c:665:import_select_connection()) MGC192.168.204.151@tcp: import ffff9c84c446a000 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:0.0:1788574320.103122:0:17046:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c84c36de300 x1875455681671936/t0(0) o250->MGC192.168.204.151@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788574320.103153:0:17046:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import f73678fb-d8c0-450f-a73b-e6565942045e->MGS 00000020:01000004:0.0:1788574320.103173:0:17046:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1788574320.103178:0:17046:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1788574320.103212:0:17046:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9c85faf4cd40) 00000020:00000080:0.0:1788574320.103225:0:17046:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1788574320.106479:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f73678fb-d8c0-450f-a73b-e6565942045e:3616:1875455681671936:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788574320.106571:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574320.106748:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681671936 00000100:00100000:2.0:1788574320.106768:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681671936 00000100:00100000:2.0:1788574320.106806:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788574320.106814:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3267850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3616:x1875455681671936:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1788574320.106843:0:17060:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from f73678fb-d8c0-450f-a73b-e6565942045e@0@lo t0 exp 0000000000000000 cur 460 last 0 00000020:00000080:2.0:1788574320.106875:0:17060:0:(genops.c:1385:class_connect()) connect: client f73678fb-d8c0-450f-a73b-e6565942045e, cookie 0x5bf8706fdac8d008 00000100:00080000:2.0:1788574320.107014:0:17060:0:(import.c:65:import_set_state_nolock()) ffff9c84c3ece000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788574320.107073:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3267850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f73678fb-d8c0-450f-a73b-e6565942045e+5:3616:x1875455681671936:12345-0@lo:250:mount.lustre.0 Request processed in 257us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574320.107081:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788574320.107129:0:3616:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.204.151@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1788574320.107138:0:3616:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.204.151@tcp: connect to target with instance 0 00000100:00080000:2.0:1788574320.107146:0:3616:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.204.151@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1788574320.107151:0:3616:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1788574320.107154:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c84c446a000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1788574320.107157:0:3616:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1788574320.107166:0:3616:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1788574320.107171:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f73678fb-d8c0-450f-a73b-e6565942045e:3616:1875455681671936:0@lo:250:mount.lustre.0 00000100:00080000:2.0:1788574320.107442:0:17063:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:0.0:1788574320.120527:0:17046:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788574320.120865:0:17046:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1788574320.120872:0:17046:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1788574320.122725:0:17046:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1788574320.122737:0:17046:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1788574320.123085:0:17046:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1788574320.123091:0:17046:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1788574320.123877:0:17046:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788574320.124038:0:17046:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1788574320.124042:0:17046:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1788574320.130464:0:17046:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1788574320.130477:0:17046:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788574320.183784:0:17046:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788574320.184032:0:17046:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788574320.184039:0:17046:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788574320.185890:0:17046:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788574320.185904:0:17046:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1788574320.186685:0:17046:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788574320.186885:0:17046:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788574320.186890:0:17046:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1788574320.187474:0:17046:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788574320.187482:0:17046:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1788574320.187993:0:17046:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788574320.188160:0:17046:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788574320.188165:0:17046:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1788574320.188802:0:17046:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788574320.188810:0:17046:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788574320.189818:0:17046:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788574320.189988:0:17046:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788574320.189994:0:17046:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1788574320.190700:0:17046:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788574320.190714:0:17046:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1788574320.216607:0:17046:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788574320.216958:0:17046:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788574320.216965:0:17046:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1788574320.220422:0:17046:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788574320.220438:0:17046:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1788574320.234170:0:17046:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788574320.234214:0:17046:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1788574320.236523:0:17046:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1788574320.236555:0:17046:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1788574320.236563:0:17046:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.151@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1788574320.236702:0:17046:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.151@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788574320.236743:0:17046:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.151@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1788574320.236747:0:17046:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788574320.236748:0:17046:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788574320.237468:0:17046:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788574320.237471:0:17046:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788574320.237472:0:17046:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788574320.237474:0:17046:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788574320.237476:0:17046:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788574320.237478:0:17046:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788574320.237479:0:17046:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788574320.237481:0:17046:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788574320.237484:0:17046:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1788574320.237486:0:17046:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788574320.237488:0:17046:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788574320.237489:0:17046:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788574320.237490:0:17046:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788574320.237492:0:17046:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788574320.237493:0:17046:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788574320.237494:0:17046:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788574320.237495:0:17046:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788574320.237496:0:17046:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788574320.237497:0:17046:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788574320.239876:0:17046:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788574320.239902:0:17046:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:17046:1875455681672064:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788574320.239988:0:17046:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574320.240103:0:17046:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85d0174900 going to sleep for 11 seconds 00000100:00100000:3.0:1788574320.240557:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681672064 00000100:00100000:3.0:1788574320.240565:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681672064 00000100:00100000:3.0:1788574320.240628:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788574320.240637:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3265050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f73678fb-d8c0-450f-a73b-e6565942045e+5:17046:x1875455681672064:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788574320.240686:0:17062:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788574320.240689:0:17062:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788574320.240692:0:17062:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1788574320.240994:0:17083:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1788574320.241689:0:17062:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:0.0:1788574320.246862:0:17084:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1788574320.246871:0:17084:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:0.0:1788574320.246875:0:17084:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1788574320.246877:0:17084:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1788574320.247100:0:17084:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:3.0:1788574320.247641:0:17062:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788574320.247652:0:17062:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788574320.249654:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3265050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f73678fb-d8c0-450f-a73b-e6565942045e+5:17046:x1875455681672064:12345-0@lo:253:mount.lustre.0 Request processed in 9007us (9655us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574320.249670:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788574320.249842:0:17046:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:17046:1875455681672064:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788574320.249859:0:17046:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788574320.249863:0:17046:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788574320.249865:0:17046:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788574320.249866:0:17046:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788574320.249867:0:17046:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788574320.249868:0:17046:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788574320.249869:0:17046:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788574320.249871:0:17046:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788574320.249872:0:17046:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788574320.249886:0:17046:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788574320.249888:0:17046:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788574320.249908:0:17046:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c84c3fd7800 from lustre-MDT0000 10000000:01000000:0.0:1788574320.249939:0:17046:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1788574320.249942:0:17046:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788574320.249947:0:17046:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9c85faf48000 10000000:01000000:0.0:1788574320.249952:0:17046:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788574320.249960:0:17046:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9c85faf48000 from 1 10000000:01000000:0.0:1788574320.249963:0:17046:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788574320.250003:0:17046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6800/0x5bf8706fdac8d00f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574320.250015:0:17046:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6800/0x5bf8706fdac8d00f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574320.250024:0:17046:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6800/0x5bf8706fdac8d00f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574320.250045:0:17046:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:17046:1875455681672192:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788574320.250164:0:17046:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574320.250296:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681672192 00000100:00100000:0.0:1788574320.250445:0:17046:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85d0174300 going to sleep for 11 seconds 00000100:00100000:2.0:1788574320.250478:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681672192 00000100:00100000:2.0:1788574320.250657:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788574320.250667:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3265c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f73678fb-d8c0-450f-a73b-e6565942045e+5:17046:x1875455681672192:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788574320.250679:0:17061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574320.250695:0:17061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85fa32e400/0x5bf8706fdac8d016 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8d00f expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574320.250735:0:17061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85fa32e400/0x5bf8706fdac8d016 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8d00f expref: 6 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574320.250745:0:17061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85fa32e400/0x5bf8706fdac8d016 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8d00f expref: 6 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574320.250854:0:17061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85fa32e400, rc 0) 00000100:00100000:2.0:1788574320.250941:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3265c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f73678fb-d8c0-450f-a73b-e6565942045e+6:17046:x1875455681672192:12345-0@lo:101:mount.lustre.0 Request processed in 276us (777us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574320.250948:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788574320.251020:0:17046:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:17046:1875455681672192:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788574320.251035:0:17046:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6800/0x5bf8706fdac8d00f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d016 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574320.251045:0:17046:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6800/0x5bf8706fdac8d00f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8d016 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574320.251186:0:17046:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:17046:1875455681672320:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788574320.251237:0:17046:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574320.251327:0:17046:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85d0174300 going to sleep for 11 seconds 00000100:00100000:3.0:1788574320.251468:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681672320 00000100:00100000:3.0:1788574320.251473:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681672320 00000100:00100000:3.0:1788574320.251572:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788574320.251582:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3265450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f73678fb-d8c0-450f-a73b-e6565942045e+6:17046:x1875455681672320:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788574320.251676:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3265450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f73678fb-d8c0-450f-a73b-e6565942045e+6:17046:x1875455681672320:12345-0@lo:501:mount.lustre.0 Request processed in 96us (438us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788574320.251682:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788574320.251774:0:17046:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:17046:1875455681672320:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788574320.251813:0:17046:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788574320.251838:0:17046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6800/0x5bf8706fdac8d00f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d016 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574320.251847:0:17046:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6800/0x5bf8706fdac8d00f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d016 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788574320.251856:0:17046:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c84c3fd7800 10000000:01000000:1.0:1788574320.251862:0:17046:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788574320.251866:0:17046:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9c84c3fd7800 10000000:01000000:1.0:1788574320.251868:0:17046:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788574320.251872:0:17046:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9c84c3fd7800 from 1 10000000:01000000:1.0:1788574320.251874:0:17046:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788574320.251898:0:17046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d08a3c00/0x5bf8706fdac8d01d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574320.251905:0:17046:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c85d08a3c00/0x5bf8706fdac8d01d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574320.251915:0:17046:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c85d08a3c00/0x5bf8706fdac8d01d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574320.251929:0:17046:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:17046:1875455681672448:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788574320.251956:0:17046:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574320.252338:0:17046:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c6a78000 going to sleep for 11 seconds 00000100:00100000:0.0:1788574320.252487:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681672448 00000100:00100000:0.0:1788574320.252493:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681672448 00000100:00100000:0.0:1788574320.252531:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788574320.252538:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3266850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f73678fb-d8c0-450f-a73b-e6565942045e+6:17046:x1875455681672448:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788574320.252547:0:17060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574320.252560:0:17060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85d20d7400/0x5bf8706fdac8d024 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8d01d expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574320.252580:0:17060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85d20d7400/0x5bf8706fdac8d024 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8d01d expref: 7 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574320.252589:0:17060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85d20d7400/0x5bf8706fdac8d024 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8d01d expref: 7 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574320.252596:0:17060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d20d7400, rc 0) 00000100:00100000:0.0:1788574320.252629:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3266850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f73678fb-d8c0-450f-a73b-e6565942045e+7:17046:x1875455681672448:12345-0@lo:101:mount.lustre.0 Request processed in 91us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574320.252634:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788574320.252864:0:17046:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:17046:1875455681672448:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788574320.252879:0:17046:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c85d08a3c00/0x5bf8706fdac8d01d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d024 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574320.252889:0:17046:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c85d08a3c00/0x5bf8706fdac8d01d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8d024 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788574320.252912:0:17046:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788574320.252922:0:17046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d08a3c00/0x5bf8706fdac8d01d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d024 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574320.252929:0:17046:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c85d08a3c00/0x5bf8706fdac8d01d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d024 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788574320.252936:0:17046:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788574320.252939:0:17046:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788574320.252944:0:17046:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9c84c3fd7800 10000000:01000000:1.0:1788574320.252947:0:17046:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788574320.252950:0:17046:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1788574320.252952:0:17046:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788574320.252969:0:17046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d08a3e00/0x5bf8706fdac8d02b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574320.252977:0:17046:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c85d08a3e00/0x5bf8706fdac8d02b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574320.252985:0:17046:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c85d08a3e00/0x5bf8706fdac8d02b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574320.253001:0:17046:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:17046:1875455681672576:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788574320.253030:0:17046:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574320.253064:0:17046:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c6a78000 going to sleep for 11 seconds 00000100:00100000:3.0:1788574320.253184:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681672576 00000100:00100000:3.0:1788574320.253212:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681672576 00000100:00100000:3.0:1788574320.253245:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788574320.253252:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3265850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f73678fb-d8c0-450f-a73b-e6565942045e+7:17046:x1875455681672576:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788574320.253260:0:17062:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574320.253271:0:17062:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c84c2617e00/0x5bf8706fdac8d032 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8d02b expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574320.253484:0:17062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c84c2617e00/0x5bf8706fdac8d032 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8d02b expref: 8 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574320.253495:0:17062:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c84c2617e00/0x5bf8706fdac8d032 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8d02b expref: 8 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574320.253513:0:17062:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c84c2617e00, rc 0) 00000100:00100000:3.0:1788574320.253552:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3265850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f73678fb-d8c0-450f-a73b-e6565942045e+8:17046:x1875455681672576:12345-0@lo:101:mount.lustre.0 Request processed in 301us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574320.253558:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788574320.253672:0:17046:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:17046:1875455681672576:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788574320.253685:0:17046:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c85d08a3e00/0x5bf8706fdac8d02b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d032 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574320.253700:0:17046:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c85d08a3e00/0x5bf8706fdac8d02b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8d032 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574320.253837:0:17046:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:17046:1875455681672704:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788574320.253864:0:17046:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574320.253894:0:17046:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c6a78000 going to sleep for 11 seconds 00000100:00100000:0.0:1788574320.253938:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681672704 00000100:00100000:0.0:1788574320.253942:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681672704 00000100:00100000:0.0:1788574320.253971:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788574320.253977:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3267c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f73678fb-d8c0-450f-a73b-e6565942045e+8:17046:x1875455681672704:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788574320.254119:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3267c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f73678fb-d8c0-450f-a73b-e6565942045e+9:17046:x1875455681672704:12345-0@lo:501:mount.lustre.0 Request processed in 142us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574320.254125:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788574320.254320:0:17046:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:17046:1875455681672704:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788574320.254476:0:17046:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:17046:1875455681672832:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788574320.254531:0:17046:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574320.254559:0:17046:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c6a78000 going to sleep for 11 seconds 00000100:00100000:0.0:1788574320.254689:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681672832 00000100:00100000:0.0:1788574320.254694:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681672832 00000100:00100000:0.0:1788574320.254714:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788574320.254727:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3266450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f73678fb-d8c0-450f-a73b-e6565942045e+9:17046:x1875455681672832:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788574320.255597:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3266450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f73678fb-d8c0-450f-a73b-e6565942045e+9:17046:x1875455681672832:12345-0@lo:503:mount.lustre.0 Request processed in 867us (1062us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574320.255608:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788574320.256239:0:17046:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:17046:1875455681672832:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788574320.257648:0:17085:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f73678fb-d8c0-450f-a73b-e6565942045e:17085:1875455681672960:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788574320.257726:0:17085:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574320.257879:0:17085:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c6a78000 going to sleep for 11 seconds 00000100:00100000:0.0:1788574320.257924:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681672960 00000100:00100000:0.0:1788574320.257932:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681672960 00000100:00100000:0.0:1788574320.258018:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788574320.258028:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3264c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f73678fb-d8c0-450f-a73b-e6565942045e+9:17085:x1875455681672960:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788574320.258932:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3264c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f73678fb-d8c0-450f-a73b-e6565942045e+9:17085:x1875455681672960:12345-0@lo:502:llog_process_th.0 Request processed in 900us (1201us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574320.258943:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788574320.259176:0:17085:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f73678fb-d8c0-450f-a73b-e6565942045e:17085:1875455681672960:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788574320.259234:0:17085:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788574320.259246:0:17085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574320.259249:0:17085:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788574320.259254:0:17085:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1788574320.259256:0:17085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788574320.259270:0:17085:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9c84c2510000) 00000020:00000080:1.0:1788574320.259286:0:17085:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1788574320.259291:0:17085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788574320.259405:0:17085:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788574320.259415:0:17085:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5bf8706fdac8d040 00000020:00000080:1.0:1788574320.259630:0:17085:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788574320.259635:0:17085:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788574320.259638:0:17085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574320.259640:0:17085:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788574320.259643:0:17085:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788574320.259646:0:17085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574320.259648:0:17085:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788574320.259651:0:17085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788574320.259657:0:17085:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9c84c2513380) 00000020:00000080:1.0:1788574320.259666:0:17085:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1788574320.259669:0:17085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788574320.259671:0:17085:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788574320.259674:0:17085:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788574320.259679:0:17085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788574320.259738:0:17085:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c84c3fd7800 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788574320.259765:0:17085:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9c84c2514d40) 00000020:00000080:1.0:1788574320.259775:0:17085:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1788574320.259831:0:17085:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788574320.259836:0:17085:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5bf8706fdac8d055 00000020:00000080:1.0:1788574320.259934:0:17085:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788574320.259940:0:17085:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788574320.259945:0:17085:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x5bf8706fdac8d05c 00080000:01000000:1.0:1788574320.259950:0:17085:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788574320.259953:0:17085:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5bf8706fdac8d063 00010000:00010000:2.0:1788574320.363983:0:17085:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1788574320.364941:0:17085:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967529 00000001:00080000:2.0:1788574320.366436:0:17085:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788574320.366948:0:17085:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9c84c303b380) 00000020:00000080:2.0:1788574320.366966:0:17085:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788574320.367045:0:17085:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788574320.367054:0:17085:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5bf8706fdac8d071 00000020:00000080:1.0:1788574320.382632:0:17085:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788574320.393804:0:17085:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x5bf8706fdac8d078 00000020:00000080:3.0:1788574320.399085:0:17085:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788574320.399101:0:17085:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788574320.399108:0:17085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574320.399110:0:17085:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788574320.399114:0:17085:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788574320.399117:0:17085:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:3.0:1788574320.399118:0:17085:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788574320.399120:0:17085:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788574320.399121:0:17085:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788574320.399123:0:17085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574320.399125:0:17085:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788574320.399127:0:17085:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788574320.399131:0:17085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574320.399133:0:17085:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788574320.399137:0:17085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788574320.399507:0:17085:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788574320.399529:0:17085:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788574320.399533:0:17085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574320.399535:0:17085:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1788574320.399538:0:17085:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788574320.399555:0:17085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574320.399557:0:17085:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1788574320.399560:0:17085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788574320.399565:0:17085:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.151@tcp to nid 0x20000c0a8cc97 (192.168.204.151@tcp) 00000020:00000080:3.0:1788574320.399590:0:17085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788574320.399606:0:17085:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9c84c2708000) 00000020:00000080:3.0:1788574320.399623:0:17085:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1788574320.399628:0:17085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788574320.399843:0:17085:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1788574320.399849:0:17085:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788574320.399858:0:17085:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5bf8706fdac8d086 00010000:00080000:3.0:1788574320.399892:0:17085:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c85ffb61800@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.151@tcp at head 00010000:00010000:3.0:1788574320.403842:0:17085:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:0.0:1788574320.405048:0:17085:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788574320.405064:0:17085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1788574320.405098:0:17085:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788574320.405119:0:17085:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5bf8706fdac8d08d 00000100:00080000:0.0:1788574320.405130:0:17085:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788574320.405136:0:17085:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9c85ffb61800 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:0.0:1788574320.405183:0:17085:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c84c36dd180 x1875455681673088/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788574320.405242:0:17085:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:0.0:1788574320.405363:0:17085:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788574320.405368:0:17085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788574320.405370:0:17085:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1788574320.405373:0:17085:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788574320.405375:0:17085:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:0.0:1788574320.405377:0:17085:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788574320.405378:0:17085:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788574320.405380:0:17085:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788574320.405388:0:17085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788574320.405390:0:17085:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788574320.405393:0:17085:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788574320.405399:0:17085:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1788574320.405402:0:17085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788574320.405403:0:17085:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788574320.405406:0:17085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788574320.405410:0:17085:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.151@tcp to nid 0x20000c0a8cc97 (192.168.204.151@tcp) 00000020:01000000:0.0:1788574320.405433:0:17085:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788574320.405435:0:17085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788574320.405446:0:17085:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9c85faf499c0) 00000020:00000080:0.0:1788574320.405457:0:17085:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1788574320.405462:0:17085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788574320.405542:0:17085:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1788574320.405548:0:17085:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:0.0:1788574320.405554:0:17085:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5bf8706fdac8d09b 00010000:00080000:0.0:1788574320.405594:0:17085:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c85c4edd000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.151@tcp at head 00010000:00010000:0.0:1788574320.405803:0:17085:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:2.0:1788574320.406538:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875455681673088:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788574320.406620:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574320.406911:0:17072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681673088 00000100:00100000:0.0:1788574320.406922:0:17072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681673088 00000100:00100000:0.0:1788574320.406962:0:17072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788574320.406971:0:17072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3008e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3616:x1875455681673088:12345-0@lo:38:llog_process_th.0 00010000:00020000:0.0:1788574320.406991:0:17072:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:01000000:2.0:1788574320.409282:0:17085:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788574320.409738:0:17085:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788574320.417609:0:17085:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788574320.418012:0:17085:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1788574320.418184:0:17085:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1788574320.425963:0:17091:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788574320.425973:0:17091:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000100:00100000:0.0:1788574320.434094:0:17072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3008e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3616:x1875455681673088:12345-0@lo:38:llog_process_th.0 Request processed in 27113us (27465us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788574320.434109:0:17072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1788574320.435665:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c85ffb61800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788574320.435676:0:3616:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788574320.435681:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875455681673088:0@lo:38:llog_process_th.0 00000020:00000080:3.0:1788574320.436006:0:17085:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788574320.436024:0:17085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788574320.436073:0:17085:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788574320.436095:0:17085:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5bf8706fdac8d0a2 00000100:00080000:3.0:1788574320.436103:0:17085:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788574320.436109:0:17085:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9c85c4edd000 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:3.0:1788574320.436147:0:17085:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c84c3c09f80 x1875455681673216/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788574320.436455:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875455681673216:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788574320.436586:0:3616:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875455681673216 offset 0 length 520: 4 00000100:00080000:3.0:1788574320.436675:0:17085:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788574320.436758:0:17085:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788574320.436763:0:17085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574320.436765:0:17085:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788574320.436768:0:17085:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788574320.436782:0:17085:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:3.0:1788574320.436783:0:17085:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788574320.436785:0:17085:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788574320.436787:0:17085:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788574320.436790:0:17085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574320.436791:0:17085:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788574320.436794:0:17085:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788574320.436798:0:17085:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788574320.436801:0:17085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574320.436802:0:17085:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788574320.436805:0:17085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788574320.436808:0:17085:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.151@tcp to nid 0x20000c0a8cc97 (192.168.204.151@tcp) 00000020:01000000:3.0:1788574320.436834:0:17085:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788574320.436837:0:17085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788574320.436849:0:17085:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9c84c270b380) 00000020:00000080:3.0:1788574320.436863:0:17085:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:3.0:1788574320.436869:0:17085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788574320.436946:0:17085:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788574320.436952:0:17085:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:3.0:1788574320.436959:0:17085:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5bf8706fdac8d0b0 00010000:00080000:3.0:1788574320.436991:0:17085:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c84c369e000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.151@tcp at head 00010000:00010000:3.0:1788574320.437230:0:17085:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1788574320.437882:0:17085:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788574320.437905:0:17085:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788574320.440146:0:17085:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788574320.440709:0:17085:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1788574320.440884:0:17085:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:0.0:1788574320.441850:0:17093:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788574320.441864:0:17093:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788574320.443015:0:17085:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788574320.443030:0:17085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788574320.443070:0:17085:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788574320.443091:0:17085:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5bf8706fdac8d0b7 00000100:00080000:0.0:1788574320.443102:0:17085:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788574320.443108:0:17085:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c84c369e000 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:0.0:1788574320.443145:0:17085:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c84c36df800 x1875455681673344/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788574320.443177:0:17085:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:2.0:1788574320.443294:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875455681673344:0@lo:8:llog_process_th.0 00000020:01000000:0.0:1788574320.443543:0:17085:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788574320.443549:0:17085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788574320.443551:0:17085:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788574320.443555:0:17085:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788574320.443558:0:17085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788574320.443560:0:17085:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788574320.443563:0:17085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788574320.443565:0:17085:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788574320.443568:0:17085:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788574320.443570:0:17085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788574320.443572:0:17085:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788574320.443574:0:17085:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788574320.443576:0:17085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788574320.443578:0:17085:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788574320.443582:0:17085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788574320.443614:0:17085:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36df100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f73678fb-d8c0-450f-a73b-e6565942045e:17085:1875455681673472:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788574320.443702:0:17085:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574320.443779:0:17085:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85d1479480 going to sleep for 11 seconds 00000400:00000100:2.0:1788574320.443978:0:3616:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875455681673344 offset 0 length 520: 4 00000100:00100000:0.0:1788574320.445883:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681673472 00000100:00100000:0.0:1788574320.445897:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681673472 00000100:00100000:0.0:1788574320.446029:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788574320.446052:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3266c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f73678fb-d8c0-450f-a73b-e6565942045e+9:17085:x1875455681673472:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788574320.446281:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3266c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f73678fb-d8c0-450f-a73b-e6565942045e+9:17085:x1875455681673472:12345-0@lo:502:llog_process_th.0 Request processed in 230us (2578us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574320.446289:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788574320.446477:0:17085:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36df100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f73678fb-d8c0-450f-a73b-e6565942045e:17085:1875455681673472:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788574320.446515:0:17085:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788574320.446522:0:17085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574320.446524:0:17085:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788574320.446529:0:17085:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1788574320.446856:0:17046:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:2.0:1788574320.446880:0:17046:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788574320.446904:0:17046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d08a3e00/0x5bf8706fdac8d02b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d032 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574320.446915:0:17046:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c85d08a3e00/0x5bf8706fdac8d02b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d032 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788574320.446924:0:17046:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c84c3fd7800 from 1 10000000:01000000:2.0:1788574320.446926:0:17046:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788574320.446960:0:17046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85fa32fa00/0x5bf8706fdac8d0be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574320.446969:0:17046:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c85fa32fa00/0x5bf8706fdac8d0be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574320.446978:0:17046:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c85fa32fa00/0x5bf8706fdac8d0be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574320.446998:0:17046:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c300b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:17046:1875455681673600:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788574320.447038:0:17046:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574320.447228:0:17046:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85fafee240 going to sleep for 11 seconds 00000100:00100000:1.0:1788574320.448951:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681673600 00000100:00100000:1.0:1788574320.448967:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681673600 00000100:00100000:1.0:1788574320.449029:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788574320.449038:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3267450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f73678fb-d8c0-450f-a73b-e6565942045e+9:17046:x1875455681673600:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788574320.449071:0:17062:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574320.449094:0:17062:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85d08a3400/0x5bf8706fdac8d0c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8d0be expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574320.449123:0:17062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85d08a3400/0x5bf8706fdac8d0c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8d0be expref: 10 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574320.449134:0:17062:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85d08a3400/0x5bf8706fdac8d0c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8d0be expref: 10 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574320.449472:0:17062:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d08a3400, rc 0) 00000100:00100000:1.0:1788574320.449546:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3267450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f73678fb-d8c0-450f-a73b-e6565942045e+10:17046:x1875455681673600:12345-0@lo:101:mount.lustre.0 Request processed in 508us (2506us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574320.449552:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788574320.449730:0:17046:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c300b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:17046:1875455681673600:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788574320.449760:0:17046:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c85fa32fa00/0x5bf8706fdac8d0be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d0c5 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574320.449770:0:17046:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c85fa32fa00/0x5bf8706fdac8d0be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8d0c5 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574320.450983:0:17046:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c0b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:17046:1875455681673728:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1788574320.451040:0:17046:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574320.452893:0:17046:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c235d600 going to sleep for 11 seconds 00000100:00100000:1.0:1788574320.453521:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681673728 00000100:00100000:1.0:1788574320.453534:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681673728 00000100:00100000:1.0:1788574320.453608:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788574320.453619:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3264850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f73678fb-d8c0-450f-a73b-e6565942045e+10:17046:x1875455681673728:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1788574320.453650:0:17062:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788574320.453727:0:17062:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1788574320.453861:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3264850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f73678fb-d8c0-450f-a73b-e6565942045e+10:17046:x1875455681673728:12345-0@lo:256:mount.lustre.0 Request processed in 238us (2813us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574320.453869:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788574320.454011:0:17046:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c0b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:17046:1875455681673728:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1788574320.455568:0:17046:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788574320.455602:0:17046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85fa32fa00/0x5bf8706fdac8d0be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d0c5 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574320.455617:0:17046:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c85fa32fa00/0x5bf8706fdac8d0be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d0c5 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788574320.455625:0:17046:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c84c3fd7800 from 1 10000000:01000000:3.0:1788574320.455629:0:17046:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788574320.455814:0:17046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c84c2617c00/0x5bf8706fdac8d0cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574320.455823:0:17046:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c84c2617c00/0x5bf8706fdac8d0cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574320.455833:0:17046:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c84c2617c00/0x5bf8706fdac8d0cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574320.455857:0:17046:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c0b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:17046:1875455681673856:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788574320.455924:0:17046:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574320.456024:0:17046:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c235d600 going to sleep for 11 seconds 00000100:00100000:0.0:1788574320.456073:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681673856 00000100:00100000:0.0:1788574320.456080:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681673856 00000100:00100000:0.0:1788574320.456128:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788574320.456137:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f7fc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f73678fb-d8c0-450f-a73b-e6565942045e+10:17046:x1875455681673856:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788574320.456149:0:17060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574320.456162:0:17060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85d20d6000/0x5bf8706fdac8d0d3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8d0cc expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574320.456183:0:17060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85d20d6000/0x5bf8706fdac8d0d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8d0cc expref: 11 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574320.456564:0:17060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85d20d6000/0x5bf8706fdac8d0d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8d0cc expref: 11 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574320.456573:0:17060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d20d6000, rc 0) 00000100:00100000:0.0:1788574320.456625:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f7fc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f73678fb-d8c0-450f-a73b-e6565942045e+11:17046:x1875455681673856:12345-0@lo:101:mount.lustre.0 Request processed in 490us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574320.456632:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788574320.456800:0:17046:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c0b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:17046:1875455681673856:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788574320.456817:0:17046:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c84c2617c00/0x5bf8706fdac8d0cc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d0d3 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574320.456826:0:17046:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c84c2617c00/0x5bf8706fdac8d0cc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8d0d3 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574320.456912:0:17046:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:17046:1875455681673984:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788574320.456942:0:17046:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574320.457017:0:17046:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c3597300 going to sleep for 11 seconds 00000100:00100000:0.0:1788574320.457082:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681673984 00000100:00100000:0.0:1788574320.457088:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681673984 00000100:00100000:0.0:1788574320.457152:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788574320.457160:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f7fc0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f73678fb-d8c0-450f-a73b-e6565942045e+11:17046:x1875455681673984:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788574320.457618:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f7fc0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f73678fb-d8c0-450f-a73b-e6565942045e+11:17046:x1875455681673984:12345-0@lo:501:mount.lustre.0 Request processed in 457us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574320.457638:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788574320.457802:0:17046:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:17046:1875455681673984:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788574320.457837:0:17046:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c08700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:17046:1875455681674112:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788574320.457876:0:17046:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574320.457946:0:17046:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c235dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788574320.457978:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681674112 00000100:00100000:0.0:1788574320.457982:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681674112 00000100:00100000:0.0:1788574320.458013:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788574320.458019:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f7fc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f73678fb-d8c0-450f-a73b-e6565942045e+11:17046:x1875455681674112:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788574320.458107:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f7fc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f73678fb-d8c0-450f-a73b-e6565942045e+11:17046:x1875455681674112:12345-0@lo:503:mount.lustre.0 Request processed in 88us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574320.458114:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788574320.458241:0:17046:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c08700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:17046:1875455681674112:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788574320.458920:0:17095:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c0b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f73678fb-d8c0-450f-a73b-e6565942045e:17095:1875455681674240:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788574320.458966:0:17095:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574320.459000:0:17095:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c235d900 going to sleep for 11 seconds 00000100:00100000:0.0:1788574320.459046:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681674240 00000100:00100000:0.0:1788574320.459051:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681674240 00000100:00100000:0.0:1788574320.459082:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788574320.459089:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f7fc2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f73678fb-d8c0-450f-a73b-e6565942045e+11:17095:x1875455681674240:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788574320.459818:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f7fc2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f73678fb-d8c0-450f-a73b-e6565942045e+11:17095:x1875455681674240:12345-0@lo:502:llog_process_th.0 Request processed in 726us (848us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574320.459827:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788574320.459913:0:17095:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c0b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f73678fb-d8c0-450f-a73b-e6565942045e:17095:1875455681674240:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788574320.459940:0:17095:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788574320.459950:0:17095:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574320.459952:0:17095:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788574320.459959:0:17095:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c84c3fd7800 00000020:00000080:3.0:1788574320.459962:0:17095:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788574320.459970:0:17095:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788574320.459974:0:17095:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574320.459975:0:17095:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788574320.459977:0:17095:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788574320.459980:0:17095:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574320.459981:0:17095:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788574320.459985:0:17095:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c84c3fd7800 00000020:00000080:3.0:1788574320.459987:0:17095:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788574320.460069:0:17095:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788574320.460073:0:17095:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574320.460074:0:17095:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788574320.460077:0:17095:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788574320.460080:0:17095:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574320.460081:0:17095:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788574320.460084:0:17095:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c84c3fd7800 00000020:00000080:3.0:1788574320.460086:0:17095:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788574320.460104:0:17095:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788574320.460107:0:17095:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574320.460108:0:17095:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788574320.460111:0:17095:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788574320.460113:0:17095:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574320.460114:0:17095:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788574320.460118:0:17095:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c84c3fd7800 00000020:00000080:3.0:1788574320.460120:0:17095:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788574320.460164:0:17095:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c0b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f73678fb-d8c0-450f-a73b-e6565942045e:17095:1875455681674368:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788574320.461308:0:17095:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574320.461354:0:17095:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c235d900 going to sleep for 11 seconds 00000100:00100000:3.0:1788574320.461780:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681674368 00000100:00100000:3.0:1788574320.461788:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681674368 00000100:00100000:3.0:1788574320.461833:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788574320.461841:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f7fc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f73678fb-d8c0-450f-a73b-e6565942045e+11:17095:x1875455681674368:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788574320.461960:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f7fc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f73678fb-d8c0-450f-a73b-e6565942045e+11:17095:x1875455681674368:12345-0@lo:502:llog_process_th.0 Request processed in 119us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574320.461968:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788574320.462321:0:17095:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c0b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f73678fb-d8c0-450f-a73b-e6565942045e:17095:1875455681674368:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788574320.462461:0:17095:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788574320.462468:0:17095:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574320.462470:0:17095:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788574320.462474:0:17095:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1788574320.462725:0:17046:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788574320.462766:0:17046:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788574320.462785:0:17046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c84c2617c00/0x5bf8706fdac8d0cc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d0d3 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574320.462796:0:17046:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c84c2617c00/0x5bf8706fdac8d0cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d0d3 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788574320.462847:0:17046:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788574320.462850:0:17046:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c84c3fd7800 10000000:01000000:3.0:1788574320.462853:0:17046:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c84c3fd7800 10000000:01000000:3.0:1788574320.462857:0:17046:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788574320.462863:0:17046:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c84c3fd7800 from 1 10000000:01000000:3.0:1788574320.462865:0:17046:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788574320.462897:0:17046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c84c2616c00/0x5bf8706fdac8d0da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574320.462905:0:17046:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c84c2616c00/0x5bf8706fdac8d0da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574320.462914:0:17046:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c84c2616c00/0x5bf8706fdac8d0da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574320.462942:0:17046:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c0aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:17046:1875455681674496:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788574320.462987:0:17046:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574320.463019:0:17046:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c235da80 going to sleep for 11 seconds 00000100:00100000:3.0:1788574320.463042:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681674496 00000100:00100000:3.0:1788574320.463048:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681674496 00000100:00100000:3.0:1788574320.463077:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788574320.463084:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f7fc2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f73678fb-d8c0-450f-a73b-e6565942045e+11:17046:x1875455681674496:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788574320.463093:0:17062:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574320.463105:0:17062:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c84c2617a00/0x5bf8706fdac8d0e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8d0da expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574320.463128:0:17062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c84c2617a00/0x5bf8706fdac8d0e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8d0da expref: 12 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574320.463139:0:17062:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c84c2617a00/0x5bf8706fdac8d0e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8d0da expref: 12 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574320.463148:0:17062:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c84c2617a00, rc 0) 00000100:00100000:3.0:1788574320.463179:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f7fc2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f73678fb-d8c0-450f-a73b-e6565942045e+12:17046:x1875455681674496:12345-0@lo:101:mount.lustre.0 Request processed in 96us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574320.463185:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788574320.463257:0:17046:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c0aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:17046:1875455681674496:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788574320.463270:0:17046:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c84c2616c00/0x5bf8706fdac8d0da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d0e1 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574320.463279:0:17046:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c84c2616c00/0x5bf8706fdac8d0da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8d0e1 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574320.472720:0:17046:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c300b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:17046:1875455681674624:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788574320.472800:0:17046:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574320.472900:0:17046:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85fafee240 going to sleep for 11 seconds 00000100:00100000:0.0:1788574320.477199:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681674624 00000100:00100000:0.0:1788574320.477215:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681674624 00000100:00100000:0.0:1788574320.477273:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788574320.477283:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f7fc1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f73678fb-d8c0-450f-a73b-e6565942045e+12:17046:x1875455681674624:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788574320.477904:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f7fc1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f73678fb-d8c0-450f-a73b-e6565942045e+12:17046:x1875455681674624:12345-0@lo:501:mount.lustre.0 Request processed in 620us (5101us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574320.477913:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788574320.478287:0:17046:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c300b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:17046:1875455681674624:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788574320.478343:0:17046:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36df100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:17046:1875455681674752:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788574320.478406:0:17046:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574320.478506:0:17046:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c384f540 going to sleep for 11 seconds 00000100:00100000:1.0:1788574320.479302:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681674752 00000100:00100000:1.0:1788574320.479311:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681674752 00000100:00100000:1.0:1788574320.479351:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788574320.479361:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f7fc3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f73678fb-d8c0-450f-a73b-e6565942045e+12:17046:x1875455681674752:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788574320.479476:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f7fc3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f73678fb-d8c0-450f-a73b-e6565942045e+12:17046:x1875455681674752:12345-0@lo:503:mount.lustre.0 Request processed in 117us (1070us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574320.479484:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788574320.479663:0:17046:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36df100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:17046:1875455681674752:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788574320.481437:0:17099:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36df100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f73678fb-d8c0-450f-a73b-e6565942045e:17099:1875455681674880:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788574320.481506:0:17099:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574320.481539:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681674880 00000100:00100000:0.0:1788574320.481544:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681674880 00000100:00100000:0.0:1788574320.481580:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788574320.481589:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f7fc0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f73678fb-d8c0-450f-a73b-e6565942045e+12:17099:x1875455681674880:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788574320.481691:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f7fc0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f73678fb-d8c0-450f-a73b-e6565942045e+12:17099:x1875455681674880:12345-0@lo:502:llog_process_th.0 Request processed in 103us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574320.481699:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788574320.482471:0:17099:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c384f300 going to sleep for 11 seconds 00000100:00100000:0.0:1788574320.482497:0:17099:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36df100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f73678fb-d8c0-450f-a73b-e6565942045e:17099:1875455681674880:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1788574320.482568:0:17099:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788574320.482583:0:17099:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9c85fa0bcd40) 00000020:00000080:0.0:1788574320.482604:0:17099:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:0.0:1788574320.482690:0:17099:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c84c3fd7800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788574320.482694:0:17099:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c84c3fd7800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788574320.482697:0:17099:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c84c3fd7800 4 00010000:00080000:0.0:1788574320.482724:0:17099:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c85e0bc2800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.151@tcp at head 00010000:00010000:0.0:1788574320.486734:0:17099:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:0.0:1788574320.489067:0:17099:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788574320.489127:0:17099:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788574320.489143:0:17099:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x5bf8706fdac8d0ef 00000100:00080000:0.0:1788574320.489155:0:17099:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788574320.489173:0:17099:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9c85e0bc2800 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:0.0:1788574320.489480:0:17099:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c84c36df100 x1875455681675008/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788574320.489515:0:17099:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788574320.489578:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875455681675008:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788574320.489658:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574320.491469:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681675008 00000100:00100000:0.0:1788574320.491484:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681675008 00000100:00100000:0.0:1788574320.491525:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788574320.491534:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3616:x1875455681675008:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788574320.491616:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3616:x1875455681675008:12345-0@lo:38:llog_process_th.0 Request processed in 82us (1958us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788574320.491623:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788574320.492432:0:17099:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36dd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f73678fb-d8c0-450f-a73b-e6565942045e:17099:1875455681675136:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788574320.492492:0:17099:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574320.492524:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681675136 00000100:00100000:0.0:1788574320.492530:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681675136 00000100:00100000:0.0:1788574320.492562:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788574320.492569:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f7fc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f73678fb-d8c0-450f-a73b-e6565942045e+12:17099:x1875455681675136:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788574320.493018:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f7fc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f73678fb-d8c0-450f-a73b-e6565942045e+12:17099:x1875455681675136:12345-0@lo:502:llog_process_th.0 Request processed in 448us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574320.493026:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788574320.493439:0:3616:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788574320.493447:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c85e0bc2800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788574320.493452:0:3616:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788574320.493455:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875455681675008:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788574320.493707:0:17099:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c384fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788574320.493723:0:17099:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36dd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f73678fb-d8c0-450f-a73b-e6565942045e:17099:1875455681675136:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788574320.493784:0:17099:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36dd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f73678fb-d8c0-450f-a73b-e6565942045e:17099:1875455681675264:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788574320.493829:0:17099:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574320.493859:0:17099:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85e57dc300 going to sleep for 11 seconds 00000100:00100000:2.0:1788574320.493971:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681675264 00000100:00100000:2.0:1788574320.493977:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681675264 00000100:00100000:2.0:1788574320.494021:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788574320.494029:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f7fc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f73678fb-d8c0-450f-a73b-e6565942045e+12:17099:x1875455681675264:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788574320.494361:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f7fc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f73678fb-d8c0-450f-a73b-e6565942045e+12:17099:x1875455681675264:12345-0@lo:502:llog_process_th.0 Request processed in 332us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574320.494368:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788574320.494547:0:17099:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36dd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f73678fb-d8c0-450f-a73b-e6565942045e:17099:1875455681675264:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788574320.494566:0:17099:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1788574320.494703:0:17046:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788574320.494726:0:17046:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788574320.494756:0:17046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c84c2616c00/0x5bf8706fdac8d0da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d0e1 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574320.494767:0:17046:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c84c2616c00/0x5bf8706fdac8d0da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d0e1 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788574320.494810:0:17046:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788574320.494812:0:17046:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788574320.494813:0:17046:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788574320.494814:0:17046:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788574320.494816:0:17046:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788574320.494817:0:17046:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788574320.494818:0:17046:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788574320.494819:0:17046:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788574320.494821:0:17046:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788574320.494822:0:17046:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788574320.494827:0:17046:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1788574320.494829:0:17046:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788574320.494830:0:17046:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788574320.494831:0:17046:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788574320.494832:0:17046:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788574320.494833:0:17046:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788574320.494834:0:17046:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788574320.494835:0:17046:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788574320.494836:0:17046:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788574320.494837:0:17046:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788574320.494838:0:17046:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788574320.494852:0:17046:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788574320.494864:0:17046:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:17046:1875455681675392:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788574320.494897:0:17046:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574320.494930:0:17046:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85e57dcc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788574320.495024:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681675392 00000100:00100000:2.0:1788574320.495028:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681675392 00000100:00100000:2.0:1788574320.495061:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788574320.495068:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f7fc1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f73678fb-d8c0-450f-a73b-e6565942045e+12:17046:x1875455681675392:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788574320.495088:0:17061:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788574320.495100:0:17061:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788574320.499689:0:17061:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788574320.499710:0:17061:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1788574320.499945:0:17083:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788574320.499951:0:17083:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788574320.499972:0:17083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c85d20d6c00/0x5bf8706fdac8d0f6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574320.499997:0:17083:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c85d08a3400/0x5bf8706fdac8d0c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8d0be expref: 12 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574320.500007:0:17083:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c85d20d6c00/0x5bf8706fdac8d0f6 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574320.500047:0:17083:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c85d08a3400/0x5bf8706fdac8d0c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5bf8706fdac8d0be expref: 12 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574320.500063:0:17083:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c85d08a3400/0x5bf8706fdac8d0c5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5bf8706fdac8d0be expref: 12 pid: 17062 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574320.500076:0:17083:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36de300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17083:1875455681675520:0@lo:104: 00000100:00100000:0.0:1788574320.500277:0:17083:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574320.500369:0:17083:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85e57dc840 going to sleep for 11 seconds 00000100:00100000:2.0:1788574320.500683:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681675520 00000100:00100000:2.0:1788574320.500691:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681675520 00000100:00100000:2.0:1788574320.500736:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788574320.500759:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f73678fb-d8c0-450f-a73b-e6565942045e+3:17083:x1875455681675520:12345-0@lo:104: 00010000:00010000:2.0:1788574320.500773:0:17050:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff9c85fa32fa00/0x5bf8706fdac8d0be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8d0c5 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574320.500830:0:17050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788574320.500836:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f73678fb-d8c0-450f-a73b-e6565942045e+3:17083:x1875455681675520:12345-0@lo:104: Request processed in 92us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574320.500843:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788574320.501032:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f7fc1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f73678fb-d8c0-450f-a73b-e6565942045e+12:17046:x1875455681675392:12345-0@lo:253:mount.lustre.0 Request processed in 5963us (6133us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574320.501041:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:0.0:1788574320.501068:0:17056:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788574320.501074:0:17056:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c85fa32fa00/0x5bf8706fdac8d0be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8d0c5 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574320.501082:0:17056:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32fa00 already unused, calling callback (ffffffffc1472c20) 10000000:00010000:0.0:1788574320.501086:0:17056:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c85fa32fa00/0x5bf8706fdac8d0be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5bf8706fdac8d0c5 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574320.501094:0:17056:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c85fa32fa00/0x5bf8706fdac8d0be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5bf8706fdac8d0c5 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788574320.501114:0:17056:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c85fa32fa00/0x5bf8706fdac8d0be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5bf8706fdac8d0c5 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788574320.501120:0:17056:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788574320.501166:0:17056:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9c85fa32fa00/0x5bf8706fdac8d0be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8d0c5 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574320.501172:0:17056:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788574320.501217:0:17056:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c85fa32fa00/0x5bf8706fdac8d0be lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8d0c5 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574320.501224:0:17056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c85fa32fa00/0x5bf8706fdac8d0be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8d0c5 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574320.501239:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574320.501241:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574320.501242:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574320.501272:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f73678fb-d8c0-450f-a73b-e6565942045e:3617:1875455681675648:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788574320.501507:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574320.501578:0:17083:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36de300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17083:1875455681675520:0@lo:104: 00010000:00010000:0.0:1788574320.501597:0:17083:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c85d20d6c00/0x5bf8706fdac8d0f6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574320.501654:0:17052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681675648 00000100:00100000:3.0:1788574320.501659:0:17052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681675648 00010000:00010000:3.0:1788574320.501680:0:17052:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c85d08a3400/0x5bf8706fdac8d0c5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8d0be expref: 12 pid: 17062 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574320.501707:0:17052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788574320.501714:0:17052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f73678fb-d8c0-450f-a73b-e6565942045e+12:3617:x1875455681675648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788574320.501725:0:17052:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574320.501730:0:17052:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c85d08a3400/0x5bf8706fdac8d0c5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8d0be expref: 12 pid: 17062 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574320.501740:0:17052:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c85d08a3400/0x5bf8706fdac8d0c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5bf8706fdac8d0be expref: 12 pid: 17062 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574320.501767:0:17052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85d08a3400/0x5bf8706fdac8d0c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5bf8706fdac8d0be expref: 12 pid: 17062 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574320.501780:0:17052:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c85d20d6c00/0x5bf8706fdac8d0f6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574320.501795:0:17052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85d20d6c00/0x5bf8706fdac8d0f6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788574320.501808:0:17052:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001857578s 00010000:00010000:3.0:1788574320.501812:0:17052:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c85d20d6c00/0x5bf8706fdac8d0f6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574320.501819:0:17052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c85d20d6c00/0x5bf8706fdac8d0f6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574320.501825:0:17052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c85d20d6c00/0x5bf8706fdac8d0f6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574320.501831:0:17052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c85d20d6c00/0x5bf8706fdac8d0f6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574320.501836:0:17052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d6c00 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:3.0:1788574320.501840:0:17052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c85d20d6c00/0x5bf8706fdac8d0f6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574320.501847:0:17052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c85d20d6c00/0x5bf8706fdac8d0f6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574320.501862:0:17052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c85d20d6c00/0x5bf8706fdac8d0f6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574320.501872:0:17052:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788574320.501904:0:17052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f73678fb-d8c0-450f-a73b-e6565942045e+11:3617:x1875455681675648:12345-0@lo:103:ldlm_bl.0 Request processed in 190us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574320.501910:0:17052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788574320.501943:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f73678fb-d8c0-450f-a73b-e6565942045e:3617:1875455681675648:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788574320.501958:0:17083:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c85d20d6c00/0x5bf8706fdac8d0f6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574320.501965:0:17083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c85d20d6c00/0x5bf8706fdac8d0f6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574320.501971:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85d20d6c00/0x5bf8706fdac8d0f6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574320.502184:0:17046:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36ded80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:17046:1875455681675392:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788574320.503034:0:17046:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788574320.503037:0:17046:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788574320.503039:0:17046:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788574320.503040:0:17046:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788574320.503041:0:17046:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788574320.503043:0:17046:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788574320.503044:0:17046:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788574320.503045:0:17046:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788574320.503047:0:17046:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788574320.503049:0:17046:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788574320.503050:0:17046:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788574320.503065:0:17046:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000020:00080000:0.0:1788574320.516974:0:17046:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:0.0:1788574320.517418:0:17046:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1788574320.517702:0:17106:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788574320.517876:0:17046:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000020:00080000:3.0:1788574320.518090:0:17105:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1788574320.518095:0:17105:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00080000:1.0:1788574320.518223:0:17107:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9c84c335e300 x1875455681675776/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574320.518236:0:17107:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c267e900 going to sleep for 0 seconds 00000040:01000000:0.0:1788574320.518595:0:17046:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788574320.518630:0:17046:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788574320.519131:0:17046:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788574320.519143:0:17046:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1788574320.519183:0:17046:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788574320.519989:0:17106:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788574320.521348:0:17046:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788574320.522376:0:17046:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788574320.522421:0:17046:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1788574320.523564:0:17106:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788574320.523619:0:17106:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00080000:10000000:0.0:1788574320.523918:0:17046:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:0.0:1788574320.525717:0:17046:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1788574320.527763:0:17046:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788574320.527812:0:17046:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb4d281647988 00100000:10000000:0.0:1788574320.527821:0:17046:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1788574320.528437:0:17046:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788574320.528526:0:17046:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.151@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788574320.528547:0:17046:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=45 00000080:00000004:0.0:1788574320.528564:0:17046:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1788574320.529487:0:17046:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788574320.529978:0:17046:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788574321.112374:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574321.556071:0:17107:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c267e900 going to sleep for 0 seconds 00000040:00080000:1.0:1788574321.556806:0:17104:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:3.0:1788574321.684412:0:17064:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788574321.684422:0:17064:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c84c3fd7800 from 7 10000000:01000000:3.0:1788574321.684428:0:17064:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788574321.684504:0:17064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c84c2617000/0x5bf8706fdac8d0fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574321.684517:0:17064:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c84c2617000/0x5bf8706fdac8d0fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574321.684529:0:17064:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c84c2617000/0x5bf8706fdac8d0fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574321.684556:0:17064:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c09500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f73678fb-d8c0-450f-a73b-e6565942045e:17064:1875455681675904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788574321.684633:0:17064:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574321.684713:0:17064:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c235d600 going to sleep for 11 seconds 00000100:00100000:0.0:1788574321.684909:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681675904 00000100:00100000:0.0:1788574321.684917:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681675904 00000100:00100000:0.0:1788574321.684971:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788574321.684980:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f7fc2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f73678fb-d8c0-450f-a73b-e6565942045e+11:17064:x1875455681675904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788574321.684995:0:17062:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574321.685010:0:17062:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85d20d7600/0x5bf8706fdac8d104 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8d0fd expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574321.685036:0:17062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85d20d7600/0x5bf8706fdac8d104 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8d0fd expref: 12 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574321.685047:0:17062:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85d20d7600/0x5bf8706fdac8d104 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8d0fd expref: 12 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574321.685057:0:17062:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d20d7600, rc 0) 00000100:00100000:0.0:1788574321.685184:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f7fc2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f73678fb-d8c0-450f-a73b-e6565942045e+12:17064:x1875455681675904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 204us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574321.685210:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788574321.688530:0:17064:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c09500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f73678fb-d8c0-450f-a73b-e6565942045e:17064:1875455681675904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788574321.688565:0:17064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c84c2617000/0x5bf8706fdac8d0fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d104 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574321.688596:0:17064:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c84c2617000/0x5bf8706fdac8d0fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8d104 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574321.688680:0:17064:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c09500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f73678fb-d8c0-450f-a73b-e6565942045e:17064:1875455681676032:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788574321.688759:0:17064:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574321.688821:0:17064:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c235d600 going to sleep for 11 seconds 00000100:00100000:0.0:1788574321.688954:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681676032 00000100:00100000:0.0:1788574321.688963:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681676032 00000100:00100000:0.0:1788574321.689027:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788574321.689036:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f7fc3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f73678fb-d8c0-450f-a73b-e6565942045e+12:17064:x1875455681676032:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788574321.689055:0:17061:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788574321.689071:0:17061:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788574321.689074:0:17061:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1788574321.689164:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f7fc3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f73678fb-d8c0-450f-a73b-e6565942045e+12:17064:x1875455681676032:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 128us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574321.689171:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788574321.689520:0:17064:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c09500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f73678fb-d8c0-450f-a73b-e6565942045e:17064:1875455681676032:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788574321.689569:0:17064:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788574321.689577:0:17064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c84c2617000/0x5bf8706fdac8d0fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d104 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574321.689586:0:17064:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c84c2617000/0x5bf8706fdac8d0fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d104 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574322.137449:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788574322.580326:0:17104:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788574322.580475:0:17107:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c267e900 going to sleep for 0 seconds 00010000:00010000:2.0:1788574323.156968:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574323.603265:0:17107:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c267e900 going to sleep for 0 seconds 00010000:00010000:0.0:1788574324.179310:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574324.627447:0:17107:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c267e900 going to sleep for 0 seconds 00000001:02000400:1.0:1788574325.041988:0:17351:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg451-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788574325.211603:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574325.655309:0:17107:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c267e900 going to sleep for 0 seconds 00000100:00080000:0.0:1788574325.907331:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788574325.907338:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788574325.907342:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c85ffb61800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788574325.907350:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 460 00000100:00080000:0.0:1788574325.907357:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788574325.907363:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9c85ffb61800 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:0.0:1788574325.907387:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c84c36dd500 x1875455681676288/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788574325.907405:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788574325.907427:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788574325.907430:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788574325.907433:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788574325.907436:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788574325.907439:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788574325.907441:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c85e0bc2800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788574325.907447:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9c85e0bc2800 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:0.0:1788574325.907462:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c84c36dc380 x1875455681676416/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788574325.907500:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875455681676288:0@lo:38:kworker.0 00000100:00100000:0.0:1788574325.907589:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574325.907666:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875455681676416:0@lo:38:kworker.0 00000100:00100000:0.0:1788574325.907698:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574325.907740:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681676288 00000100:00100000:0.0:1788574325.907748:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681676288 00000100:00100000:0.0:1788574325.907779:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788574325.907787:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3616:x1875455681676288:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788574325.907808:0:17073:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788574325.909978:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f73678fb-d8c0-450f-a73b-e6565942045e:3618:1875455681676160:0@lo:400:kworker.0 00000100:00100000:1.0:1788574325.910050:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574325.910132:0:17067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681676416 00000100:00100000:1.0:1788574325.910148:0:17067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681676416 00000100:00100000:1.0:1788574325.910182:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788574325.910205:0:17067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1875455681676416:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788574325.910232:0:17067:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 465 last 0 00000020:00000080:1.0:1788574325.910389:0:17067:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x5bf8706fdac8d10b 00000004:00100000:1.0:1788574325.910406:0:17067:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788574325.910604:0:17067:0:(import.c:65:import_set_state_nolock()) ffff9c85fa0fa800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788574325.910679:0:17067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875455681676416:12345-0@lo:38:kworker.0 Request processed in 489us (2980us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574325.910687:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788574325.910791:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681676160 00000100:00100000:2.0:1788574325.910796:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681676160 00000100:00100000:2.0:1788574325.910827:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788574325.910833:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1b9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f73678fb-d8c0-450f-a73b-e6565942045e+12:3618:x1875455681676160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574325.910875:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1b9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f73678fb-d8c0-450f-a73b-e6565942045e+12:3618:x1875455681676160:12345-0@lo:400:kworker.0 Request processed in 42us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574325.910890:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788574325.910936:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f73678fb-d8c0-450f-a73b-e6565942045e:3618:1875455681676160:0@lo:400:kworker.0 00010000:00080000:3.0:1788574325.920847:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c84c36dc380 x1875455681676416/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788574335 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788574325.920870:0:3616:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788574325.920879:0:3616:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788574325.920885:0:3616:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788574325.920888:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c85e0bc2800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788574325.920895:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875455681676416:0@lo:38:kworker.0 00000100:00100000:0.0:1788574325.932053:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3616:x1875455681676288:12345-0@lo:38:kworker.0 Request processed in 24255us (24452us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788574325.932069:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1788574325.932355:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c85ffb61800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788574325.932365:0:3616:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788574325.932369:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875455681676288:0@lo:38:kworker.0 00000020:00000004:1.0:1788574325.950116:0:17403:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788574325.950615:0:17403:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788574326.230651:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574326.676238:0:17107:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c267e900 going to sleep for 0 seconds 00000020:00000004:2.0:1788574327.033758:0:17453:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788574327.034021:0:17453:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788574327.251532:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574327.699269:0:17107:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c267e900 going to sleep for 0 seconds 00010000:00010000:0.0:1788574328.275418:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574328.723452:0:17107:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c267e900 going to sleep for 0 seconds 00010000:00010000:2.0:1788574329.302590:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574329.748166:0:17107:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c267e900 going to sleep for 0 seconds 00000100:00100000:0.0:1788574330.004116:0:3616:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788574320/real 1788574320] req@ffff9c84c36df800 x1875455681673344/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788574330 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574330.004148:0:3616:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c84c36df800 x1875455681673344/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788574330 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574330.004161:0:3616:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788574320/real 1788574320] req@ffff9c84c3c09f80 x1875455681673216/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788574330 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574330.004172:0:3616:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c84c3c09f80 x1875455681673216/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788574330 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788574330.004204:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c84c369e000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788574330.004234:0:3616:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788574330.004238:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875455681673344:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788574330.004244:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c85c4edd000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788574330.004249:0:3616:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788574330.004252:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875455681673216:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788574330.004457:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788574330.004462:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788574330.004464:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c85ffb61800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788574330.004469:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 465 00000100:00080000:2.0:1788574330.004474:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788574330.004481:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9c85ffb61800 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:2.0:1788574330.004500:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c84c300aa00 x1875455681676672/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788574330.004512:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788574330.004515:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788574330.004517:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c85c4edd000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788574330.004520:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 460 00000100:00080000:2.0:1788574330.004523:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788574330.004526:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9c85c4edd000 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:2.0:1788574330.004535:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c84c3008a80 x1875455681676800/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788574330.004543:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788574330.004545:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788574330.004552:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c84c369e000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788574330.004555:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 460 00000100:00080000:2.0:1788574330.004558:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788574330.004575:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c84c369e000 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:2.0:1788574330.004589:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c84c300ad80 x1875455681676928/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788574330.004687:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3008380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875455681677056:0@lo:400:kworker.0 00000100:00100000:0.0:1788574330.004763:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574330.004825:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788574330.004832:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3009c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f73678fb-d8c0-450f-a73b-e6565942045e:3620:1875455681676544:0@lo:400:kworker.0 00000100:00100000:0.0:1788574330.004861:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574330.004903:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681676544 00000100:00100000:0.0:1788574330.004911:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681676544 00000100:00100000:2.0:1788574330.005024:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681677056 00000100:00100000:2.0:1788574330.005029:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681677056 00000100:00100000:2.0:1788574330.005075:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788574330.005084:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875455681677056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574330.005137:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875455681677056:12345-0@lo:400:kworker.0 Request processed in 54us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574330.005143:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788574330.005335:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788574330.005342:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1b9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f73678fb-d8c0-450f-a73b-e6565942045e+12:3620:x1875455681676544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574330.005380:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1b9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f73678fb-d8c0-450f-a73b-e6565942045e+12:3620:x1875455681676544:12345-0@lo:400:kworker.0 Request processed in 39us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574330.005386:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788574330.005416:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c300aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875455681676672:0@lo:38:kworker.0 00000100:00100000:0.0:1788574330.005440:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574330.005460:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3008a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875455681676800:0@lo:8:kworker.0 00000400:00000100:0.0:1788574330.005478:0:3616:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875455681676800 offset 0 length 520: 4 00000100:00100000:0.0:1788574330.005496:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c300ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875455681676928:0@lo:8:kworker.0 00000400:00000100:0.0:1788574330.005513:0:3616:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875455681676928 offset 0 length 520: 4 00000100:00100000:0.0:1788574330.005535:0:17072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681676672 00000100:00100000:0.0:1788574330.005539:0:17072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681676672 00000100:00100000:0.0:1788574330.005557:0:17072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788574330.005576:0:17072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3616:x1875455681676672:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788574330.005592:0:17072:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788574330.006158:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3009c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f73678fb-d8c0-450f-a73b-e6565942045e:3620:1875455681676544:0@lo:400:kworker.0 00010000:00080000:1.0:1788574330.006179:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c84c3008380 x1875455681677056/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574346 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574330.006225:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3008380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875455681677056:0@lo:400:kworker.0 00000100:00100000:0.0:1788574330.030141:0:17072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3616:x1875455681676672:12345-0@lo:38:kworker.0 Request processed in 24568us (24689us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788574330.030157:0:17072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1788574330.030659:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c85ffb61800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788574330.030666:0:3616:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788574330.030672:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c300aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875455681676672:0@lo:38:kworker.0 00010000:00010000:0.0:1788574330.323647:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574330.771460:0:17107:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c267e900 going to sleep for 0 seconds 00010000:00010000:1.0:1788574331.351144:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574331.797924:0:17107:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c267e900 going to sleep for 0 seconds 00010000:00010000:0.0:1788574332.371368:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788574332.821328:0:17104:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788574332.822325:0:17107:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c267e900 going to sleep for 0 seconds 00010000:00010000:1.0:1788574333.396301:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788574333.726873:0:17798:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788574333.726878:0:17798:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:3.0:1788574333.726880:0:17798:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1788574333.727105:0:17798:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9c85c3688000 00000020:01000004:3.0:1788574333.727121:0:17798:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:3.0:1788574333.727171:0:17798:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788574333.727185:0:17798:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff9c84c270cd40) 00000020:00000080:3.0:1788574333.727277:0:17798:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788574333.780782:0:17798:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:2.0:1788574333.782250:0:17798:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788574333.783231:0:17798:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1788574333.783509:0:17798:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1788574333.783723:0:17798:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1788574333.784284:0:17798:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1788574333.784463:0:17798:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1788574333.784753:0:17798:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:2.0:1788574333.784945:0:17798:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:2.0:1788574333.785272:0:17798:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1788574333.785470:0:17798:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1788574333.785733:0:17798:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1788574333.786108:0:17798:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:2.0:1788574333.786334:0:17798:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1788574333.786586:0:17798:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:2.0:1788574333.786883:0:17798:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:2.0:1788574333.787184:0:17798:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1788574333.787640:0:17798:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1788574333.787959:0:17798:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:3.0:1788574333.788289:0:17798:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1788574333.788531:0:17798:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1788574333.788848:0:17798:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1788574333.789150:0:17798:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:3.0:1788574333.789829:0:17798:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1788574333.790316:0:17798:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1788574333.790518:0:17798:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:3.0:1788574333.790755:0:17798:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:3.0:1788574333.790938:0:17798:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:3.0:1788574333.791335:0:17798:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1788574333.791546:0:17798:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:3.0:1788574333.791823:0:17798:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1788574333.792132:0:17798:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1788574333.792452:0:17798:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1788574333.792728:0:17798:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1788574333.793281:0:17798:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1788574333.793744:0:17798:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:3.0:1788574333.794128:0:17798:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1788574333.794437:0:17798:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1788574333.794756:0:17798:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1788574333.794961:0:17798:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788574333.795298:0:17798:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1788574333.795507:0:17798:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788574333.795791:0:17798:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:3.0:1788574333.796005:0:17798:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788574333.796370:0:17798:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1788574333.796863:0:17798:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:01000000:3.0:1788574333.799627:0:17798:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788574333.799932:0:17798:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1788574333.799945:0:17798:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788574333.799958:0:17798:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5bf8706fdac8d119 00000020:01000004:3.0:1788574333.799965:0:17798:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1788574333.800114:0:17798:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.151@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788574333.800119:0:17798:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.151@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788574333.800126:0:17798:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1788574333.800154:0:17798:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1788574333.800159:0:17798:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.151@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:3.0:1788574333.804332:0:17798:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.151@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788574333.804370:0:17798:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.204.151@tcp, index=0001, flags=0x20001 00000020:01000004:3.0:1788574333.804374:0:17798:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788574333.804376:0:17798:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788574333.804378:0:17798:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788574333.804379:0:17798:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788574333.804380:0:17798:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788574333.804382:0:17798:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788574333.804383:0:17798:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788574333.804390:0:17798:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788574333.804391:0:17798:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788574333.804394:0:17798:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:3.0:1788574333.804397:0:17798:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788574333.804398:0:17798:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788574333.804399:0:17798:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788574333.804400:0:17798:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788574333.804401:0:17798:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788574333.804402:0:17798:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788574333.804403:0:17798:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788574333.804404:0:17798:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788574333.804405:0:17798:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788574333.804431:0:17798:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1788574333.804452:0:17798:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c09500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:17798:1875455681677184:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788574333.804538:0:17798:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574333.804673:0:17798:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c33d7d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788574333.804811:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681677184 00000100:00100000:2.0:1788574333.804820:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681677184 00000100:00100000:2.0:1788574333.804919:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788574333.804929:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1b9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f73678fb-d8c0-450f-a73b-e6565942045e+12:17798:x1875455681677184:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788574333.804957:0:17061:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788574333.804960:0:17061:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:2.0:1788574333.804967:0:17061:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1788574333.805320:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1b9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f73678fb-d8c0-450f-a73b-e6565942045e+12:17798:x1875455681677184:12345-0@lo:253:mount.lustre.0 Request processed in 392us (781us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574333.805328:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788574333.805427:0:17798:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c09500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:17798:1875455681677184:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788574333.805436:0:17798:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1788574333.805438:0:17798:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788574333.805440:0:17798:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788574333.805441:0:17798:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788574333.805442:0:17798:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788574333.805442:0:17798:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788574333.805443:0:17798:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788574333.805444:0:17798:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788574333.805445:0:17798:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788574333.805446:0:17798:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788574333.805464:0:17798:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c85c3688000 from lustre-MDT0001 10000000:01000000:3.0:1788574333.805507:0:17798:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:3.0:1788574333.805510:0:17798:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1788574333.805517:0:17798:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9c85faf48000 local copy 00010000:00010000:3.0:1788574333.805528:0:17798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6800/0x5bf8706fdac8d00f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d016 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574333.805606:0:17798:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c09500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:17798:1875455681677312:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788574333.805647:0:17798:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574333.805885:0:17798:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c33d7840 going to sleep for 11 seconds 00000100:00100000:0.0:1788574333.805955:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681677312 00000100:00100000:0.0:1788574333.805960:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681677312 00000100:00100000:0.0:1788574333.805995:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788574333.806003:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1b9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f73678fb-d8c0-450f-a73b-e6565942045e+12:17798:x1875455681677312:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788574333.806126:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1b9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f73678fb-d8c0-450f-a73b-e6565942045e+12:17798:x1875455681677312:12345-0@lo:501:mount.lustre.0 Request processed in 124us (478us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788574333.806141:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788574333.806417:0:17798:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c09500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:17798:1875455681677312:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788574333.806446:0:17798:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.151@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788574333.806468:0:17798:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.151@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788574333.806475:0:17798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6800/0x5bf8706fdac8d00f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d016 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574333.806483:0:17798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6800/0x5bf8706fdac8d00f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d016 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788574333.806520:0:17798:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c85c3688000 10000000:01000000:3.0:1788574333.806525:0:17798:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788574333.806529:0:17798:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9c85faf48000 10000000:01000000:3.0:1788574333.806532:0:17798:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1788574333.806535:0:17798:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9c85faf48000 from 1 10000000:01000000:3.0:1788574333.806539:0:17798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788574333.806563:0:17798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c84c2617800/0x5bf8706fdac8d120 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574333.806571:0:17798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c84c2617800/0x5bf8706fdac8d120 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574333.806579:0:17798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c84c2617800/0x5bf8706fdac8d120 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574333.806595:0:17798:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c09500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:17798:1875455681677440:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788574333.806623:0:17798:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574333.806649:0:17798:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c33d7840 going to sleep for 11 seconds 00000100:00100000:2.0:1788574333.806742:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681677440 00000100:00100000:2.0:1788574333.806747:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681677440 00000100:00100000:2.0:1788574333.806771:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788574333.806777:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1b9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f73678fb-d8c0-450f-a73b-e6565942045e+12:17798:x1875455681677440:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788574333.806786:0:17061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574333.806797:0:17061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85fa32e800/0x5bf8706fdac8d127 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8d120 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574333.806817:0:17061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85fa32e800/0x5bf8706fdac8d127 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8d120 expref: 13 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574333.806835:0:17061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85fa32e800/0x5bf8706fdac8d127 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8d120 expref: 13 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574333.806845:0:17061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85fa32e800, rc 0) 00000100:00100000:2.0:1788574333.806871:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1b9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f73678fb-d8c0-450f-a73b-e6565942045e+13:17798:x1875455681677440:12345-0@lo:101:mount.lustre.0 Request processed in 95us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574333.806877:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788574333.807070:0:17798:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c09500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:17798:1875455681677440:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788574333.807082:0:17798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c84c2617800/0x5bf8706fdac8d120 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d127 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574333.807091:0:17798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c84c2617800/0x5bf8706fdac8d120 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8d127 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788574333.807105:0:17798:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788574333.807124:0:17798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c84c2617800/0x5bf8706fdac8d120 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d127 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574333.807132:0:17798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c84c2617800/0x5bf8706fdac8d120 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d127 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788574333.807139:0:17798:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9c85c3688000 10000000:01000000:3.0:1788574333.807143:0:17798:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788574333.807147:0:17798:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9c85c3688000 from 1 10000000:01000000:3.0:1788574333.807149:0:17798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788574333.807163:0:17798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c84c2616200/0x5bf8706fdac8d12e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574333.807170:0:17798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c84c2616200/0x5bf8706fdac8d12e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574333.807177:0:17798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c84c2616200/0x5bf8706fdac8d12e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574333.807245:0:17798:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c09500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:17798:1875455681677568:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788574333.807274:0:17798:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574333.807347:0:17798:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c33d7840 going to sleep for 11 seconds 00000100:00100000:1.0:1788574333.807487:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681677568 00000100:00100000:1.0:1788574333.807502:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681677568 00000100:00100000:2.0:1788574333.807548:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788574333.807556:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1b9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f73678fb-d8c0-450f-a73b-e6565942045e+13:17798:x1875455681677568:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788574333.807565:0:17061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574333.807573:0:17061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85fa32f600/0x5bf8706fdac8d135 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8d12e expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574333.807588:0:17061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85fa32f600/0x5bf8706fdac8d135 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8d12e expref: 14 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574333.807595:0:17061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85fa32f600/0x5bf8706fdac8d135 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8d12e expref: 14 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574333.807602:0:17061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85fa32f600, rc 0) 00000100:00100000:2.0:1788574333.807640:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1b9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f73678fb-d8c0-450f-a73b-e6565942045e+14:17798:x1875455681677568:12345-0@lo:101:mount.lustre.0 Request processed in 85us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574333.807646:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788574333.807780:0:17798:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c09500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:17798:1875455681677568:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788574333.807791:0:17798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c84c2616200/0x5bf8706fdac8d12e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d135 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574333.807799:0:17798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c84c2616200/0x5bf8706fdac8d12e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8d135 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788574333.807810:0:17798:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788574333.807824:0:17798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c84c2616200/0x5bf8706fdac8d12e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d135 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574333.807831:0:17798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c84c2616200/0x5bf8706fdac8d12e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d135 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788574333.807837:0:17798:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1788574333.807842:0:17798:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788574333.807846:0:17798:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9c85c3688000 10000000:01000000:3.0:1788574333.807849:0:17798:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788574333.807852:0:17798:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:3.0:1788574333.807854:0:17798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1788574333.807869:0:17798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c84c2617600/0x5bf8706fdac8d13c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574333.807876:0:17798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c84c2617600/0x5bf8706fdac8d13c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574333.807882:0:17798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c84c2617600/0x5bf8706fdac8d13c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574333.807905:0:17798:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c09500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:17798:1875455681677696:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788574333.807933:0:17798:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574333.807956:0:17798:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c33d7840 going to sleep for 11 seconds 00000100:00100000:2.0:1788574333.808153:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681677696 00000100:00100000:2.0:1788574333.808158:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681677696 00000100:00100000:2.0:1788574333.808213:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788574333.808220:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1b9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f73678fb-d8c0-450f-a73b-e6565942045e+14:17798:x1875455681677696:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788574333.808235:0:17062:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574333.808244:0:17062:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85fa32ee00/0x5bf8706fdac8d143 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8d13c expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574333.808261:0:17062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85fa32ee00/0x5bf8706fdac8d143 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8d13c expref: 15 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574333.808269:0:17062:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85fa32ee00/0x5bf8706fdac8d143 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8d13c expref: 15 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574333.808276:0:17062:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85fa32ee00, rc 0) 00000100:00100000:2.0:1788574333.808311:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1b9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f73678fb-d8c0-450f-a73b-e6565942045e+15:17798:x1875455681677696:12345-0@lo:101:mount.lustre.0 Request processed in 91us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574333.808316:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788574333.808450:0:17798:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c09500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:17798:1875455681677696:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788574333.808462:0:17798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c84c2617600/0x5bf8706fdac8d13c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d143 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574333.808470:0:17798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c84c2617600/0x5bf8706fdac8d13c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8d143 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788574333.809945:0:17798:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:3.0:1788574333.810868:0:17798:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788574333.814802:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1788574333.814863:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:3.0:1788574333.814884:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:3.0:1788574333.814899:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:3.0:1788574333.814914:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:3.0:1788574333.814929:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:3.0:1788574333.814943:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:3.0:1788574333.814955:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:3.0:1788574333.815104:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:3.0:1788574333.815129:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:3.0:1788574333.815141:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:3.0:1788574333.815153:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:3.0:1788574333.815165:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:3.0:1788574333.815176:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:3.0:1788574333.815261:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:3.0:1788574333.815281:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:3.0:1788574333.815293:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:3.0:1788574333.815314:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:3.0:1788574333.815326:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:3.0:1788574333.815340:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:3.0:1788574333.815351:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:3.0:1788574333.815363:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:3.0:1788574333.815374:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:3.0:1788574333.815398:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:3.0:1788574333.815403:0:17798:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:3.0:1788574333.817919:0:17798:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c09500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:17798:1875455681677824:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788574333.818264:0:17798:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574333.818352:0:17798:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c33d79c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788574333.818398:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681677824 00000100:00100000:0.0:1788574333.818407:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681677824 00000100:00100000:0.0:1788574333.818511:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788574333.818521:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1b9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f73678fb-d8c0-450f-a73b-e6565942045e+15:17798:x1875455681677824:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788574333.818700:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1b9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f73678fb-d8c0-450f-a73b-e6565942045e+15:17798:x1875455681677824:12345-0@lo:501:mount.lustre.0 Request processed in 180us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574333.818707:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788574333.818782:0:17798:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c09500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:17798:1875455681677824:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788574333.818822:0:17798:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c09500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:17798:1875455681677952:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788574333.818873:0:17798:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574333.819004:0:17798:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c33d79c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788574333.819438:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681677952 00000100:00100000:2.0:1788574333.819445:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681677952 00000100:00100000:3.0:1788574333.819543:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788574333.819550:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1b9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f73678fb-d8c0-450f-a73b-e6565942045e+15:17798:x1875455681677952:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788574333.820440:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1b9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f73678fb-d8c0-450f-a73b-e6565942045e+15:17798:x1875455681677952:12345-0@lo:503:mount.lustre.0 Request processed in 885us (1562us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574333.820451:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788574333.820751:0:17798:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c09500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:17798:1875455681677952:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788574333.821421:0:17798:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788574333.822347:0:17798:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c300aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:17798:1875455681678080:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788574333.822430:0:17798:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574333.822470:0:17798:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c2568cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788574333.822547:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681678080 00000100:00100000:0.0:1788574333.822553:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681678080 00000100:00100000:0.0:1788574333.822604:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788574333.822613:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1b9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f73678fb-d8c0-450f-a73b-e6565942045e+15:17798:x1875455681678080:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788574333.823551:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1b9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f73678fb-d8c0-450f-a73b-e6565942045e+15:17798:x1875455681678080:12345-0@lo:502:mount.lustre.0 Request processed in 936us (1118us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574333.823562:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788574333.823783:0:17798:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c300aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:17798:1875455681678080:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788574333.824782:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1788574333.824825:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:3.0:1788574333.824852:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:3.0:1788574333.824867:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:3.0:1788574333.824878:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:3.0:1788574333.824889:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:3.0:1788574333.824902:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:3.0:1788574333.824913:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:3.0:1788574333.824925:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:3.0:1788574333.824936:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:3.0:1788574333.824948:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:3.0:1788574333.824959:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:3.0:1788574333.824970:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:3.0:1788574333.825168:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:3.0:1788574333.825185:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:3.0:1788574333.825375:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:3.0:1788574333.825389:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:3.0:1788574333.825404:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:3.0:1788574333.825417:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:3.0:1788574333.825433:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:3.0:1788574333.825447:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:3.0:1788574333.825462:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:3.0:1788574333.825476:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:3.0:1788574333.825501:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:3.0:1788574333.825518:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:3.0:1788574333.825532:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:3.0:1788574333.825547:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:3.0:1788574333.825561:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:3.0:1788574333.825575:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:3.0:1788574333.825588:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:3.0:1788574333.825601:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:3.0:1788574333.825614:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:3.0:1788574333.825627:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:3.0:1788574333.825641:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:3.0:1788574333.825764:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:3.0:1788574333.825796:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:3.0:1788574333.825810:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:3.0:1788574333.825825:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:3.0:1788574333.825838:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:3.0:1788574333.825851:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:3.0:1788574333.825865:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:3.0:1788574333.825879:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:3.0:1788574333.825891:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:3.0:1788574333.825902:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:3.0:1788574333.825946:0:17798:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c0a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:17798:1875455681678208:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788574333.826510:0:17798:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574333.826601:0:17798:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c2568cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788574333.826647:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681678208 00000100:00100000:2.0:1788574333.826717:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681678208 00000100:00100000:2.0:1788574333.826822:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788574333.826832:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1b9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f73678fb-d8c0-450f-a73b-e6565942045e+15:17798:x1875455681678208:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788574333.826967:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1b9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f73678fb-d8c0-450f-a73b-e6565942045e+15:17798:x1875455681678208:12345-0@lo:502:mount.lustre.0 Request processed in 136us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574333.826987:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788574333.827090:0:17798:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c0a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:17798:1875455681678208:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788574333.827155:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:3.0:1788574333.827167:0:17798:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:3.0:1788574333.828335:0:17802:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788574333.828348:0:17802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574333.828351:0:17802:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1788574333.828357:0:17802:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:3.0:1788574333.828361:0:17802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788574333.828386:0:17802:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9c85f746b380) 00000020:00000080:3.0:1788574333.828408:0:17802:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:3.0:1788574333.828417:0:17802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788574333.828508:0:17802:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788574333.828519:0:17802:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5bf8706fdac8d151 00000020:00000080:3.0:1788574333.828839:0:17802:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1788574333.828845:0:17802:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788574333.828849:0:17802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574333.828851:0:17802:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1788574333.828854:0:17802:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788574333.828857:0:17802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574333.828864:0:17802:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:3.0:1788574333.828869:0:17802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788574333.828876:0:17802:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9c85f746cd40) 00000020:00000080:3.0:1788574333.828889:0:17802:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:3.0:1788574333.828893:0:17802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788574333.828895:0:17802:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:3.0:1788574333.828898:0:17802:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:3.0:1788574333.828903:0:17802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788574333.828947:0:17802:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c85c3688000 from lustre-MDT0001, refs=2 00000020:00000080:3.0:1788574333.828960:0:17802:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9c85f74699c0) 00000020:00000080:3.0:1788574333.828968:0:17802:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:3.0:1788574333.829436:0:17802:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788574333.829442:0:17802:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5bf8706fdac8d166 00000020:00000080:3.0:1788574333.829556:0:17802:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:3.0:1788574333.829563:0:17802:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788574333.829568:0:17802:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x5bf8706fdac8d16d 00080000:01000000:3.0:1788574333.829573:0:17802:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788574333.829578:0:17802:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5bf8706fdac8d174 00000100:00100000:2.0:1788574333.848742:0:17107:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c267e900 going to sleep for 0 seconds 00010000:00010000:3.0:1788574333.895771:0:17802:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:3.0:1788574333.896371:0:17802:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:3.0:1788574333.896736:0:17802:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1788574333.897929:0:17802:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1788574333.897946:0:17802:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788574333.897952:0:17802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574333.897955:0:17802:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1788574333.897959:0:17802:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788574333.897964:0:17802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574333.897966:0:17802:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1788574333.897969:0:17802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788574333.897981:0:17802:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.151@tcp to nid 0x20000c0a8cc97 (192.168.204.151@tcp) 00000020:00000080:1.0:1788574333.898010:0:17802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788574333.898027:0:17802:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9c84c25119c0) 00000020:00000080:1.0:1788574333.898060:0:17802:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:1.0:1788574333.898073:0:17802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788574333.898140:0:17802:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1788574333.898147:0:17802:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788574333.898154:0:17802:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5bf8706fdac8d182 00010000:00080000:1.0:1788574333.898232:0:17802:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c8600d3f800@lustre-MDT0000-osp-MDT0001: add connection 192.168.204.151@tcp at head 00010000:00010000:1.0:1788574333.899954:0:17802:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:3.0:1788574333.909473:0:17802:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788574333.909503:0:17802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1788574333.909557:0:17802:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788574333.909584:0:17802:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5bf8706fdac8d189 00000100:00080000:3.0:1788574333.909594:0:17802:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788574333.909601:0:17802:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9c8600d3f800 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:3.0:1788574333.909642:0:17802:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c84c3c0a680 x1875455681678336/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788574333.909708:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1875455681678336:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788574333.909791:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788574333.909924:0:17802:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788574333.909954:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788574333.909968:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788574333.909971:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c85ffb61800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788574333.909975:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 469 00000100:00080000:3.0:1788574333.909980:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788574333.909985:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9c85ffb61800 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:3.0:1788574333.910002:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c84c3c08e00 x1875455681678464/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788574333.910208:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681678336 00000100:00100000:1.0:1788574333.910217:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681678336 00000100:00100000:1.0:1788574333.910326:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788574333.910335:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3616:x1875455681678336:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788574333.910358:0:17073:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 473 last 0 00000020:00000080:1.0:1788574333.910398:0:17073:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5bf8706fdac8d190 00000004:00100000:1.0:1788574333.910533:0:17073:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1788574333.910540:0:17073:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000020:01000000:2.0:1788574333.910840:0:17802:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788574333.910846:0:17802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574333.910855:0:17802:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:2.0:1788574333.910859:0:17802:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788574333.910862:0:17802:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1788574333.910864:0:17802:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788574333.910865:0:17802:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788574333.910867:0:17802:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788574333.910869:0:17802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574333.910871:0:17802:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788574333.910873:0:17802:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788574333.910877:0:17802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574333.910878:0:17802:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:2.0:1788574333.910882:0:17802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788574333.910932:0:17802:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788574333.910952:0:17802:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788574333.910956:0:17802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574333.910957:0:17802:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:2.0:1788574333.910959:0:17802:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788574333.910961:0:17802:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:2.0:1788574333.910962:0:17802:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788574333.910963:0:17802:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788574333.910965:0:17802:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788574333.910966:0:17802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574333.910967:0:17802:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788574333.910969:0:17802:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788574333.910973:0:17802:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1788574333.910975:0:17802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574333.910977:0:17802:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788574333.910980:0:17802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788574333.910983:0:17802:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.151@tcp to nid 0x20000c0a8cc97 (192.168.204.151@tcp) 00000020:01000000:2.0:1788574333.911005:0:17802:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1788574333.911008:0:17802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788574333.911024:0:17802:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9c84c303cd40) 00000020:00000080:2.0:1788574333.911038:0:17802:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1788574333.911042:0:17802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788574333.911112:0:17802:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:2.0:1788574333.911119:0:17802:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788574333.911125:0:17802:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5bf8706fdac8d19e 00010000:00080000:2.0:1788574333.911153:0:17802:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c85ffb1e800@lustre-OST0000-osc-MDT0001: add connection 192.168.204.151@tcp at head 00010000:00010000:2.0:1788574333.911432:0:17802:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:0.0:1788574333.911518:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875455681678464:0@lo:38:kworker.0 00000100:00100000:0.0:1788574333.911580:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574333.911718:0:17072:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:0.0:1788574333.911728:0:17072:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:0.0:1788574333.914803:0:17072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681678464 00000100:00100000:0.0:1788574333.915141:0:17072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681678464 00000100:00100000:0.0:1788574333.915282:0:17072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788574333.915292:0:17072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3616:x1875455681678464:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1788574333.915401:0:17072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3616:x1875455681678464:12345-0@lo:38:kworker.0 Request processed in 109us (3820us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788574333.915416:0:17072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788574333.915462:0:3616:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788574333.915472:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c85ffb61800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788574333.915476:0:3616:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788574333.915479:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875455681678464:0@lo:38:kworker.0 00000100:00080000:3.0:1788574333.915599:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788574333.915605:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788574333.915607:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788574333.915610:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788574333.916010:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875455681678592:0@lo:400:kworker.0 00000100:00100000:2.0:1788574333.916351:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:01000000:0.0:1788574333.919819:0:17802:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788574333.920441:0:17802:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:2.0:1788574333.921912:0:17073:0:(import.c:65:import_set_state_nolock()) ffff9c85ffb1c800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788574333.922032:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3616:x1875455681678336:12345-0@lo:38:llog_process_th.0 Request processed in 11695us (12239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574333.922073:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788574333.923315:0:3616:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788574333.923331:0:3616:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1788574333.923341:0:3616:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1788574333.923348:0:3616:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788574333.923351:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c8600d3f800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788574333.923374:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1875455681678336:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788574333.923775:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681678720:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788574333.923847:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574333.923935:0:17072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681678720 00000100:00100000:1.0:1788574333.923943:0:17072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681678720 00000100:00100000:1.0:1788574333.923997:0:17072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788574333.924007:0:17072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c300b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3618:x1875455681678720:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788574333.924046:0:17072:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788574333.924108:0:17072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c300b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3618:x1875455681678720:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574333.924115:0:17072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788574333.924850:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681678720:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1788574333.926934:0:17802:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788574333.927618:0:17802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1788574333.927776:0:17802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000100:00100000:3.0:1788574333.928411:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681678592 00000100:00100000:3.0:1788574333.928421:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681678592 00000100:00100000:3.0:1788574333.928540:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788574333.928552:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3009f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875455681678592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574333.928659:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3009f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875455681678592:12345-0@lo:400:kworker.0 Request processed in 109us (12308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574333.928666:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788574333.928747:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c84c3c0b480 x1875455681678592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574349 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574333.928781:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875455681678592:0@lo:400:kworker.0 00000040:00080000:1.0:1788574333.929589:0:17808:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788574333.929595:0:17808:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1788574333.930716:0:17802:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788574333.930729:0:17802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788574333.930770:0:17802:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788574333.930795:0:17802:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5bf8706fdac8d1a5 00000100:00080000:0.0:1788574333.930806:0:17802:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788574333.930814:0:17802:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9c85ffb1e800 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:0.0:1788574333.930849:0:17802:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c84c36ddf80 x1875455681678848/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788574333.930910:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1875455681678848:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788574333.930963:0:3616:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875455681678848 offset 0 length 520: 4 00000100:00080000:0.0:1788574333.931023:0:17802:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1788574333.931107:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788574333.931112:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788574333.931115:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788574333.931118:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:0.0:1788574333.931212:0:17802:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788574333.931217:0:17802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788574333.931219:0:17802:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788574333.931222:0:17802:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788574333.931234:0:17802:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:0.0:1788574333.931236:0:17802:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788574333.931238:0:17802:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788574333.931240:0:17802:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788574333.931242:0:17802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788574333.931244:0:17802:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788574333.931246:0:17802:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788574333.931250:0:17802:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1788574333.931253:0:17802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788574333.931254:0:17802:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788574333.931257:0:17802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788574333.931261:0:17802:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.151@tcp to nid 0x20000c0a8cc97 (192.168.204.151@tcp) 00000020:01000000:0.0:1788574333.931279:0:17802:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1788574333.931281:0:17802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788574333.931292:0:17802:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9c85fa0b8000) 00000020:00000080:0.0:1788574333.931303:0:17802:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:0.0:1788574333.931307:0:17802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788574333.931366:0:17802:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:0.0:1788574333.931372:0:17802:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788574333.931377:0:17802:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5bf8706fdac8d1b3 00010000:00080000:0.0:1788574333.931405:0:17802:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c84c2272000@lustre-OST0001-osc-MDT0001: add connection 192.168.204.151@tcp at head 00010000:00010000:0.0:1788574333.931628:0:17802:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:0.0:1788574333.931697:0:17802:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788574333.931711:0:17802:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1788574333.933671:0:17802:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788574333.933868:0:17802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1788574333.934048:0:17802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1788574333.934724:0:17810:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788574333.934734:0:17810:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788574333.935597:0:17802:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788574333.935609:0:17802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788574333.935646:0:17802:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788574333.935669:0:17802:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5bf8706fdac8d1ba 00000100:00080000:0.0:1788574333.935679:0:17802:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788574333.935691:0:17802:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9c84c2272000 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:0.0:1788574333.935724:0:17802:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c84c36dea00 x1875455681678976/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788574333.935785:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1875455681678976:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788574333.935846:0:3616:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875455681678976 offset 0 length 520: 4 00000100:00080000:0.0:1788574333.935903:0:17802:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1788574333.935996:0:17802:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788574333.935999:0:17802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788574333.936001:0:17802:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788574333.936004:0:17802:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788574333.936008:0:17802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788574333.936009:0:17802:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788574333.936012:0:17802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788574333.936014:0:17802:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788574333.936016:0:17802:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788574333.936018:0:17802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788574333.936019:0:17802:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788574333.936021:0:17802:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788574333.936023:0:17802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788574333.936024:0:17802:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788574333.936027:0:17802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788574333.936060:0:17802:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788574333.936063:0:17802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788574333.936064:0:17802:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788574333.936067:0:17802:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000020:01000000:0.0:1788574333.936130:0:17798:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:0.0:1788574333.936159:0:17798:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1788574333.936173:0:17798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c84c2617600/0x5bf8706fdac8d13c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d143 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574333.936212:0:17798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c84c2617600/0x5bf8706fdac8d13c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d143 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788574333.936220:0:17798:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c85c3688000 from 1 10000000:01000000:0.0:1788574333.936228:0:17798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788574333.936252:0:17798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7200/0x5bf8706fdac8d1c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574333.936260:0:17798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7200/0x5bf8706fdac8d1c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574333.936271:0:17798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7200/0x5bf8706fdac8d1c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574333.936285:0:17798:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36de680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:17798:1875455681679104:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788574333.936322:0:17798:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574333.936335:0:17798:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c8f0d9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788574333.936592:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681679104 00000100:00100000:1.0:1788574333.936600:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681679104 00000100:00100000:1.0:1788574333.936650:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788574333.936659:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1b9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f73678fb-d8c0-450f-a73b-e6565942045e+15:17798:x1875455681679104:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788574333.936672:0:17060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574333.936684:0:17060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85d08a2000/0x5bf8706fdac8d1c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8d1c1 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574333.936708:0:17060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85d08a2000/0x5bf8706fdac8d1c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8d1c1 expref: 16 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574333.936717:0:17060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85d08a2000/0x5bf8706fdac8d1c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8d1c1 expref: 16 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574333.936725:0:17060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d08a2000, rc 0) 00000100:00100000:1.0:1788574333.936763:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1b9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f73678fb-d8c0-450f-a73b-e6565942045e+16:17798:x1875455681679104:12345-0@lo:101:mount.lustre.0 Request processed in 105us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574333.936771:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788574333.936861:0:17798:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36de680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:17798:1875455681679104:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788574333.936875:0:17798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7200/0x5bf8706fdac8d1c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d1c8 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574333.936885:0:17798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7200/0x5bf8706fdac8d1c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8d1c8 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574333.937539:0:17798:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36de680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:17798:1875455681679232:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1788574333.937585:0:17798:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574333.937607:0:17798:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c8f0d9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788574333.937683:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681679232 00000100:00100000:2.0:1788574333.937688:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681679232 00000100:00100000:2.0:1788574333.937754:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788574333.937762:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1b9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f73678fb-d8c0-450f-a73b-e6565942045e+16:17798:x1875455681679232:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1788574333.937776:0:17061:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788574333.937794:0:17061:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788574333.937797:0:17061:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1788574333.937883:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1b9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f73678fb-d8c0-450f-a73b-e6565942045e+16:17798:x1875455681679232:12345-0@lo:256:mount.lustre.0 Request processed in 121us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574333.937891:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788574333.937946:0:17798:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36de680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:17798:1875455681679232:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1788574333.938559:0:17798:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788574333.938577:0:17798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7200/0x5bf8706fdac8d1c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d1c8 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574333.938599:0:17798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7200/0x5bf8706fdac8d1c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d1c8 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788574333.938609:0:17798:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c85c3688000 from 1 10000000:01000000:0.0:1788574333.938611:0:17798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788574333.938636:0:17798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7c00/0x5bf8706fdac8d1cf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574333.938644:0:17798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7c00/0x5bf8706fdac8d1cf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574333.938653:0:17798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7c00/0x5bf8706fdac8d1cf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574333.938670:0:17798:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36de680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:17798:1875455681679360:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788574333.938705:0:17798:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788574333.938761:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788574333.938765:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788574333.938768:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788574333.938771:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788574333.939165:0:17798:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c8f0d9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788574333.939324:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681679360 00000100:00100000:1.0:1788574333.939330:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681679360 00000100:00100000:1.0:1788574333.939361:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788574333.939368:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1b9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f73678fb-d8c0-450f-a73b-e6565942045e+16:17798:x1875455681679360:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788574333.939378:0:17060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574333.939396:0:17060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85d08a3a00/0x5bf8706fdac8d1d6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8d1cf expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574333.939418:0:17060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85d08a3a00/0x5bf8706fdac8d1d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8d1cf expref: 17 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574333.939429:0:17060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85d08a3a00/0x5bf8706fdac8d1d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8d1cf expref: 17 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574333.939437:0:17060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d08a3a00, rc 0) 00000100:00100000:1.0:1788574333.939484:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1b9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f73678fb-d8c0-450f-a73b-e6565942045e+17:17798:x1875455681679360:12345-0@lo:101:mount.lustre.0 Request processed in 116us (778us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574333.939510:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788574333.939586:0:17798:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36de680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:17798:1875455681679360:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788574333.939600:0:17798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7c00/0x5bf8706fdac8d1cf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d1d6 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574333.939610:0:17798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7c00/0x5bf8706fdac8d1cf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8d1d6 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788574333.939731:0:17798:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788574333.939762:0:17798:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36de680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:17798:1875455681679488:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788574333.939787:0:17798:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574333.939827:0:17798:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c8f0dd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788574333.939871:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681679488 00000100:00100000:1.0:1788574333.939875:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681679488 00000100:00100000:1.0:1788574333.939890:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788574333.939895:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601806450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f73678fb-d8c0-450f-a73b-e6565942045e+17:17798:x1875455681679488:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788574333.939972:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601806450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f73678fb-d8c0-450f-a73b-e6565942045e+17:17798:x1875455681679488:12345-0@lo:501:mount.lustre.0 Request processed in 75us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574333.939978:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788574333.940032:0:17798:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36de680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:17798:1875455681679488:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788574333.940122:0:17798:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36de680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:17798:1875455681679616:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788574333.940157:0:17798:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574333.940265:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681679616 00000100:00100000:1.0:1788574333.940269:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681679616 00000100:00100000:1.0:1788574333.940283:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788574333.940288:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601804850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f73678fb-d8c0-450f-a73b-e6565942045e+17:17798:x1875455681679616:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788574333.940350:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601804850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f73678fb-d8c0-450f-a73b-e6565942045e+17:17798:x1875455681679616:12345-0@lo:503:mount.lustre.0 Request processed in 61us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574333.940357:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788574333.940418:0:17798:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c8f0dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788574333.940431:0:17798:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36de680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:17798:1875455681679616:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788574333.941453:0:17798:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788574333.941556:0:17798:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36de680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:17798:1875455681679744:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788574333.941616:0:17798:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574333.941691:0:17798:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c8f0d9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788574333.941727:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681679744 00000100:00100000:1.0:1788574333.941738:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681679744 00000100:00100000:1.0:1788574333.941803:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788574333.941811:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601806050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f73678fb-d8c0-450f-a73b-e6565942045e+17:17798:x1875455681679744:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788574333.941917:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601806050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f73678fb-d8c0-450f-a73b-e6565942045e+17:17798:x1875455681679744:12345-0@lo:502:mount.lustre.0 Request processed in 107us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574333.941925:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788574333.941994:0:17798:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36de680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:17798:1875455681679744:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788574333.942242:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1788574333.942268:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:0.0:1788574333.942280:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:0.0:1788574333.942290:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:0.0:1788574333.942301:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:0.0:1788574333.942312:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:0.0:1788574333.942323:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:0.0:1788574333.942334:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:0.0:1788574333.942344:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1788574333.942354:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:0.0:1788574333.942365:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:0.0:1788574333.942385:0:17798:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36de680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:17798:1875455681679872:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788574333.942419:0:17798:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574333.942731:0:17798:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c8f0d9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788574333.942790:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681679872 00000100:00100000:2.0:1788574333.942795:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681679872 00000100:00100000:2.0:1788574333.942823:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788574333.942829:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601804450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f73678fb-d8c0-450f-a73b-e6565942045e+17:17798:x1875455681679872:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788574333.942952:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601804450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f73678fb-d8c0-450f-a73b-e6565942045e+17:17798:x1875455681679872:12345-0@lo:502:mount.lustre.0 Request processed in 122us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574333.942960:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788574333.943124:0:17798:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36de680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:17798:1875455681679872:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788574333.943317:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:0.0:1788574333.943334:0:17798:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1788574333.943830:0:17812:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788574333.943840:0:17812:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574333.943843:0:17812:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788574333.943851:0:17812:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c85c3688000 00000020:00000080:3.0:1788574333.943853:0:17812:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788574333.943862:0:17812:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788574333.943865:0:17812:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574333.943866:0:17812:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788574333.943868:0:17812:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788574333.943870:0:17812:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574333.943872:0:17812:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788574333.943875:0:17812:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c85c3688000 00000020:00000080:3.0:1788574333.943876:0:17812:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788574333.943969:0:17812:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788574333.943973:0:17812:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574333.943974:0:17812:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788574333.943977:0:17812:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788574333.943979:0:17812:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574333.943980:0:17812:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788574333.943983:0:17812:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c85c3688000 00000020:00000080:3.0:1788574333.943985:0:17812:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788574333.946819:0:17812:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788574333.949707:0:17812:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574333.949715:0:17812:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788574333.949726:0:17812:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788574333.949732:0:17812:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574333.949733:0:17812:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788574333.949739:0:17812:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c85c3688000 00000020:00000080:1.0:1788574333.949742:0:17812:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788574333.950167:0:17812:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788574333.950174:0:17812:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574333.950175:0:17812:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788574333.950178:0:17812:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:0.0:1788574333.950555:0:17798:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1788574333.950592:0:17798:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788574333.950619:0:17798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7c00/0x5bf8706fdac8d1cf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d1d6 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574333.950633:0:17798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7c00/0x5bf8706fdac8d1cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d1d6 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788574333.950691:0:17798:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788574333.950695:0:17798:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c85c3688000 10000000:01000000:0.0:1788574333.950721:0:17798:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c85c3688000 10000000:01000000:0.0:1788574333.950728:0:17798:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788574333.950734:0:17798:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c85c3688000 from 1 10000000:01000000:0.0:1788574333.950737:0:17798:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788574333.950791:0:17798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6e00/0x5bf8706fdac8d1dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574333.950800:0:17798:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6e00/0x5bf8706fdac8d1dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574333.950811:0:17798:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6e00/0x5bf8706fdac8d1dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574333.950837:0:17798:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36de680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:17798:1875455681680000:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788574333.950911:0:17798:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574333.950953:0:17798:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c8f0dd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788574333.951257:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681680000 00000100:00100000:2.0:1788574333.951266:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681680000 00000100:00100000:2.0:1788574333.951311:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788574333.951321:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601805c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f73678fb-d8c0-450f-a73b-e6565942045e+17:17798:x1875455681680000:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788574333.951335:0:17061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574333.951348:0:17061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85fa32e000/0x5bf8706fdac8d1e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8d1dd expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574333.951372:0:17061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85fa32e000/0x5bf8706fdac8d1e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8d1dd expref: 18 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574333.951384:0:17061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85fa32e000/0x5bf8706fdac8d1e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8d1dd expref: 18 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574333.951394:0:17061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85fa32e000, rc 0) 00000100:00100000:2.0:1788574333.951446:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601805c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f73678fb-d8c0-450f-a73b-e6565942045e+18:17798:x1875455681680000:12345-0@lo:101:mount.lustre.0 Request processed in 126us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574333.951462:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788574333.951658:0:17798:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36de680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:17798:1875455681680000:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788574333.951674:0:17798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6e00/0x5bf8706fdac8d1dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d1e4 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574333.951697:0:17798:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6e00/0x5bf8706fdac8d1dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8d1e4 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788574333.955688:0:17798:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:0.0:1788574333.955984:0:17798:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788574333.956234:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:0.0:1788574333.956260:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:0.0:1788574333.956284:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:0.0:1788574333.956296:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:0.0:1788574333.956306:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:0.0:1788574333.956317:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:0.0:1788574333.956327:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:0.0:1788574333.956338:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:0.0:1788574333.956348:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:0.0:1788574333.956359:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:0.0:1788574333.956370:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:0.0:1788574333.956380:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:0.0:1788574333.956391:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:0.0:1788574333.956401:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:0.0:1788574333.956412:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:0.0:1788574333.956422:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:0.0:1788574333.956433:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:0.0:1788574333.956443:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:0.0:1788574333.956464:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:0.0:1788574333.956475:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:0.0:1788574333.956502:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:0.0:1788574333.956518:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:0.0:1788574333.956531:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:0.0:1788574333.956544:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:0.0:1788574333.956558:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:0.0:1788574333.956571:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:0.0:1788574333.956596:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:0.0:1788574333.956609:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:0.0:1788574333.956627:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:0.0:1788574333.956633:0:17798:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:0.0:1788574333.956713:0:17798:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36de680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:17798:1875455681680128:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788574333.956783:0:17798:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574333.956829:0:17798:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c8f0d000 going to sleep for 11 seconds 00000100:00100000:3.0:1788574333.956919:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681680128 00000100:00100000:3.0:1788574333.956926:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681680128 00000100:00100000:1.0:1788574333.962790:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788574333.962888:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601804c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f73678fb-d8c0-450f-a73b-e6565942045e+18:17798:x1875455681680128:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788574333.963186:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601804c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f73678fb-d8c0-450f-a73b-e6565942045e+18:17798:x1875455681680128:12345-0@lo:501:mount.lustre.0 Request processed in 381us (6402us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574333.963216:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788574333.963350:0:17798:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36de680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:17798:1875455681680128:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788574333.963413:0:17798:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c08000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:17798:1875455681680256:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788574333.963504:0:17798:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574333.963539:0:17798:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c86019839c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788574333.963650:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681680256 00000100:00100000:1.0:1788574333.963656:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681680256 00000100:00100000:1.0:1788574333.963735:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788574333.963744:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601805450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f73678fb-d8c0-450f-a73b-e6565942045e+18:17798:x1875455681680256:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788574333.963840:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601805450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f73678fb-d8c0-450f-a73b-e6565942045e+18:17798:x1875455681680256:12345-0@lo:503:mount.lustre.0 Request processed in 96us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574333.963854:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788574333.963978:0:17798:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c08000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:17798:1875455681680256:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788574333.964545:0:17798:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788574333.964631:0:17798:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c300aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:17798:1875455681680384:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788574333.964677:0:17798:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574333.964716:0:17798:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85e5770240 going to sleep for 11 seconds 00000100:00100000:1.0:1788574333.964765:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681680384 00000100:00100000:1.0:1788574333.964771:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681680384 00000100:00100000:1.0:1788574333.964837:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788574333.964846:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601807c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f73678fb-d8c0-450f-a73b-e6565942045e+18:17798:x1875455681680384:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788574333.964935:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601807c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f73678fb-d8c0-450f-a73b-e6565942045e+18:17798:x1875455681680384:12345-0@lo:502:mount.lustre.0 Request processed in 90us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574333.964942:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788574333.965006:0:17798:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c300aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:17798:1875455681680384:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788574333.965369:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1788574333.965396:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:2.0:1788574333.965423:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:2.0:1788574333.965439:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:2.0:1788574333.965452:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:2.0:1788574333.965464:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:2.0:1788574333.965477:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:2.0:1788574333.965504:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:2.0:1788574333.965520:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:2.0:1788574333.965532:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:2.0:1788574333.965545:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:2.0:1788574333.965559:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:2.0:1788574333.965574:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:2.0:1788574333.965587:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:2.0:1788574333.965599:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:2.0:1788574333.965611:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:2.0:1788574333.965624:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:2.0:1788574333.965637:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:2.0:1788574333.965664:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:2.0:1788574333.965681:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:2.0:1788574333.965695:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:2.0:1788574333.965707:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:2.0:1788574333.965719:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:2.0:1788574333.965744:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:2.0:1788574333.965759:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:2.0:1788574333.965774:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:2.0:1788574333.965789:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:2.0:1788574333.965802:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:2.0:1788574333.965817:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:2.0:1788574333.965830:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:2.0:1788574333.965841:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:2.0:1788574333.965852:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:2.0:1788574333.965864:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:2.0:1788574333.965876:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:2.0:1788574333.965904:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:2.0:1788574333.965920:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:2.0:1788574333.965932:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:2.0:1788574333.965942:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:2.0:1788574333.965955:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:2.0:1788574333.965968:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:2.0:1788574333.965981:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:2.0:1788574333.965995:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:2.0:1788574333.966008:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:2.0:1788574333.966022:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:2.0:1788574333.966133:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:2.0:1788574333.966152:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:2.0:1788574333.966164:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:2.0:1788574333.966308:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:2.0:1788574333.966358:0:17798:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c300aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:17798:1875455681680512:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788574333.966419:0:17798:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574333.966517:0:17798:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85e5770240 going to sleep for 11 seconds 00000100:00100000:1.0:1788574333.966629:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681680512 00000100:00100000:1.0:1788574333.966636:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681680512 00000100:00100000:1.0:1788574333.966714:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788574333.966722:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601804050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f73678fb-d8c0-450f-a73b-e6565942045e+18:17798:x1875455681680512:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788574333.966824:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601804050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f73678fb-d8c0-450f-a73b-e6565942045e+18:17798:x1875455681680512:12345-0@lo:502:mount.lustre.0 Request processed in 102us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574333.966831:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788574333.966901:0:17798:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c300aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:17798:1875455681680512:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788574333.967143:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:2.0:1788574333.967175:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:2.0:1788574333.967455:0:17798:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c300aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:17798:1875455681680640:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788574333.968033:0:17798:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574333.968144:0:17798:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85e5770240 going to sleep for 11 seconds 00000100:00100000:1.0:1788574333.968352:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681680640 00000100:00100000:1.0:1788574333.968359:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681680640 00000100:00100000:1.0:1788574333.968438:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788574333.968447:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601806c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f73678fb-d8c0-450f-a73b-e6565942045e+18:17798:x1875455681680640:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788574333.968577:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601806c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f73678fb-d8c0-450f-a73b-e6565942045e+18:17798:x1875455681680640:12345-0@lo:502:mount.lustre.0 Request processed in 121us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574333.968585:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788574333.968822:0:17798:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c300aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:17798:1875455681680640:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788574333.968890:0:17798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:2.0:1788574333.968903:0:17798:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1788574333.972169:0:17817:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:0.0:1788574333.972214:0:17817:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9c85fa0b99c0) 00000020:00000080:0.0:1788574333.972238:0:17817:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:0.0:1788574333.972337:0:17817:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c85c3688000 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1788574333.972341:0:17817:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c85c3688000 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1788574333.972344:0:17817:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c85c3688000 3 00010000:00080000:0.0:1788574333.972380:0:17817:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c85cbbe1800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.204.151@tcp at head 00010000:00010000:0.0:1788574333.975168:0:17817:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:0.0:1788574333.975414:0:17817:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:0.0:1788574333.975457:0:17817:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788574333.975470:0:17817:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x5bf8706fdac8d1f2 00000100:00080000:0.0:1788574333.975480:0:17817:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788574333.975562:0:17817:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9c85cbbe1800 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:0.0:1788574333.975602:0:17817:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c84c36de680 x1875455681680768/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788574333.975642:0:17817:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788574333.975671:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788574333.975675:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788574333.975676:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875455681680768:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1788574333.975678:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788574333.975681:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788574333.975760:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574333.975835:0:17067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681680768 00000100:00100000:3.0:1788574333.975844:0:17067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681680768 00000100:00100000:3.0:1788574333.975878:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788574333.975885:0:17067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3616:x1875455681680768:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788574333.975908:0:17067:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 473 last 0 00000020:00000080:3.0:1788574333.975950:0:17067:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x5bf8706fdac8d1f9 00000004:00100000:3.0:1788574333.975968:0:17067:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788574333.975997:0:17067:0:(import.c:65:import_set_state_nolock()) ffff9c85fa1fc000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788574333.976068:0:17067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875455681680768:12345-0@lo:38:llog_process_th.0 Request processed in 182us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574333.976076:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788574333.976174:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c84c36de680 x1875455681680768/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788574343 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574333.976186:0:3616:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788574333.976221:0:3616:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1788574333.976229:0:3616:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788574333.976233:0:3616:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788574333.976235:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c85cbbe1800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788574333.976241:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875455681680768:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1788574333.976466:0:17817:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:2.0:1788574333.978119:0:17798:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788574333.978165:0:17798:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788574333.978601:0:17798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6e00/0x5bf8706fdac8d1dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d1e4 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574333.978614:0:17798:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6e00/0x5bf8706fdac8d1dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d1e4 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788574333.978839:0:17798:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788574333.978842:0:17798:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788574333.978843:0:17798:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788574333.978844:0:17798:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788574333.978845:0:17798:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788574333.978847:0:17798:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788574333.978848:0:17798:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788574333.978850:0:17798:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788574333.978851:0:17798:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788574333.978855:0:17798:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:2.0:1788574333.978858:0:17798:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788574333.978859:0:17798:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788574333.978860:0:17798:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788574333.978862:0:17798:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788574333.978863:0:17798:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788574333.978864:0:17798:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788574333.978865:0:17798:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788574333.978866:0:17798:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788574333.978868:0:17798:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788574333.978893:0:17798:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1788574333.978916:0:17798:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c300aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:17798:1875455681680896:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788574333.978990:0:17798:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574333.979165:0:17798:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85e5770240 going to sleep for 11 seconds 00000100:00100000:0.0:1788574333.979347:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681680896 00000100:00100000:0.0:1788574333.979354:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681680896 00000100:00100000:0.0:1788574333.979436:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788574333.979446:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c536a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f73678fb-d8c0-450f-a73b-e6565942045e+18:17798:x1875455681680896:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788574333.979473:0:17061:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788574333.979586:0:17061:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:1.0:1788574333.982759:0:17047:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1788574333.982932:0:17061:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788574333.982972:0:17061:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:1.0:1788574333.983131:0:17083:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788574333.983136:0:17083:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788574333.983157:0:17083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c85d08a3200/0x5bf8706fdac8d200 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574333.983181:0:17083:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c85d20d7600/0x5bf8706fdac8d104 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8d0fd expref: 18 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574333.983363:0:17083:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c85d08a2000/0x5bf8706fdac8d1c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8d1c1 expref: 18 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574333.983371:0:17083:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c85d08a3200/0x5bf8706fdac8d200 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574333.983411:0:17083:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c85d08a2000/0x5bf8706fdac8d1c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5bf8706fdac8d1c1 expref: 18 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574333.983424:0:17083:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c85d08a2000/0x5bf8706fdac8d1c8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5bf8706fdac8d1c1 expref: 18 pid: 17060 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574333.983438:0:17083:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335c380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17083:1875455681681024:0@lo:104: 00000100:00100000:1.0:1788574333.983513:0:17083:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788574333.983562:0:17083:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c85d20d7600/0x5bf8706fdac8d104 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5bf8706fdac8d0fd expref: 18 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574333.983570:0:17083:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c85d20d7600/0x5bf8706fdac8d104 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5bf8706fdac8d0fd expref: 18 pid: 17062 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574333.983579:0:17083:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335ed80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17083:1875455681681152:0@lo:104: 00000100:00100000:1.0:1788574333.983601:0:17083:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574333.983618:0:17083:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c353b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788574333.983656:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681681024 00000100:00100000:1.0:1788574333.983663:0:17051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681681024 00000100:00100000:1.0:1788574333.983693:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681681152 00000100:00100000:1.0:1788574333.983701:0:17051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681681152 00000100:00100000:1.0:1788574333.983719:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788574333.983727:0:17051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c335df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f73678fb-d8c0-450f-a73b-e6565942045e+4:17083:x1875455681681024:12345-0@lo:104: 00010000:00010000:1.0:1788574333.983739:0:17051:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7200/0x5bf8706fdac8d1c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8d1c8 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574333.983786:0:17051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788574333.983792:0:17051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c335df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f73678fb-d8c0-450f-a73b-e6565942045e+4:17083:x1875455681681024:12345-0@lo:104: Request processed in 66us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574333.983799:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788574333.983827:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788574333.983833:0:17051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c335d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f73678fb-d8c0-450f-a73b-e6565942045e+3:17083:x1875455681681152:12345-0@lo:104: 00010000:00010000:1.0:1788574333.983841:0:17051:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff9c84c2617000/0x5bf8706fdac8d0fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8d104 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574333.983869:0:17051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788574333.983873:0:17051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c335d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f73678fb-d8c0-450f-a73b-e6565942045e+3:17083:x1875455681681152:12345-0@lo:104: Request processed in 41us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574333.983878:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1788574333.983895:0:17055:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788574333.983901:0:17055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7200/0x5bf8706fdac8d1c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8d1c8 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574333.983907:0:17055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d7200 already unused, calling callback (ffffffffc1472c20) 10000000:00010000:1.0:1788574333.983911:0:17055:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7200/0x5bf8706fdac8d1c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5bf8706fdac8d1c8 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574333.983918:0:17055:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7200/0x5bf8706fdac8d1c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5bf8706fdac8d1c8 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788574333.983934:0:17055:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7200/0x5bf8706fdac8d1c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5bf8706fdac8d1c8 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788574333.983939:0:17055:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788574333.983966:0:17055:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7200/0x5bf8706fdac8d1c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8d1c8 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574333.983972:0:17055:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788574333.983987:0:17055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7200/0x5bf8706fdac8d1c1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8d1c8 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574333.983994:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f73678fb-d8c0-450f-a73b-e6565942045e:3619:1875455681681280:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788574333.983994:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7200/0x5bf8706fdac8d1c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8d1c8 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574333.984005:0:17055:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788574333.984008:0:17055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c84c2617000/0x5bf8706fdac8d0fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8d104 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574333.984013:0:17055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c84c2617000 already unused, calling callback (ffffffffc1472c20) 10000000:00010000:1.0:1788574333.984016:0:17055:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c84c2617000/0x5bf8706fdac8d0fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5bf8706fdac8d104 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574333.984023:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788574333.984023:0:17055:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c84c2617000/0x5bf8706fdac8d0fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5bf8706fdac8d104 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788574333.984029:0:17055:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c84c2617000/0x5bf8706fdac8d0fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5bf8706fdac8d104 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788574333.984034:0:17055:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:3.0:1788574333.984051:0:17052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681681280 00010000:00010000:1.0:1788574333.984054:0:17055:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9c84c2617000/0x5bf8706fdac8d0fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8d104 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574333.984055:0:17052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681681280 00010000:00010000:1.0:1788574333.984060:0:17055:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788574333.984071:0:17052:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c85d08a2000/0x5bf8706fdac8d1c8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8d1c1 expref: 19 pid: 17060 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574333.984092:0:17052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788574333.984098:0:17052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f73678fb-d8c0-450f-a73b-e6565942045e+19:3619:x1875455681681280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788574333.984114:0:17052:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574333.984119:0:17052:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c85d08a2000/0x5bf8706fdac8d1c8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8d1c1 expref: 19 pid: 17060 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574333.984129:0:17052:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c85d08a2000/0x5bf8706fdac8d1c8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5bf8706fdac8d1c1 expref: 19 pid: 17060 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574333.984144:0:17052:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788574333.984176:0:17052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f73678fb-d8c0-450f-a73b-e6565942045e+19:3619:x1875455681681280:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574333.984181:0:17052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788574333.984233:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f73678fb-d8c0-450f-a73b-e6565942045e:3619:1875455681681280:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788574333.984303:0:17055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c84c2617000/0x5bf8706fdac8d0fd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8d104 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574333.984311:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c84c2617000/0x5bf8706fdac8d0fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8d104 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574333.984323:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574333.984325:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574333.984327:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574333.984344:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f73678fb-d8c0-450f-a73b-e6565942045e:3620:1875455681681408:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788574333.984370:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574333.984397:0:17054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681681408 00000100:00100000:1.0:1788574333.984400:0:17054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681681408 00010000:00010000:1.0:1788574333.984415:0:17054:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c85d20d7600/0x5bf8706fdac8d104 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8d0fd expref: 19 pid: 17062 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574333.984433:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788574333.984439:0:17054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c335d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f73678fb-d8c0-450f-a73b-e6565942045e+19:3620:x1875455681681408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788574333.984446:0:17054:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574333.984450:0:17054:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c85d20d7600/0x5bf8706fdac8d104 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8d0fd expref: 19 pid: 17062 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574333.984458:0:17054:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c85d20d7600/0x5bf8706fdac8d104 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5bf8706fdac8d0fd expref: 19 pid: 17062 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574333.984470:0:17054:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c85d08a3200/0x5bf8706fdac8d200 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574333.984498:0:17054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85d08a3200/0x5bf8706fdac8d200 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788574333.984512:0:17054:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001857578s 00010000:00010000:1.0:1788574333.984517:0:17054:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c85d08a3200/0x5bf8706fdac8d200 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574333.984524:0:17054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c85d08a3200/0x5bf8706fdac8d200 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574333.984531:0:17054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c85d08a3200/0x5bf8706fdac8d200 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574333.984537:0:17054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c85d08a3200/0x5bf8706fdac8d200 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574333.984543:0:17054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d08a3200 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:1.0:1788574333.984547:0:17054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c85d08a3200/0x5bf8706fdac8d200 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574333.984555:0:17054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c85d08a3200/0x5bf8706fdac8d200 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574333.984564:0:17054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c85d08a3200/0x5bf8706fdac8d200 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574333.984573:0:17054:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788574333.984602:0:17054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c335d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f73678fb-d8c0-450f-a73b-e6565942045e+19:3620:x1875455681681408:12345-0@lo:103:ldlm_bl.0 Request processed in 162us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574333.984609:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788574333.984640:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f73678fb-d8c0-450f-a73b-e6565942045e:3620:1875455681681408:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788574333.984663:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85d08a2000/0x5bf8706fdac8d1c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5bf8706fdac8d1c1 expref: 18 pid: 17060 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574333.984672:0:17083:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335c380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17083:1875455681681024:0@lo:104: 00010000:00010000:1.0:1788574333.984680:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85d20d7600/0x5bf8706fdac8d104 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5bf8706fdac8d0fd expref: 17 pid: 17062 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574333.984688:0:17083:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335ed80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17083:1875455681681152:0@lo:104: 00010000:00010000:1.0:1788574333.984700:0:17083:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c85d08a3200/0x5bf8706fdac8d200 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574333.984709:0:17083:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c85d08a3200/0x5bf8706fdac8d200 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574333.984715:0:17083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c85d08a3200/0x5bf8706fdac8d200 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574333.984720:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85d08a3200/0x5bf8706fdac8d200 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574333.984957:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574333.985049:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c536a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f73678fb-d8c0-450f-a73b-e6565942045e+16:17798:x1875455681680896:12345-0@lo:253:mount.lustre.0 Request processed in 5605us (6059us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574333.985058:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788574333.985128:0:17798:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c300aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:17798:1875455681680896:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788574333.985138:0:17798:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1788574333.985141:0:17798:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788574333.985143:0:17798:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788574333.985144:0:17798:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788574333.985145:0:17798:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788574333.985146:0:17798:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788574333.985147:0:17798:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788574333.985149:0:17798:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788574333.985150:0:17798:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788574333.985152:0:17798:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788574333.985162:0:17798:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000040:01000000:3.0:1788574333.993941:0:17798:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:2.0:1788574333.994117:0:17823:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:2.0:1788574333.994122:0:17823:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:2.0:1788574333.994273:0:17824:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788574333.994726:0:17798:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:2.0:1788574333.994865:0:17824:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:3.0:1788574333.996438:0:17798:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:3.0:1788574333.996477:0:17798:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788574333.998057:0:17798:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788574333.998135:0:17798:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:3.0:1788574333.998244:0:17798:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788574333.999887:0:17798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788574334.000791:0:17798:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788574334.000893:0:17798:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:3.0:1788574334.000999:0:17798:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788574334.001353:0:17824:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788574334.001411:0:17824:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 1, retries 0 00080000:10000000:3.0:1788574334.001735:0:17798:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000100:00100000:3.0:1788574334.002823:0:17825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c0b480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17825:1875455681681536:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788574334.002900:0:17825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574334.003152:0:17825:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c4feecc0 going to sleep for 11 seconds 00000001:00000004:0.0:1788574334.006101:0:17798:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:2.0:1788574334.006707:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681681536 00000100:00100000:2.0:1788574334.006718:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681681536 00000100:00100000:2.0:1788574334.006830:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788574334.006840:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17825:x1875455681681536:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788574334.007103:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17825:x1875455681681536:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 262us (4201us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574334.007111:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788574334.007389:0:17825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c0b480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17825:1875455681681536:0@lo:1000:lod0001_rec0000.0 00000040:01000000:3.0:1788574334.007429:0:17825:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1788574334.007472:0:17825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c0b480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17825:1875455681681664:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788574334.007529:0:17825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574334.007596:0:17825:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c4fee6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788574334.007802:0:17807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681681664 00000100:00100000:2.0:1788574334.007808:0:17807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681681664 00000100:00100000:2.0:1788574334.007845:0:17807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788574334.007851:0:17807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17825:x1875455681681664:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788574334.008223:0:17807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17825:x1875455681681664:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 370us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574334.008231:0:17807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788574334.008406:0:17825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c0b480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17825:1875455681681664:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788574334.008514:0:17825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c0b480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17825:1875455681681792:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1788574334.008547:0:17825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574334.008561:0:17825:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c4feecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788574334.008968:0:17078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681681792 00000100:00100000:1.0:1788574334.008976:0:17078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681681792 00000100:00100000:1.0:1788574334.009072:0:17078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788574334.009082:0:17078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17825:x1875455681681792:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1788574334.009141:0:17078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17825:x1875455681681792:12345-0@lo:900:lod0001_rec0000.0 Request processed in 61us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574334.009157:0:17078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788574334.009172:0:17825:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c84c3c0b480 x1875455681681792/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788574350 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574334.009316:0:17825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c0b480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17825:1875455681681792:0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1788574334.009366:0:17825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c0b480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17825:1875455681681920:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788574334.009396:0:17825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574334.009450:0:17825:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c4fee6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788574334.009506:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681681920 00000100:00100000:2.0:1788574334.009512:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681681920 00000100:00100000:2.0:1788574334.009602:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788574334.009610:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17825:x1875455681681920:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788574334.009698:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17825:x1875455681681920:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 89us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574334.009705:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788574334.010020:0:17825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c0b480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17825:1875455681681920:0@lo:1000:lod0001_rec0000.0 00000040:00080000:2.0:1788574334.010132:0:17825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788574334.014395:0:17825:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788574334.014504:0:17825:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 1, retries 0 00000004:00080000:3.0:1788574334.014523:0:17825:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00080000:0.0:1788574334.017164:0:17798:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788574334.017245:0:17798:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb4d2815b7988 00100000:10000000:0.0:1788574334.017253:0:17798:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:0.0:1788574334.017780:0:17798:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788574334.017818:0:17798:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.151@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788574334.017836:0:17798:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1788574334.017853:0:17798:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:0.0:1788574334.021908:0:17798:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788574334.023364:0:17798:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788574334.419346:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574334.873083:0:17107:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c267e900 going to sleep for 0 seconds 00000040:00080000:1.0:1788574334.996848:0:17820:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788574335.443365:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788574335.763338:0:17064:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788574335.763348:0:17064:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c85c3688000 from 8 10000000:01000000:1.0:1788574335.763354:0:17064:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788574335.763409:0:17064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2000/0x5bf8706fdac8d207 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574335.763420:0:17064:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2000/0x5bf8706fdac8d207 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574335.763445:0:17064:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2000/0x5bf8706fdac8d207 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574335.763486:0:17064:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f73678fb-d8c0-450f-a73b-e6565942045e:17064:1875455681682048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788574335.763572:0:17064:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574335.763650:0:17064:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85f6f2db40 going to sleep for 11 seconds 00000100:00100000:2.0:1788574335.763845:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681682048 00000100:00100000:2.0:1788574335.763853:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681682048 00000100:00100000:2.0:1788574335.763913:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788574335.763921:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c536ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f73678fb-d8c0-450f-a73b-e6565942045e+16:17064:x1875455681682048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788574335.763934:0:17062:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574335.763947:0:17062:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85fa32f800/0x5bf8706fdac8d20e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8d207 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574335.763970:0:17062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85fa32f800/0x5bf8706fdac8d20e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8d207 expref: 17 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574335.763981:0:17062:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85fa32f800/0x5bf8706fdac8d20e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8d207 expref: 17 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574335.763990:0:17062:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85fa32f800, rc 0) 00000100:00100000:2.0:1788574335.764332:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c536ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f73678fb-d8c0-450f-a73b-e6565942045e+17:17064:x1875455681682048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 410us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574335.764339:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788574335.766673:0:17064:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f73678fb-d8c0-450f-a73b-e6565942045e:17064:1875455681682048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788574335.766705:0:17064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2000/0x5bf8706fdac8d207 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d20e expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574335.766719:0:17064:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2000/0x5bf8706fdac8d207 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8d20e expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574335.766913:0:17064:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3008380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f73678fb-d8c0-450f-a73b-e6565942045e:17064:1875455681682176:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788574335.767318:0:17064:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574335.767409:0:17064:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c53cb840 going to sleep for 11 seconds 00000100:00100000:1.0:1788574335.767466:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681682176 00000100:00100000:1.0:1788574335.767474:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681682176 00000100:00100000:1.0:1788574335.767561:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788574335.767571:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c536b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f73678fb-d8c0-450f-a73b-e6565942045e+17:17064:x1875455681682176:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788574335.767592:0:17061:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788574335.767608:0:17061:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788574335.767611:0:17061:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1788574335.767824:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c536b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f73678fb-d8c0-450f-a73b-e6565942045e+17:17064:x1875455681682176:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 254us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574335.767832:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788574335.767914:0:17064:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3008380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f73678fb-d8c0-450f-a73b-e6565942045e:17064:1875455681682176:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788574335.767965:0:17064:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788574335.767974:0:17064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2000/0x5bf8706fdac8d207 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d20e expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574335.767982:0:17064:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2000/0x5bf8706fdac8d207 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d20e expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788574335.767993:0:17064:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788574335.767995:0:17064:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c84c3fd7800 from 8 10000000:01000000:3.0:1788574335.767998:0:17064:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788574335.768234:0:17064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c84c2617000/0x5bf8706fdac8d215 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574335.768244:0:17064:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c84c2617000/0x5bf8706fdac8d215 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574335.768464:0:17064:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c84c2617000/0x5bf8706fdac8d215 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574335.768487:0:17064:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c0b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f73678fb-d8c0-450f-a73b-e6565942045e:17064:1875455681682304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788574335.768533:0:17064:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574335.768612:0:17064:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c4fee840 going to sleep for 11 seconds 00000100:00100000:1.0:1788574335.768732:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681682304 00000100:00100000:1.0:1788574335.768744:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681682304 00000100:00100000:1.0:1788574335.768787:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788574335.768794:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c536a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f73678fb-d8c0-450f-a73b-e6565942045e+17:17064:x1875455681682304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788574335.768805:0:17061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574335.768817:0:17061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85d08a2e00/0x5bf8706fdac8d21c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8d215 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574335.768839:0:17061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85d08a2e00/0x5bf8706fdac8d21c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8d215 expref: 18 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574335.768849:0:17061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85d08a2e00/0x5bf8706fdac8d21c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8d215 expref: 18 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574335.768858:0:17061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d08a2e00, rc 0) 00000100:00100000:1.0:1788574335.768955:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c536a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f73678fb-d8c0-450f-a73b-e6565942045e+18:17064:x1875455681682304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 161us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574335.768963:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788574335.769633:0:17064:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c0b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f73678fb-d8c0-450f-a73b-e6565942045e:17064:1875455681682304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788574335.769654:0:17064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c84c2617000/0x5bf8706fdac8d215 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d21c expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574335.769666:0:17064:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c84c2617000/0x5bf8706fdac8d215 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8d21c expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574335.769735:0:17064:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36de680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f73678fb-d8c0-450f-a73b-e6565942045e:17064:1875455681682432:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788574335.769775:0:17064:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574335.769849:0:17064:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85d1089a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788574335.770246:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681682432 00000100:00100000:1.0:1788574335.770252:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681682432 00000100:00100000:1.0:1788574335.770331:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788574335.770339:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c5369c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f73678fb-d8c0-450f-a73b-e6565942045e+18:17064:x1875455681682432:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788574335.770356:0:17061:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788574335.770375:0:17061:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788574335.770378:0:17061:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1788574335.770480:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c5369c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f73678fb-d8c0-450f-a73b-e6565942045e+18:17064:x1875455681682432:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 142us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574335.770488:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788574335.770557:0:17064:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36de680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f73678fb-d8c0-450f-a73b-e6565942045e:17064:1875455681682432:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788574335.770600:0:17064:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788574335.770608:0:17064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c84c2617000/0x5bf8706fdac8d215 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d21c expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574335.770617:0:17064:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c84c2617000/0x5bf8706fdac8d215 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d21c expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574335.892280:0:17107:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c267e900 going to sleep for 0 seconds 00000040:00080000:1.0:1788574336.022887:0:17820:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788574336.472243:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574336.922690:0:17107:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c267e900 going to sleep for 0 seconds 00010000:00010000:0.0:1788574337.491546:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574337.953628:0:17107:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c267e900 going to sleep for 0 seconds 00010000:00010000:0.0:1788574338.516563:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574338.964652:0:17107:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c267e900 going to sleep for 0 seconds 00000100:00100000:3.0:1788574339.219682:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681682560:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788574339.219813:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574339.219898:0:17807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681682560 00000100:00100000:3.0:1788574339.219906:0:17807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681682560 00000100:00100000:3.0:1788574339.219954:0:17807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788574339.219964:0:17807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681682560:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788574339.219997:0:17807:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788574339.220062:0:17807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681682560:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574339.220070:0:17807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788574339.220117:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681682560:0@lo:41:osp-pre-0-1.0 00000100:00080000:3.0:1788574339.223521:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788574339.223528:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788574339.223532:0:8:0:(import.c:65:import_set_state_nolock()) ffff9c85ffb61800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788574339.223543:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9c85ffb61800 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:3.0:1788574339.223568:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c84c3c0ad80 x1875455681682816/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788574339.223585:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788574339.223588:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788574339.223591:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788574339.223594:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788574339.223624:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788574339.223628:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788574339.223630:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788574339.223633:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788574339.223697:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875455681682816:0@lo:38:kworker.0 00000100:00100000:3.0:1788574339.223797:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574339.223856:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875455681682944:0@lo:400:kworker.0 00000100:00100000:3.0:1788574339.223900:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574339.223920:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788574339.223925:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875455681683072:0@lo:400:kworker.0 00000100:00100000:3.0:1788574339.223947:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574339.223982:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681682816 00000100:00100000:3.0:1788574339.223990:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681682816 00000100:00100000:3.0:1788574339.224044:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788574339.224052:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3616:x1875455681682816:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788574339.224078:0:17073:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 479 last 0 00000020:00000080:3.0:1788574339.224125:0:17073:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5bf8706fdac8d223 00000004:00100000:3.0:1788574339.224141:0:17073:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1788574339.224148:0:17073:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:3.0:1788574339.224260:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681682944 00000100:00100000:3.0:1788574339.224265:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681682944 00000100:00100000:3.0:1788574339.224298:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681683072 00000100:00100000:3.0:1788574339.224301:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681683072 00000100:00100000:3.0:1788574339.224314:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788574339.224320:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875455681682944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574339.224378:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875455681682944:12345-0@lo:400:kworker.0 Request processed in 58us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574339.224397:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788574339.224416:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788574339.224422:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875455681683072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574339.224448:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875455681683072:12345-0@lo:400:kworker.0 Request processed in 27us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574339.224453:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788574339.224492:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c84c3c08a80 x1875455681683072/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574355 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574339.224505:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875455681683072:0@lo:400:kworker.0 00010000:00080000:3.0:1788574339.224517:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c84c3c0a300 x1875455681682944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574355 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574339.224526:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875455681682944:0@lo:400:kworker.0 00000100:00100000:3.0:1788574339.224553:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788574339.224561:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f73678fb-d8c0-450f-a73b-e6565942045e:3617:1875455681682688:0@lo:400:kworker.0 00000100:00100000:3.0:1788574339.224591:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574339.224628:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681682688 00000100:00100000:3.0:1788574339.224632:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681682688 00000100:00100000:3.0:1788574339.224659:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788574339.224666:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85cbd5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f73678fb-d8c0-450f-a73b-e6565942045e+18:3617:x1875455681682688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574339.224701:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85cbd5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f73678fb-d8c0-450f-a73b-e6565942045e+18:3617:x1875455681682688:12345-0@lo:400:kworker.0 Request processed in 36us (109us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574339.224707:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788574339.224752:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f73678fb-d8c0-450f-a73b-e6565942045e:3617:1875455681682688:0@lo:400:kworker.0 00000001:02000400:1.0:1788574339.229914:0:18068:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg451-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:3.0:1788574339.243956:0:17073:0:(import.c:65:import_set_state_nolock()) ffff9c85ffb17800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788574339.244624:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3616:x1875455681682816:12345-0@lo:38:kworker.0 Request processed in 20568us (20823us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574339.244636:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1788574339.244777:0:3616:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788574339.244787:0:3616:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1788574339.244793:0:3616:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788574339.244811:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c85ffb61800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1788574339.244835:0:3616:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000f13c08b4): req@ffff9c84c335e300 x1875455681675776/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574339.244855:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875455681682816:0@lo:38:kworker.0 00000100:00100000:2.0:1788574339.244975:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788574339.244988:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3009c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681683200:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788574339.245027:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574339.245107:0:17107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574339.245124:0:17107:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c267e900 going to sleep for 11 seconds 00000100:00100000:2.0:1788574339.245147:0:17072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681683200 00000100:00100000:2.0:1788574339.245153:0:17072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681683200 00000100:00100000:2.0:1788574339.245184:0:17072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681675776 00000100:00100000:2.0:1788574339.245206:0:17072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681675776 00000100:00100000:2.0:1788574339.245222:0:17072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788574339.245230:0:17072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c300b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3618:x1875455681683200:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788574339.245259:0:17072:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788574339.245300:0:17072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c300b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3618:x1875455681683200:12345-0@lo:41:osp-pre-1-0.0 Request processed in 70us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574339.245306:0:17072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788574339.245320:0:17072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788574339.245326:0:17072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3009180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17107:x1875455681675776:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788574339.245404:0:17072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3009180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17107:x1875455681675776:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 77us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574339.245411:0:17072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788574339.245447:0:17107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335e300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17107:1875455681675776:0@lo:1000:lod0000_rec0001.0 00000040:01000000:2.0:1788574339.245490:0:17107:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1788574339.245527:0:17107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c300a300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17107:1875455681683328:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788574339.245557:0:17107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574339.245579:0:17107:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c53cbf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788574339.245599:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3009c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681683200:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788574339.245623:0:17072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681683328 00000100:00100000:2.0:1788574339.245626:0:17072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681683328 00000100:00100000:2.0:1788574339.245639:0:17072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788574339.245644:0:17072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c300b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17107:x1875455681683328:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788574339.245739:0:17072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c300b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17107:x1875455681683328:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 94us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574339.245745:0:17072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788574339.245764:0:17107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c300a300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17107:1875455681683328:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788574339.245822:0:17107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c300a300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17107:1875455681683456:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788574339.245840:0:17107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574339.245851:0:17107:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c53cbf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788574339.245861:0:17072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681683456 00000100:00100000:2.0:1788574339.245864:0:17072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681683456 00000100:00100000:2.0:1788574339.245879:0:17072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788574339.245884:0:17072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3009c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17107:x1875455681683456:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788574339.245919:0:17072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3009c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17107:x1875455681683456:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 35us (79us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574339.245925:0:17072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788574339.245944:0:17107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c300a300 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17107:1875455681683456:0@lo:1000:lod0000_rec0001.0 00000040:00080000:2.0:1788574339.245979:0:17107:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788574339.254794:0:17107:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788574339.254864:0:17107:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 19, retries 0 00000004:00080000:2.0:1788574339.254869:0:17107:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:0.0:1788574339.541007:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788574340.336381:0:18120:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788574340.336668:0:18120:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788574340.563709:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788574341.319854:0:18170:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788574341.320308:0:18170:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788574341.587365:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788574342.037163:0:17104:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000080:1.0:1788574342.357362:0:18218:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcdf057af0 20000000:00000080:1.0:1788574342.357381:0:18218:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c85c5f36800 uarg=0000000000000000 20000000:01000000:1.0:1788574342.357833:0:18218:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1788574342.357841:0:18218:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1788574342.357846:0:18218:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1788574342.358781:0:18219:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:1.0:1788574342.359017:0:18218:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788574342.367561:0:18218:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788574342.367597:0:18218:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c85d08a3000/0x5bf8706fdac8d22a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574342.367618:0:18218:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c85d20d6000/0x5bf8706fdac8d0d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8d0cc expref: 17 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574342.367625:0:18218:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c85d08a3a00/0x5bf8706fdac8d1d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8d1cf expref: 17 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574342.367632:0:18218:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c85d08a3000/0x5bf8706fdac8d22a lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574342.367743:0:18218:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c85d08a3a00/0x5bf8706fdac8d1d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5bf8706fdac8d1cf expref: 17 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574342.367758:0:18218:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c85d08a3a00/0x5bf8706fdac8d1d6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5bf8706fdac8d1cf expref: 17 pid: 17060 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574342.367771:0:18218:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18218:1875455681683584:0@lo:104: 00000100:00100000:1.0:1788574342.367836:0:18218:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788574342.367953:0:18218:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c85d20d6000/0x5bf8706fdac8d0d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5bf8706fdac8d0cc expref: 17 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574342.367962:0:18218:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c85d20d6000/0x5bf8706fdac8d0d3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5bf8706fdac8d0cc expref: 17 pid: 17060 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574342.367984:0:18218:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18218:1875455681683712:0@lo:104: 00000100:00100000:1.0:1788574342.368006:0:18218:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574342.368242:0:18218:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85f6f2dd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788574342.370302:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681683584 00000100:00100000:2.0:1788574342.370342:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681683584 00000100:00100000:2.0:1788574342.370386:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681683712 00000100:00100000:2.0:1788574342.370389:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681683712 00000100:00100000:2.0:1788574342.370406:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788574342.370416:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c335ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f73678fb-d8c0-450f-a73b-e6565942045e+4:18218:x1875455681683584:12345-0@lo:104: 00010000:00010000:2.0:1788574342.370433:0:17050:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7c00/0x5bf8706fdac8d1cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8d1d6 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574342.370541:0:17050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788574342.370548:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c335ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f73678fb-d8c0-450f-a73b-e6565942045e+4:18218:x1875455681683584:12345-0@lo:104: Request processed in 134us (2711us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574342.370555:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788574342.370572:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788574342.370578:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c335d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f73678fb-d8c0-450f-a73b-e6565942045e+3:18218:x1875455681683712:12345-0@lo:104: 00010000:00010000:2.0:1788574342.370587:0:17050:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff9c84c2617c00/0x5bf8706fdac8d0cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8d0d3 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574342.370619:0:17050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788574342.370624:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c335d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f73678fb-d8c0-450f-a73b-e6565942045e+3:18218:x1875455681683712:12345-0@lo:104: Request processed in 47us (2617us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574342.370630:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1788574342.370656:0:17055:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788574342.370662:0:17055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7c00/0x5bf8706fdac8d1cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8d1d6 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574342.370669:0:17055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d7c00 already unused, calling callback (ffffffffc1472c20) 10000000:00010000:2.0:1788574342.370673:0:17055:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7c00/0x5bf8706fdac8d1cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5bf8706fdac8d1d6 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574342.370692:0:17055:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7c00/0x5bf8706fdac8d1cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5bf8706fdac8d1d6 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788574342.370700:0:17055:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7c00/0x5bf8706fdac8d1cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5bf8706fdac8d1d6 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788574342.370706:0:17055:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788574342.370742:0:17055:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7c00/0x5bf8706fdac8d1cf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8d1d6 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574342.370748:0:17055:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788574342.370768:0:17055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7c00/0x5bf8706fdac8d1cf lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8d1d6 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574342.370775:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7c00/0x5bf8706fdac8d1cf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8d1d6 expref: -99 pid: 17798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574342.370788:0:17055:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788574342.370791:0:17055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c84c2617c00/0x5bf8706fdac8d0cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8d0d3 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574342.370796:0:17055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c84c2617c00 already unused, calling callback (ffffffffc1472c20) 10000000:00010000:2.0:1788574342.370799:0:17055:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c84c2617c00/0x5bf8706fdac8d0cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5bf8706fdac8d0d3 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574342.370805:0:17055:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c84c2617c00/0x5bf8706fdac8d0cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5bf8706fdac8d0d3 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788574342.370811:0:17055:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c84c2617c00/0x5bf8706fdac8d0cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5bf8706fdac8d0d3 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788574342.370824:0:17055:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788574342.370837:0:17055:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9c84c2617c00/0x5bf8706fdac8d0cc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8d0d3 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574342.370843:0:17055:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788574342.370859:0:17055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c84c2617c00/0x5bf8706fdac8d0cc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8d0d3 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574342.370865:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c84c2617c00/0x5bf8706fdac8d0cc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8d0d3 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574342.370892:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574342.370895:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574342.370896:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574342.371352:0:18218:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18218:1875455681683584:0@lo:104: 00000100:00100000:0.0:1788574342.371363:0:18218:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18218:1875455681683712:0@lo:104: 00010000:00010000:0.0:1788574342.371384:0:18218:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c85d08a3000/0x5bf8706fdac8d22a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574342.371510:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574342.371532:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c300a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f73678fb-d8c0-450f-a73b-e6565942045e:3618:1875455681683840:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788574342.371576:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574342.371684:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3009500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f73678fb-d8c0-450f-a73b-e6565942045e:3619:1875455681683968:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788574342.371709:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574342.372169:0:17052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681683840 00000100:00100000:1.0:1788574342.372176:0:17052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681683840 00010000:00010000:1.0:1788574342.372262:0:17052:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c85d08a3a00/0x5bf8706fdac8d1d6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8d1cf expref: 18 pid: 17060 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574342.372286:0:17052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681683968 00000100:00100000:1.0:1788574342.372290:0:17052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681683968 00010000:00010000:1.0:1788574342.372301:0:17052:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c85d20d6000/0x5bf8706fdac8d0d3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8d0cc expref: 19 pid: 17060 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574342.372314:0:17052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788574342.372320:0:17052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3008000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f73678fb-d8c0-450f-a73b-e6565942045e+19:3618:x1875455681683840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788574342.372345:0:17052:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574342.372350:0:17052:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c85d08a3a00/0x5bf8706fdac8d1d6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8d1cf expref: 19 pid: 17060 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574342.372361:0:17052:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c85d08a3a00/0x5bf8706fdac8d1d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5bf8706fdac8d1cf expref: 19 pid: 17060 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574342.372376:0:17052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85d08a3a00/0x5bf8706fdac8d1d6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5bf8706fdac8d1cf expref: 19 pid: 17060 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574342.372388:0:17052:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788574342.372435:0:17052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3008000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f73678fb-d8c0-450f-a73b-e6565942045e+18:3618:x1875455681683840:12345-0@lo:103:ldlm_bl.0 Request processed in 115us (859us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574342.372443:0:17052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788574342.372477:0:17052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788574342.372482:0:17052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c300bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f73678fb-d8c0-450f-a73b-e6565942045e+17:3619:x1875455681683968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788574342.372489:0:17052:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574342.372494:0:17052:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c85d20d6000/0x5bf8706fdac8d0d3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8d0cc expref: 17 pid: 17060 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574342.372501:0:17052:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c85d20d6000/0x5bf8706fdac8d0d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5bf8706fdac8d0cc expref: 17 pid: 17060 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574342.372510:0:17052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85d20d6000/0x5bf8706fdac8d0d3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5bf8706fdac8d0cc expref: 17 pid: 17060 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574342.372520:0:17052:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c85d08a3000/0x5bf8706fdac8d22a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574342.372527:0:17052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85d08a3000/0x5bf8706fdac8d22a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574342.372539:0:17052:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c85d08a3000/0x5bf8706fdac8d22a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574342.372545:0:17052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c85d08a3000/0x5bf8706fdac8d22a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574342.372552:0:17052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c85d08a3000/0x5bf8706fdac8d22a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574342.372557:0:17052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c85d08a3000/0x5bf8706fdac8d22a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574342.372562:0:17052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d08a3000 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:1.0:1788574342.372573:0:17052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c85d08a3000/0x5bf8706fdac8d22a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574342.372580:0:17052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c85d08a3000/0x5bf8706fdac8d22a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574342.372595:0:17052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c85d08a3000/0x5bf8706fdac8d22a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574342.372604:0:17052:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788574342.372635:0:17052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c300bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f73678fb-d8c0-450f-a73b-e6565942045e+16:3619:x1875455681683968:12345-0@lo:103:ldlm_bl.0 Request processed in 153us (925us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574342.372642:0:17052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788574342.372685:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3009500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f73678fb-d8c0-450f-a73b-e6565942045e:3619:1875455681683968:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788574342.372938:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c300a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f73678fb-d8c0-450f-a73b-e6565942045e:3618:1875455681683840:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788574342.373166:0:18218:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c85d08a3000/0x5bf8706fdac8d22a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574342.373176:0:18218:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c85d08a3000/0x5bf8706fdac8d22a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574342.373183:0:18218:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85d08a3000/0x5bf8706fdac8d22a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574342.611611:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574343.316525:0:3616:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788574333/real 1788574333] req@ffff9c84c36dea00 x1875455681678976/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788574343 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574343.316557:0:3616:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c84c36dea00 x1875455681678976/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788574343 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574343.316567:0:3616:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788574333/real 1788574333] req@ffff9c84c36ddf80 x1875455681678848/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788574343 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574343.316591:0:3616:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c84c36ddf80 x1875455681678848/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788574343 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788574343.316611:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c84c2272000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788574343.316637:0:3616:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788574343.316641:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1875455681678976:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788574343.316647:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c85ffb1e800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788574343.316652:0:3616:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788574343.316654:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1875455681678848:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788574343.316795:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788574343.316799:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788574343.316802:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788574343.316805:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788574343.316819:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788574343.316827:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788574343.316830:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c85ffb1e800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788574343.316834:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 473 00000100:00080000:2.0:1788574343.316839:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788574343.316846:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9c85ffb1e800 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:2.0:1788574343.316865:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c84c3009500 x1875455681684608/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788574343.316878:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788574343.316880:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788574343.316882:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c84c2272000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788574343.316885:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 473 00000100:00080000:2.0:1788574343.316888:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788574343.316891:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9c84c2272000 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:2.0:1788574343.316901:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c84c3008380 x1875455681684736/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788574343.316932:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c300a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681684224:0@lo:400:kworker.0 00000100:00100000:2.0:1788574343.317252:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574343.317286:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788574343.317291:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3008700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875455681684352:0@lo:400:kworker.0 00000100:00100000:2.0:1788574343.317328:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574343.317358:0:17072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681684224 00000100:00100000:2.0:1788574343.317364:0:17072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681684224 00000100:00100000:2.0:1788574343.317399:0:17072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788574343.317406:0:17072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2f47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3617:x1875455681684224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574343.317453:0:17072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2f47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3617:x1875455681684224:12345-0@lo:400:kworker.0 Request processed in 46us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574343.317465:0:17072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788574343.317501:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c300a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681684224:0@lo:400:kworker.0 00000100:00100000:0.0:1788574343.317572:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3009880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681684480:0@lo:400:kworker.0 00000100:00100000:0.0:1788574343.317601:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574343.317829:0:17807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681684480 00000100:00100000:2.0:1788574343.317834:0:17807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681684480 00000100:00100000:2.0:1788574343.317857:0:17807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788574343.317864:0:17807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681684480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574343.317896:0:17807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681684480:12345-0@lo:400:kworker.0 Request processed in 33us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574343.317902:0:17807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788574343.317955:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3009880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681684480:0@lo:400:kworker.0 00000100:00100000:0.0:1788574343.318104:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788574343.318248:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c300a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f73678fb-d8c0-450f-a73b-e6565942045e:3619:1875455681684096:0@lo:400:kworker.0 00000100:00100000:0.0:1788574343.318282:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574343.318333:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c300aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875455681684864:0@lo:400:kworker.0 00000100:00100000:0.0:1788574343.318360:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574343.318388:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681684096 00000100:00100000:0.0:1788574343.318393:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681684096 00000100:00100000:0.0:1788574343.318416:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788574343.318422:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85cbd5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f73678fb-d8c0-450f-a73b-e6565942045e+16:3619:x1875455681684096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574343.318455:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85cbd5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f73678fb-d8c0-450f-a73b-e6565942045e+16:3619:x1875455681684096:12345-0@lo:400:kworker.0 Request processed in 33us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574343.318461:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788574343.318504:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3009500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1875455681684608:0@lo:8:kworker.0 00000400:00000100:0.0:1788574343.318531:0:3616:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875455681684608 offset 0 length 520: 4 00000100:00100000:0.0:1788574343.318544:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3008380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1875455681684736:0@lo:8:kworker.0 00000400:00000100:0.0:1788574343.318563:0:3616:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875455681684736 offset 0 length 520: 4 00000100:00100000:0.0:1788574343.318591:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c300a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f73678fb-d8c0-450f-a73b-e6565942045e:3619:1875455681684096:0@lo:400:kworker.0 00000100:00100000:3.0:1788574343.318829:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681684352 00000100:00100000:3.0:1788574343.318834:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681684352 00000100:00100000:3.0:1788574343.318869:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681684864 00000100:00100000:3.0:1788574343.318873:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681684864 00000100:00100000:3.0:1788574343.318889:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788574343.318895:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2f46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875455681684352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574343.318938:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2f46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875455681684352:12345-0@lo:400:kworker.0 Request processed in 43us (1608us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574343.318944:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788574343.318959:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788574343.319346:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875455681684864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574343.319385:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875455681684864:12345-0@lo:400:kworker.0 Request processed in 44us (1024us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574343.319391:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788574343.319437:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c84c3008700 x1875455681684352/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574359 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574343.319451:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3008700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875455681684352:0@lo:400:kworker.0 00010000:00080000:3.0:1788574343.319476:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c84c300aa00 x1875455681684864/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574359 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574343.319495:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c300aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875455681684864:0@lo:400:kworker.0 10000000:01000000:0.0:1788574343.573929:0:17064:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788574343.573939:0:17064:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c85c3688000 from 13 10000000:01000000:0.0:1788574343.573944:0:17064:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788574343.573994:0:17064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7200/0x5bf8706fdac8d231 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574343.574008:0:17064:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7200/0x5bf8706fdac8d231 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574343.574019:0:17064:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7200/0x5bf8706fdac8d231 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574343.574045:0:17064:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36de680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f73678fb-d8c0-450f-a73b-e6565942045e:17064:1875455681684992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788574343.574125:0:17064:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574343.574297:0:17064:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c267e300 going to sleep for 11 seconds 00000100:00100000:3.0:1788574343.575877:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681684992 00000100:00100000:3.0:1788574343.575888:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681684992 00000100:00100000:3.0:1788574343.575941:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788574343.575950:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85cbd5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f73678fb-d8c0-450f-a73b-e6565942045e+16:17064:x1875455681684992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788574343.575965:0:17060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574343.575984:0:17060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c84c2616e00/0x5bf8706fdac8d238 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8d231 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574343.576009:0:17060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c84c2616e00/0x5bf8706fdac8d238 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8d231 expref: 17 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574343.576031:0:17060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c84c2616e00/0x5bf8706fdac8d238 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8d231 expref: 17 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574343.576041:0:17060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c84c2616e00, rc 0) 00000100:00100000:2.0:1788574343.576365:0:17064:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36de680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f73678fb-d8c0-450f-a73b-e6565942045e:17064:1875455681684992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788574343.576388:0:17064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7200/0x5bf8706fdac8d231 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d238 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574343.576398:0:17064:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7200/0x5bf8706fdac8d231 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8d238 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574343.576468:0:17064:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c2f45500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f73678fb-d8c0-450f-a73b-e6565942045e:17064:1875455681685120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788574343.576502:0:17064:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574343.576549:0:17064:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85d10e9b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788574343.576596:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681685120 00000100:00100000:0.0:1788574343.576601:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681685120 00000100:00100000:0.0:1788574343.576638:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788574343.576646:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e0bdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f73678fb-d8c0-450f-a73b-e6565942045e+18:17064:x1875455681685120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788574343.576753:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e0bdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f73678fb-d8c0-450f-a73b-e6565942045e+18:17064:x1875455681685120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 107us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574343.576761:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788574343.576835:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85cbd5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f73678fb-d8c0-450f-a73b-e6565942045e+17:17064:x1875455681684992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 158us (1982us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574343.576842:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788574343.576980:0:17064:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c2f45500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f73678fb-d8c0-450f-a73b-e6565942045e:17064:1875455681685120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788574343.577012:0:17064:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c2f45500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f73678fb-d8c0-450f-a73b-e6565942045e:17064:1875455681685248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788574343.577063:0:17064:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574343.577083:0:17064:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85d10e9b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788574343.577131:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681685248 00000100:00100000:0.0:1788574343.577136:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681685248 00000100:00100000:0.0:1788574343.577165:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788574343.577171:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e0bdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f73678fb-d8c0-450f-a73b-e6565942045e+17:17064:x1875455681685248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788574343.577276:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e0bdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f73678fb-d8c0-450f-a73b-e6565942045e+17:17064:x1875455681685248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 104us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574343.577282:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788574343.577524:0:17064:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c2f45500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f73678fb-d8c0-450f-a73b-e6565942045e:17064:1875455681685248:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788574343.578663:0:18274:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788574343.578869:0:17064:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788574343.578889:0:17064:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788574343.578900:0:17064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7200/0x5bf8706fdac8d231 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d238 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574343.578912:0:17064:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7200/0x5bf8706fdac8d231 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d238 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788574343.578922:0:17064:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788574343.578924:0:17064:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c84c3fd7800 from 13 10000000:01000000:2.0:1788574343.578926:0:17064:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788574343.578998:0:17064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85fa32ec00/0x5bf8706fdac8d23f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574343.579007:0:17064:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c85fa32ec00/0x5bf8706fdac8d23f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574343.579026:0:17064:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c85fa32ec00/0x5bf8706fdac8d23f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574343.579050:0:17064:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c2f45500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f73678fb-d8c0-450f-a73b-e6565942045e:17064:1875455681685376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788574343.579345:0:17064:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574343.579394:0:17064:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c8f0d480 going to sleep for 11 seconds 00000100:00100000:0.0:1788574343.579441:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681685376 00000100:00100000:0.0:1788574343.579448:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681685376 00000100:00100000:0.0:1788574343.579488:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788574343.579495:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e0bdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f73678fb-d8c0-450f-a73b-e6565942045e+17:17064:x1875455681685376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788574343.579507:0:17061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574343.579521:0:17061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85d20d6000/0x5bf8706fdac8d246 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8d23f expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574343.579542:0:17061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85d20d6000/0x5bf8706fdac8d246 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8d23f expref: 18 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574343.579551:0:17061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85d20d6000/0x5bf8706fdac8d246 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8d23f expref: 18 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574343.579560:0:17061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d20d6000, rc 0) 00000100:00100000:0.0:1788574343.579602:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e0bdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f73678fb-d8c0-450f-a73b-e6565942045e+18:17064:x1875455681685376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574343.579608:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788574343.579676:0:17064:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c2f45500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f73678fb-d8c0-450f-a73b-e6565942045e:17064:1875455681685376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788574343.579689:0:17064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c85fa32ec00/0x5bf8706fdac8d23f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d246 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574343.579697:0:17064:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c85fa32ec00/0x5bf8706fdac8d23f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8d246 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574343.579760:0:17064:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c2f45500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f73678fb-d8c0-450f-a73b-e6565942045e:17064:1875455681685504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788574343.579782:0:17064:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574343.579805:0:17064:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c8f0d480 going to sleep for 11 seconds 00000100:00100000:0.0:1788574343.579844:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681685504 00000100:00100000:0.0:1788574343.579857:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681685504 00000100:00100000:0.0:1788574343.579886:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788574343.579892:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e0bd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f73678fb-d8c0-450f-a73b-e6565942045e+18:17064:x1875455681685504:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788574343.579989:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e0bd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f73678fb-d8c0-450f-a73b-e6565942045e+18:17064:x1875455681685504:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 97us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574343.579996:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788574343.580257:0:17064:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c2f45500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f73678fb-d8c0-450f-a73b-e6565942045e:17064:1875455681685504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788574343.580284:0:17064:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c2f45500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f73678fb-d8c0-450f-a73b-e6565942045e:17064:1875455681685632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788574343.580333:0:17064:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574343.580363:0:17064:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c8f0d480 going to sleep for 11 seconds 00000100:00100000:3.0:1788574343.580420:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681685632 00000100:00100000:3.0:1788574343.580424:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681685632 00000100:00100000:3.0:1788574343.580455:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788574343.580463:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e0bda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f73678fb-d8c0-450f-a73b-e6565942045e+18:17064:x1875455681685632:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788574343.580539:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e0bda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f73678fb-d8c0-450f-a73b-e6565942045e+18:17064:x1875455681685632:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 77us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574343.580555:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788574343.580653:0:17064:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c2f45500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f73678fb-d8c0-450f-a73b-e6565942045e:17064:1875455681685632:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788574343.581726:0:18275:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788574343.583418:0:17064:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788574343.583450:0:17064:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788574343.583462:0:17064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85fa32ec00/0x5bf8706fdac8d23f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d246 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574343.583473:0:17064:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c85fa32ec00/0x5bf8706fdac8d23f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d246 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574343.641415:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574344.340619:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681685760:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788574344.340688:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574344.340743:0:17807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681685760 00000100:00100000:3.0:1788574344.340750:0:17807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681685760 00000100:00100000:3.0:1788574344.340797:0:17807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788574344.340807:0:17807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681685760:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788574344.340840:0:17807:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788574344.340884:0:17807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681685760:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574344.340891:0:17807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788574344.340936:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681685760:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788574344.344303:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c2f45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681685888:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788574344.344379:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574344.344601:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681685888 00000100:00100000:3.0:1788574344.344609:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681685888 00000100:00100000:3.0:1788574344.344661:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788574344.344670:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3618:x1875455681685888:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788574344.344713:0:17073:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788574344.344760:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3618:x1875455681685888:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574344.344767:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788574344.344810:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c2f45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681685888:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788574344.663656:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788574344.857811:0:17799:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1788574345.365166:0:3616:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788574330/real 1788574330] req@ffff9c84c3008a80 x1875455681676800/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788574345 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574345.365226:0:3616:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c84c3008a80 x1875455681676800/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788574345 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574345.365236:0:3616:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788574330/real 1788574330] req@ffff9c84c300ad80 x1875455681676928/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788574345 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574345.365247:0:3616:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c84c300ad80 x1875455681676928/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788574345 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788574345.365279:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c85c4edd000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788574345.365297:0:3616:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788574345.365301:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3008a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875455681676800:0@lo:8:kworker.0 00000100:00080000:0.0:1788574345.365306:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c84c369e000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788574345.365310:0:3616:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788574345.365313:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c300ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875455681676928:0@lo:8:kworker.0 00000100:00080000:3.0:1788574345.365441:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788574345.365445:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788574345.365448:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c85c4edd000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788574345.365454:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 469 00000100:00080000:3.0:1788574345.365459:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788574345.365466:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9c85c4edd000 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:3.0:1788574345.365486:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c84c3c0ad80 x1875455681686272/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788574345.365500:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788574345.365503:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788574345.365504:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c84c369e000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788574345.365507:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 469 00000100:00080000:3.0:1788574345.365510:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788574345.365513:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c84c369e000 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:3.0:1788574345.365524:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c84c3c0b100 x1875455681686400/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788574345.365554:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788574345.365558:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788574345.365561:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788574345.365570:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788574345.365600:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681686144:0@lo:400:kworker.0 00000100:00100000:3.0:1788574345.365667:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574345.365724:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788574345.365732:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f73678fb-d8c0-450f-a73b-e6565942045e:3620:1875455681686016:0@lo:400:kworker.0 00000100:00100000:3.0:1788574345.365762:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574345.365790:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c8601836300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875455681686784:0@lo:400:kworker.0 00000100:00100000:3.0:1788574345.365813:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574345.365839:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875455681686528:0@lo:400:kworker.0 00000100:00100000:3.0:1788574345.365861:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574345.365877:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788574345.365883:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c8601835180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681686656:0@lo:400:kworker.0 00000100:00100000:3.0:1788574345.365903:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574345.365935:0:17072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681686144 00000100:00100000:3.0:1788574345.365942:0:17072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681686144 00000100:00100000:3.0:1788574345.365982:0:17072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681686656 00000100:00100000:3.0:1788574345.365986:0:17072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681686656 00000100:00100000:3.0:1788574345.366431:0:17072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788574345.366443:0:17072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601835880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681686144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574345.367214:0:17072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601835880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681686144:12345-0@lo:400:kworker.0 Request processed in 750us (1522us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574345.367225:0:17072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788574345.367249:0:17072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788574345.367259:0:17072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601837b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681686656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574345.367340:0:17072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601837b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681686656:12345-0@lo:400:kworker.0 Request processed in 83us (1435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574345.367355:0:17072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788574345.367386:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681686016 00000100:00100000:1.0:1788574345.367392:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c8601835180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681686656:0@lo:400:kworker.0 00000100:00100000:3.0:1788574345.367393:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681686016 00000100:00100000:3.0:1788574345.367432:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788574345.367440:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e0bd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f73678fb-d8c0-450f-a73b-e6565942045e+18:3620:x1875455681686016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574345.367474:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e0bd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f73678fb-d8c0-450f-a73b-e6565942045e+18:3620:x1875455681686016:12345-0@lo:400:kworker.0 Request processed in 35us (1711us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574345.367480:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788574345.367514:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681686784 00000100:00100000:3.0:1788574345.367519:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681686784 00000100:00100000:3.0:1788574345.367562:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681686528 00000100:00100000:3.0:1788574345.367566:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681686528 00000100:00100000:3.0:1788574345.367592:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788574345.367600:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601834700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875455681686784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574345.367632:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601834700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875455681686784:12345-0@lo:400:kworker.0 Request processed in 34us (1818us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574345.367638:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788574345.367651:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788574345.367658:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601836a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875455681686528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574345.367692:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601836a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875455681686528:12345-0@lo:400:kworker.0 Request processed in 35us (1829us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574345.367698:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1788574345.367740:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c84c3c0b480 x1875455681686528/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574361 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574345.367750:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875455681686528:0@lo:400:kworker.0 00000100:00100000:3.0:1788574345.367774:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875455681686272:0@lo:8:kworker.0 00000400:00000100:3.0:1788574345.367814:0:3616:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875455681686272 offset 0 length 520: 4 00000100:00100000:3.0:1788574345.367847:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875455681686400:0@lo:8:kworker.0 00000400:00000100:3.0:1788574345.367868:0:3616:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875455681686400 offset 0 length 520: 4 00000100:00100000:3.0:1788574345.367910:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f73678fb-d8c0-450f-a73b-e6565942045e:3620:1875455681686016:0@lo:400:kworker.0 00010000:00080000:3.0:1788574345.367928:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c8601836300 x1875455681686784/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574361 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574345.367938:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c8601836300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875455681686784:0@lo:400:kworker.0 00000100:00100000:3.0:1788574345.367951:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681686144:0@lo:400:kworker.0 00010000:00010000:2.0:1788574345.683516:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788574346.267921:0:17820:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788574346.707480:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574347.732566:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788574348.572960:0:18567:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788574348.572964:0:18567:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:1.0:1788574348.572965:0:18567:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1788574348.573079:0:18567:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9c85c8a34800 00000020:01000004:1.0:1788574348.573095:0:18567:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1788574348.573107:0:18567:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788574348.573120:0:18567:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9c85e56999c0) 00000020:00000080:1.0:1788574348.573134:0:18567:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788574348.614946:0:18567:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788574348.616850:0:18567:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788574348.617367:0:18567:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788574348.617594:0:18567:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1788574348.617834:0:18567:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1788574348.618145:0:18567:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1788574348.618472:0:18567:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:3.0:1788574348.619811:0:18567:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788574348.620088:0:18567:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788574348.620101:0:18567:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788574348.620114:0:18567:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x5bf8706fdac8d254 00000020:01000004:3.0:1788574348.620120:0:18567:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1788574348.620141:0:18567:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.151@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788574348.620144:0:18567:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.151@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788574348.620150:0:18567:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788574348.620154:0:18567:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788574348.620173:0:18567:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9c85f7468000) 00000020:00000080:3.0:1788574348.620186:0:18567:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:3.0:1788574348.621371:0:18567:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788574348.621538:0:18567:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788574348.621545:0:18567:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1788574348.628307:0:18567:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1788574348.628326:0:18567:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1788574348.632863:0:18567:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1788574348.632878:0:18567:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1788574348.635141:0:18567:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788574348.635461:0:18567:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1788574348.635467:0:18567:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788574348.636176:0:18567:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788574348.636183:0:18567:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1788574348.661366:0:18567:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788574348.661821:0:18567:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788574348.661827:0:18567:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1788574348.663509:0:18567:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788574348.663522:0:18567:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788574348.664473:0:18567:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788574348.664491:0:18567:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1788574348.666554:0:18567:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788574348.666737:0:18567:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1788574348.666744:0:18567:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1788574348.667597:0:18567:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788574348.667606:0:18567:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1788574348.715836:0:18567:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788574348.716037:0:18567:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1788574348.716044:0:18567:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788574348.718590:0:18567:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788574348.718602:0:18567:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1788574348.719621:0:18567:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1788574348.719658:0:18567:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1788574348.719664:0:18567:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.151@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1788574348.732704:0:18567:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.151@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788574348.732811:0:18567:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.151@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1788574348.732816:0:18567:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788574348.732817:0:18567:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788574348.732819:0:18567:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788574348.732820:0:18567:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788574348.732821:0:18567:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788574348.732822:0:18567:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788574348.732824:0:18567:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788574348.732825:0:18567:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788574348.732827:0:18567:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788574348.732831:0:18567:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1788574348.732833:0:18567:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788574348.732834:0:18567:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788574348.732835:0:18567:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788574348.732836:0:18567:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788574348.732838:0:18567:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788574348.732839:0:18567:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788574348.732840:0:18567:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788574348.732841:0:18567:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788574348.732842:0:18567:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788574348.732870:0:18567:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788574348.732891:0:18567:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36dd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:18567:1875455681686912:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788574348.732971:0:18567:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574348.733093:0:18567:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85fafee240 going to sleep for 11 seconds 00000100:00100000:2.0:1788574348.733459:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681686912 00000100:00100000:2.0:1788574348.733468:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681686912 00000100:00100000:2.0:1788574348.733524:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788574348.733534:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3267850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f73678fb-d8c0-450f-a73b-e6565942045e+18:18567:x1875455681686912:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788574348.733572:0:17061:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788574348.733575:0:17061:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1788574348.733579:0:17061:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1788574348.734871:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3267850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f73678fb-d8c0-450f-a73b-e6565942045e+18:18567:x1875455681686912:12345-0@lo:253:mount.lustre.0 Request processed in 1333us (1894us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574348.734882:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788574348.735055:0:18567:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36dd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:18567:1875455681686912:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788574348.735070:0:18567:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788574348.735073:0:18567:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788574348.735075:0:18567:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788574348.735076:0:18567:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788574348.735078:0:18567:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788574348.735079:0:18567:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788574348.735080:0:18567:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788574348.735081:0:18567:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788574348.735093:0:18567:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788574348.735095:0:18567:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788574348.735114:0:18567:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c85c8a34800 from lustre-OST0000 10000000:01000000:0.0:1788574348.735155:0:18567:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1788574348.735159:0:18567:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788574348.735167:0:18567:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9c85faf48000 local copy 00010000:00010000:0.0:1788574348.735178:0:18567:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6800/0x5bf8706fdac8d00f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d016 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574348.735439:0:18567:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36dd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:18567:1875455681687040:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788574348.735478:0:18567:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574348.735519:0:18567:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85fafee240 going to sleep for 11 seconds 00000100:00100000:3.0:1788574348.735577:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681687040 00000100:00100000:3.0:1788574348.735583:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681687040 00000100:00100000:3.0:1788574348.735824:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788574348.735834:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3265050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f73678fb-d8c0-450f-a73b-e6565942045e+18:18567:x1875455681687040:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788574348.735956:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3265050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f73678fb-d8c0-450f-a73b-e6565942045e+18:18567:x1875455681687040:12345-0@lo:501:mount.lustre.0 Request processed in 124us (477us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788574348.735973:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788574348.736121:0:18567:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36dd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:18567:1875455681687040:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788574348.736137:0:18567:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.151@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788574348.736158:0:18567:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.151@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788574348.736165:0:18567:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6800/0x5bf8706fdac8d00f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d016 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574348.736185:0:18567:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6800/0x5bf8706fdac8d00f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d016 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788574348.738527:0:18567:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c85c8a34800 10000000:01000000:1.0:1788574348.738558:0:18567:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788574348.738565:0:18567:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788574348.738569:0:18567:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788574348.738574:0:18567:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1788574348.738577:0:18567:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788574348.738614:0:18567:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2a00/0x5bf8706fdac8d262 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574348.738625:0:18567:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2a00/0x5bf8706fdac8d262 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574348.738637:0:18567:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2a00/0x5bf8706fdac8d262 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574348.738661:0:18567:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:18567:1875455681687168:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788574348.738724:0:18567:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574348.738924:0:18567:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85d1089d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788574348.739007:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681687168 00000100:00100000:3.0:1788574348.739014:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681687168 00000100:00100000:3.0:1788574348.739067:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788574348.739078:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3265c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f73678fb-d8c0-450f-a73b-e6565942045e+18:18567:x1875455681687168:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788574348.739091:0:17060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574348.739104:0:17060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c84c2616600/0x5bf8706fdac8d269 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8d262 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574348.739128:0:17060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c84c2616600/0x5bf8706fdac8d269 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8d262 expref: 19 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574348.739139:0:17060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c84c2616600/0x5bf8706fdac8d269 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8d262 expref: 19 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574348.739147:0:17060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c84c2616600, rc 0) 00000100:00100000:3.0:1788574348.739222:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3265c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f73678fb-d8c0-450f-a73b-e6565942045e+19:18567:x1875455681687168:12345-0@lo:101:mount.lustre.0 Request processed in 146us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574348.739230:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788574348.739461:0:18567:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:18567:1875455681687168:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788574348.739477:0:18567:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2a00/0x5bf8706fdac8d262 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d269 expref: -99 pid: 18567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574348.739487:0:18567:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2a00/0x5bf8706fdac8d262 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8d269 expref: -99 pid: 18567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788574348.740905:0:18567:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1788574348.741606:0:18567:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788574348.744824:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1788574348.744883:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1788574348.744901:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1788574348.744915:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1788574348.744931:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1788574348.744947:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1788574348.744974:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1788574348.746078:0:18567:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1788574348.746363:0:18567:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:18567:1875455681687296:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788574348.746435:0:18567:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574348.746526:0:18567:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85d1089780 going to sleep for 11 seconds 00000100:00100000:3.0:1788574348.746906:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681687296 00000100:00100000:3.0:1788574348.746914:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681687296 00000100:00100000:3.0:1788574348.747006:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788574348.747015:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3265450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f73678fb-d8c0-450f-a73b-e6565942045e+19:18567:x1875455681687296:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788574348.747237:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3265450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f73678fb-d8c0-450f-a73b-e6565942045e+19:18567:x1875455681687296:12345-0@lo:501:mount.lustre.0 Request processed in 222us (801us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574348.747244:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788574348.747530:0:18567:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:18567:1875455681687296:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788574348.747571:0:18567:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:18567:1875455681687424:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788574348.747621:0:18567:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574348.747738:0:18567:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85d1089780 going to sleep for 11 seconds 00000100:00100000:3.0:1788574348.747830:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681687424 00000100:00100000:3.0:1788574348.747843:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681687424 00000100:00100000:3.0:1788574348.747877:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788574348.747883:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3266850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f73678fb-d8c0-450f-a73b-e6565942045e+19:18567:x1875455681687424:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788574348.749183:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3266850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f73678fb-d8c0-450f-a73b-e6565942045e+19:18567:x1875455681687424:12345-0@lo:503:mount.lustre.0 Request processed in 1294us (1556us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574348.749395:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788574348.749476:0:18567:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:18567:1875455681687424:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788574348.750391:0:18567:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788574348.750484:0:18567:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:18567:1875455681687552:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788574348.750555:0:18567:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574348.750641:0:18567:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85e5770c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788574348.750868:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681687552 00000100:00100000:0.0:1788574348.750875:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681687552 00000100:00100000:0.0:1788574348.750926:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788574348.750935:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3265850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f73678fb-d8c0-450f-a73b-e6565942045e+19:18567:x1875455681687552:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788574348.752749:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3265850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f73678fb-d8c0-450f-a73b-e6565942045e+19:18567:x1875455681687552:12345-0@lo:502:mount.lustre.0 Request processed in 1809us (2188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574348.752860:0:18567:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:18567:1875455681687552:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788574348.753140:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1788574348.753173:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1788574348.753227:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1788574348.753247:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1788574348.753263:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1788574348.753278:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1788574348.753293:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1788574348.753324:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1788574348.753359:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1788574348.753378:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1788574348.753393:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1788574348.753408:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1788574348.753446:0:18567:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c2f45180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:18567:1875455681687680:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788574348.753500:0:18567:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574348.753548:0:18567:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c3e516c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788574348.753695:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681687680 00000100:00100000:3.0:1788574348.753702:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681687680 00000100:00100000:3.0:1788574348.753764:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788574348.753774:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3267c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f73678fb-d8c0-450f-a73b-e6565942045e+20:18567:x1875455681687680:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788574348.753885:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3267c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f73678fb-d8c0-450f-a73b-e6565942045e+20:18567:x1875455681687680:12345-0@lo:502:mount.lustre.0 Request processed in 113us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574348.753894:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788574348.754223:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788574348.754422:0:18567:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c2f45180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:18567:1875455681687680:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788574348.754482:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:2.0:1788574348.754494:0:18567:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00010000:00010000:0.0:1788574348.755349:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1788574348.755546:0:18584:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788574348.755554:0:18584:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1788574348.755560:0:18584:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574348.755562:0:18584:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1788574348.755568:0:18584:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788574348.755582:0:18584:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9c84c30399c0) 00000020:00000080:2.0:1788574348.755607:0:18584:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788574348.755612:0:18584:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788574348.755712:0:18584:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c85c8a34800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1788574348.755720:0:18584:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788574348.755728:0:18584:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x5bf8706fdac8d277 00010000:00010000:2.0:1788574348.766054:0:18584:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:2.0:1788574348.767074:0:18584:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967326 00080000:10000000:2.0:1788574348.769054:0:18584:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:2.0:1788574348.770737:0:18584:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1788574348.770759:0:18584:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788574348.770766:0:18584:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574348.770769:0:18584:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1788574348.770773:0:18584:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788574348.770776:0:18584:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:2.0:1788574348.770778:0:18584:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788574348.770779:0:18584:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788574348.770780:0:18584:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788574348.770783:0:18584:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574348.770784:0:18584:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788574348.770786:0:18584:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788574348.770789:0:18584:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574348.770790:0:18584:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788574348.770793:0:18584:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788574348.770795:0:18584:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788574348.770798:0:18584:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788574348.770800:0:18584:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574348.770802:0:18584:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788574348.770804:0:18584:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788574348.770806:0:18584:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574348.770807:0:18584:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788574348.770809:0:18584:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788574348.770837:0:18584:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788574348.770840:0:18584:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788574348.770841:0:18584:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788574348.770844:0:18584:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1788574348.771166:0:18567:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1788574348.771237:0:18567:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788574348.771258:0:18567:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2a00/0x5bf8706fdac8d262 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d269 expref: -99 pid: 18567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574348.771270:0:18567:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2a00/0x5bf8706fdac8d262 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d269 expref: -99 pid: 18567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788574348.771279:0:18567:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c85c8a34800 from 1 10000000:01000000:3.0:1788574348.771281:0:18567:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788574348.771332:0:18567:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c84c2616800/0x5bf8706fdac8d27e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574348.771340:0:18567:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c84c2616800/0x5bf8706fdac8d27e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574348.771366:0:18567:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c84c2616800/0x5bf8706fdac8d27e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574348.771392:0:18567:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c8601836300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:18567:1875455681687808:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788574348.771458:0:18567:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574348.771510:0:18567:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c5a5dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788574348.771720:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681687808 00000100:00100000:0.0:1788574348.771729:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681687808 00000100:00100000:0.0:1788574348.771879:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788574348.771888:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3266450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f73678fb-d8c0-450f-a73b-e6565942045e+19:18567:x1875455681687808:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788574348.771901:0:17060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574348.771915:0:17060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85d20d6400/0x5bf8706fdac8d285 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8d27e expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574348.771937:0:17060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85d20d6400/0x5bf8706fdac8d285 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8d27e expref: 20 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574348.771957:0:17060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85d20d6400/0x5bf8706fdac8d285 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8d27e expref: 20 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574348.771965:0:17060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d20d6400, rc 0) 00000100:00100000:0.0:1788574348.772024:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3266450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f73678fb-d8c0-450f-a73b-e6565942045e+20:18567:x1875455681687808:12345-0@lo:101:mount.lustre.0 Request processed in 137us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574348.772032:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788574348.772180:0:18567:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c8601836300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:18567:1875455681687808:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788574348.772228:0:18567:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c84c2616800/0x5bf8706fdac8d27e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d285 expref: -99 pid: 18567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574348.772249:0:18567:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c84c2616800/0x5bf8706fdac8d27e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8d285 expref: -99 pid: 18567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788574348.773581:0:18567:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1788574348.774055:0:18567:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788574348.774484:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1788574348.774513:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1788574348.774533:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1788574348.774539:0:18567:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1788574348.774619:0:18567:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c2f45180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:18567:1875455681687936:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788574348.774695:0:18567:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574348.774996:0:18567:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85fa3da780 going to sleep for 11 seconds 00000100:00100000:3.0:1788574348.775101:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681687936 00000100:00100000:3.0:1788574348.775107:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681687936 00000100:00100000:3.0:1788574348.775154:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788574348.775162:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3264c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f73678fb-d8c0-450f-a73b-e6565942045e+20:18567:x1875455681687936:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788574348.775293:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3264c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f73678fb-d8c0-450f-a73b-e6565942045e+20:18567:x1875455681687936:12345-0@lo:501:mount.lustre.0 Request processed in 131us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574348.775425:0:18567:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c2f45180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:18567:1875455681687936:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788574348.775458:0:18567:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c2f45180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:18567:1875455681688064:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788574348.775498:0:18567:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574348.775521:0:18567:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85fa3da780 going to sleep for 11 seconds 00000100:00100000:1.0:1788574348.775582:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681688064 00000100:00100000:1.0:1788574348.775587:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681688064 00000100:00100000:1.0:1788574348.775606:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788574348.775612:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3266c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f73678fb-d8c0-450f-a73b-e6565942045e+21:18567:x1875455681688064:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788574348.775685:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3266c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f73678fb-d8c0-450f-a73b-e6565942045e+21:18567:x1875455681688064:12345-0@lo:503:mount.lustre.0 Request processed in 73us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574348.775692:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788574348.775778:0:18567:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c2f45180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:18567:1875455681688064:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788574348.776104:0:18567:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788574348.776156:0:18567:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c2f45180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:18567:1875455681688192:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788574348.776232:0:18567:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574348.776256:0:18567:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85fa3da0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788574348.776509:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681688192 00000100:00100000:1.0:1788574348.776514:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681688192 00000100:00100000:1.0:1788574348.776533:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788574348.776539:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3267450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f73678fb-d8c0-450f-a73b-e6565942045e+21:18567:x1875455681688192:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788574348.776615:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3267450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f73678fb-d8c0-450f-a73b-e6565942045e+21:18567:x1875455681688192:12345-0@lo:502:mount.lustre.0 Request processed in 75us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574348.776622:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788574348.776766:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788574348.776874:0:18567:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c2f45180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:18567:1875455681688192:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788574348.777031:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1788574348.777055:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1788574348.777066:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1788574348.777084:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1788574348.777094:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1788574348.777105:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1788574348.777128:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1788574348.777139:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:2.0:1788574348.777150:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1788574348.777160:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:2.0:1788574348.777171:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:2.0:1788574348.777243:0:18567:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c2f45180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:18567:1875455681688320:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788574348.777278:0:18567:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574348.777428:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681688320 00000100:00100000:1.0:1788574348.777433:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681688320 00000100:00100000:1.0:1788574348.777463:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788574348.777469:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3264850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f73678fb-d8c0-450f-a73b-e6565942045e+20:18567:x1875455681688320:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788574348.777534:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3264850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f73678fb-d8c0-450f-a73b-e6565942045e+20:18567:x1875455681688320:12345-0@lo:502:mount.lustre.0 Request processed in 64us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574348.777540:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788574348.777594:0:18567:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85fa3da0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788574348.777608:0:18567:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c2f45180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:18567:1875455681688320:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788574348.777646:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:2.0:1788574348.777655:0:18567:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1788574348.781887:0:18588:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788574348.781900:0:18588:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574348.781903:0:18588:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788574348.781911:0:18588:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c85c8a34800 00000020:00000080:1.0:1788574348.781913:0:18588:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788574348.781921:0:18588:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788574348.781923:0:18588:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574348.781924:0:18588:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788574348.781926:0:18588:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788574348.781929:0:18588:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574348.781930:0:18588:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788574348.781941:0:18588:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c85c8a34800 00000020:00000080:1.0:1788574348.781943:0:18588:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788574348.782003:0:18588:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788574348.782007:0:18588:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574348.782009:0:18588:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788574348.782012:0:18588:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788574348.782014:0:18588:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574348.782016:0:18588:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788574348.782019:0:18588:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c85c8a34800 00000020:00000080:1.0:1788574348.782021:0:18588:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788574348.782040:0:18588:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788574348.782043:0:18588:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574348.782044:0:18588:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788574348.782047:0:18588:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788574348.782049:0:18588:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574348.782050:0:18588:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788574348.782053:0:18588:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c85c8a34800 00000020:00000080:1.0:1788574348.782055:0:18588:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788574348.782079:0:18588:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788574348.782082:0:18588:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574348.782083:0:18588:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788574348.782086:0:18588:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:3.0:1788574348.782320:0:18567:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788574348.782347:0:18567:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788574348.782371:0:18567:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c84c2616800/0x5bf8706fdac8d27e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d285 expref: -99 pid: 18567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574348.782384:0:18567:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c84c2616800/0x5bf8706fdac8d27e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d285 expref: -99 pid: 18567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788574348.782432:0:18567:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788574348.782434:0:18567:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c85c8a34800 10000000:01000000:3.0:1788574348.782437:0:18567:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c85c8a34800 10000000:01000000:3.0:1788574348.782440:0:18567:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788574348.782445:0:18567:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c85c8a34800 from 1 10000000:01000000:3.0:1788574348.782448:0:18567:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788574348.782489:0:18567:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c84c2616000/0x5bf8706fdac8d28c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574348.782497:0:18567:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c84c2616000/0x5bf8706fdac8d28c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574348.782509:0:18567:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c84c2616000/0x5bf8706fdac8d28c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574348.782534:0:18567:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c8601834380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:18567:1875455681688448:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788574348.782603:0:18567:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574348.782645:0:18567:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c5a5d000 going to sleep for 11 seconds 00000100:00100000:3.0:1788574348.782670:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681688448 00000100:00100000:3.0:1788574348.782677:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681688448 00000100:00100000:3.0:1788574348.782714:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788574348.782723:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f7fc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f73678fb-d8c0-450f-a73b-e6565942045e+20:18567:x1875455681688448:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788574348.782735:0:17062:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574348.782746:0:17062:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c84c2616400/0x5bf8706fdac8d293 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8d28c expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574348.782769:0:17062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c84c2616400/0x5bf8706fdac8d293 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8d28c expref: 21 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574348.782779:0:17062:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c84c2616400/0x5bf8706fdac8d293 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8d28c expref: 21 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574348.782786:0:17062:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c84c2616400, rc 0) 00000100:00100000:3.0:1788574348.782820:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f7fc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f73678fb-d8c0-450f-a73b-e6565942045e+21:18567:x1875455681688448:12345-0@lo:101:mount.lustre.0 Request processed in 99us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574348.782826:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788574348.782879:0:18567:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c8601834380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:18567:1875455681688448:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788574348.782894:0:18567:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c84c2616000/0x5bf8706fdac8d28c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d293 expref: -99 pid: 18567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574348.782903:0:18567:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c84c2616000/0x5bf8706fdac8d28c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8d293 expref: -99 pid: 18567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788574348.792482:0:18567:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1788574348.792838:0:18567:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788574348.793294:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1788574348.793855:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1788574348.793874:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1788574348.793888:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1788574348.793902:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1788574348.793917:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1788574348.793948:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1788574348.793964:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1788574348.793979:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1788574348.794074:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1788574348.794088:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1788574348.794101:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1788574348.794114:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1788574348.794127:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1788574348.794140:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1788574348.794154:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1788574348.794167:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1788574348.794181:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1788574348.794234:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1788574348.794251:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1788574348.794264:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1788574348.794275:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1788574348.794312:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1788574348.794336:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1788574348.794349:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:3.0:1788574348.794362:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:3.0:1788574348.794375:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:3.0:1788574348.794386:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:3.0:1788574348.794399:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:3.0:1788574348.794411:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:3.0:1788574348.794422:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:3.0:1788574348.794432:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:3.0:1788574348.794444:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:3.0:1788574348.794455:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:3.0:1788574348.794468:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:3.0:1788574348.794480:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:3.0:1788574348.794493:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:3.0:1788574348.794515:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:3.0:1788574348.794520:0:18567:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1788574348.794621:0:18567:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c8601834380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:18567:1875455681688576:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788574348.794686:0:18567:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574348.794749:0:18567:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c5a5d900 going to sleep for 11 seconds 00000100:00100000:3.0:1788574348.797170:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681688576 00000100:00100000:3.0:1788574348.797181:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681688576 00000100:00100000:3.0:1788574348.797274:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788574348.797284:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f7fc0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f73678fb-d8c0-450f-a73b-e6565942045e+21:18567:x1875455681688576:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788574348.798463:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f7fc0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f73678fb-d8c0-450f-a73b-e6565942045e+21:18567:x1875455681688576:12345-0@lo:501:mount.lustre.0 Request processed in 1176us (3772us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574348.798476:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788574348.798541:0:18567:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c8601834380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:18567:1875455681688576:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788574348.798590:0:18567:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c8601834380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:18567:1875455681688704:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788574348.798647:0:18567:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574348.799887:0:18567:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c5a5d900 going to sleep for 11 seconds 00000100:00100000:2.0:1788574348.801859:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681688704 00000100:00100000:2.0:1788574348.801873:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681688704 00000100:00100000:2.0:1788574348.801927:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788574348.801937:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f7fc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f73678fb-d8c0-450f-a73b-e6565942045e+21:18567:x1875455681688704:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788574348.802103:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f7fc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f73678fb-d8c0-450f-a73b-e6565942045e+21:18567:x1875455681688704:12345-0@lo:503:mount.lustre.0 Request processed in 167us (3456us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574348.802111:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788574348.802327:0:18567:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c8601834380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:18567:1875455681688704:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788574348.802882:0:18567:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788574348.803051:0:18567:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c8601834380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:18567:1875455681688832:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788574348.803108:0:18567:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574348.803151:0:18567:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c5a5d000 going to sleep for 11 seconds 00000100:00100000:2.0:1788574348.803673:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681688832 00000100:00100000:2.0:1788574348.803682:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681688832 00000100:00100000:2.0:1788574348.803731:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788574348.803739:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f7fc2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f73678fb-d8c0-450f-a73b-e6565942045e+21:18567:x1875455681688832:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788574348.803854:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f7fc2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f73678fb-d8c0-450f-a73b-e6565942045e+21:18567:x1875455681688832:12345-0@lo:502:mount.lustre.0 Request processed in 116us (745us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574348.803861:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788574348.804141:0:18567:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c8601834380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:18567:1875455681688832:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788574348.804387:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1788574348.804417:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1788574348.804430:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1788574348.804443:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1788574348.804462:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1788574348.804476:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1788574348.804488:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1788574348.804501:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1788574348.804514:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1788574348.804526:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1788574348.804536:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1788574348.804549:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1788574348.804562:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1788574348.804575:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1788574348.804606:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1788574348.804623:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1788574348.804637:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1788574348.804651:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1788574348.804664:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1788574348.804675:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1788574348.804687:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1788574348.804727:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1788574348.804743:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1788574348.804944:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1788574348.804962:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:3.0:1788574348.804974:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:3.0:1788574348.805396:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:3.0:1788574348.805414:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:3.0:1788574348.805427:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:3.0:1788574348.805438:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:3.0:1788574348.805466:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:3.0:1788574348.805482:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:3.0:1788574348.805496:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:3.0:1788574348.805510:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:3.0:1788574348.805525:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:3.0:1788574348.805539:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:3.0:1788574348.805550:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:3.0:1788574348.805561:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:3.0:1788574348.805574:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:3.0:1788574348.805587:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:3.0:1788574348.805600:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:3.0:1788574348.805613:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:3.0:1788574348.805626:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:3.0:1788574348.805639:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:3.0:1788574348.805654:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:3.0:1788574348.805668:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:3.0:1788574348.805697:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:3.0:1788574348.807433:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:3.0:1788574348.807498:0:18567:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c8601834380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:18567:1875455681688960:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788574348.807582:0:18567:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574348.807638:0:18567:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c5a5d000 going to sleep for 11 seconds 00000100:00100000:2.0:1788574348.808139:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681688960 00000100:00100000:2.0:1788574348.808148:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681688960 00000100:00100000:2.0:1788574348.808235:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788574348.808245:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f7fc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f73678fb-d8c0-450f-a73b-e6565942045e+21:18567:x1875455681688960:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788574348.808933:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f7fc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f73678fb-d8c0-450f-a73b-e6565942045e+21:18567:x1875455681688960:12345-0@lo:502:mount.lustre.0 Request processed in 686us (1347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574348.808943:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788574348.809147:0:18567:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c8601834380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:18567:1875455681688960:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788574348.810148:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:3.0:1788574348.810844:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:3.0:1788574348.810893:0:18567:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c8601834380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:18567:1875455681689088:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788574348.810955:0:18567:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574348.811854:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681689088 00000100:00100000:3.0:1788574348.811865:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681689088 00000100:00100000:3.0:1788574348.813169:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788574348.813185:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f7fc2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f73678fb-d8c0-450f-a73b-e6565942045e+21:18567:x1875455681689088:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788574348.813380:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f7fc2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f73678fb-d8c0-450f-a73b-e6565942045e+21:18567:x1875455681689088:12345-0@lo:502:mount.lustre.0 Request processed in 200us (2424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574348.813389:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788574348.822166:0:18567:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c5a5d000 going to sleep for 11 seconds 00000100:00100000:1.0:1788574348.822242:0:18567:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c8601834380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:18567:1875455681689088:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788574348.822419:0:18567:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:1.0:1788574348.822433:0:18567:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1788574348.835443:0:18592:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788574348.835483:0:18592:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9c84c2323380) 00000020:00000080:3.0:1788574348.835511:0:18592:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:3.0:1788574348.835630:0:18592:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c85c8a34800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788574348.835635:0:18592:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c85c8a34800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788574348.835637:0:18592:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c85c8a34800 3 00010000:00080000:3.0:1788574348.835670:0:18592:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c84c34c6800@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.151@tcp at head 00010000:00010000:3.0:1788574348.840855:0:18592:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:3.0:1788574348.841061:0:18592:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1788574348.841103:0:18592:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788574348.841119:0:18592:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x5bf8706fdac8d2a1 00000100:00080000:3.0:1788574348.841129:0:18592:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788574348.841136:0:18592:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c84c34c6800 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:3.0:1788574348.841173:0:18592:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c8601834a80 x1875455681689216/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788574348.841226:0:18592:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788574348.841370:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c8601834a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1875455681689216:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788574348.841444:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574348.841912:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681689216 00000100:00100000:3.0:1788574348.841921:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681689216 00000100:00100000:3.0:1788574348.841950:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788574348.841957:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c335ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3616:x1875455681689216:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788574348.841979:0:17068:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 488 last 0 00000020:00000080:3.0:1788574348.842022:0:17068:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x5bf8706fdac8d2a8 00000004:00100000:3.0:1788574348.842037:0:17068:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788574348.842076:0:17068:0:(import.c:65:import_set_state_nolock()) ffff9c84c34c1800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788574348.845434:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c335ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875455681689216:12345-0@lo:38:llog_process_th.0 Request processed in 3466us (3980us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574348.845450:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000020:01000004:3.0:1788574348.845620:0:18592:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788574348.845636:0:18592:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9c84c2324d40) 00000020:00000080:3.0:1788574348.845660:0:18592:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:3.0:1788574348.845928:0:18592:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c85c8a34800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788574348.845933:0:18592:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c85c8a34800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788574348.845936:0:18592:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c85c8a34800 3 00010000:00080000:3.0:1788574348.845967:0:18592:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c84c2217800@lustre-MDT0001-lwp-OST0000: add connection 192.168.204.151@tcp at head 00000100:00080000:0.0:1788574348.852182:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788574348.852230:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788574348.852233:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788574348.852236:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788574348.852266:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788574348.852269:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788574348.852271:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788574348.852274:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788574348.852330:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875455681689728:0@lo:400:kworker.0 00000100:00100000:0.0:1788574348.852399:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574348.852433:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788574348.852439:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681689344:0@lo:400:kworker.0 00000100:00100000:0.0:1788574348.852463:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574348.852494:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875455681689472:0@lo:400:kworker.0 00000100:00100000:0.0:1788574348.852516:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574348.852543:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788574348.852549:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681689600:0@lo:400:kworker.0 00000100:00100000:0.0:1788574348.852573:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574348.852612:0:17072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681689344 00000100:00100000:0.0:1788574348.852620:0:17072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681689344 00000100:00100000:0.0:1788574348.852658:0:17072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681689600 00000100:00100000:0.0:1788574348.852662:0:17072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681689600 00000100:00100000:0.0:1788574348.852677:0:17072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788574348.852686:0:17072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681689344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574348.853393:0:17072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681689344:12345-0@lo:400:kworker.0 Request processed in 705us (926us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574348.853402:0:17072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788574348.853424:0:17072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788574348.853433:0:17072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681689600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574348.853475:0:17072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681689600:12345-0@lo:400:kworker.0 Request processed in 44us (901us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574348.853481:0:17072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788574348.853514:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681689728 00000100:00100000:0.0:1788574348.853518:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681689728 00000100:00100000:0.0:1788574348.853545:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681689472 00000100:00100000:0.0:1788574348.853548:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681689472 00000100:00100000:0.0:1788574348.853559:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788574348.853564:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875455681689728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574348.853592:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875455681689728:12345-0@lo:400:kworker.0 Request processed in 28us (1194us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574348.853597:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788574348.853609:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788574348.853614:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875455681689472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574348.853653:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875455681689472:12345-0@lo:400:kworker.0 Request processed in 39us (1136us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574348.853660:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788574348.853719:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681689344:0@lo:400:kworker.0 00010000:00080000:0.0:1788574348.853735:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c84c36dca80 x1875455681689728/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574364 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574348.853744:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875455681689728:0@lo:400:kworker.0 00000100:00100000:0.0:1788574348.854942:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681689600:0@lo:400:kworker.0 00010000:00080000:0.0:1788574348.854959:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c84c36de300 x1875455681689472/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574364 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574348.854968:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875455681689472:0@lo:400:kworker.0 00010000:00010000:3.0:1788574348.858266:0:18592:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00010000:00080000:1.0:1788574348.859067:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c8601834a80 x1875455681689216/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788574358 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574348.859081:0:3616:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788574348.859097:0:3616:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1788574348.859105:0:3616:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788574348.859110:0:3616:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788574348.859114:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c84c34c6800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788574348.859121:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c8601834a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3616:1875455681689216:0@lo:38:llog_process_th.0 00000020:00000080:3.0:1788574348.863904:0:18592:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1788574348.863951:0:18592:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788574348.863963:0:18592:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x5bf8706fdac8d2b6 00000100:00080000:3.0:1788574348.863973:0:18592:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788574348.863989:0:18592:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9c84c2217800 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:3.0:1788574348.864025:0:18592:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c8601837800 x1875455681689856/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788574348.864046:0:18592:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1788574348.864251:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788574348.864256:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788574348.864259:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788574348.864262:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788574348.864266:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788574348.864269:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788574348.864271:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788574348.864274:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:3.0:1788574348.870712:0:18592:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:1.0:1788574348.871963:0:18567:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1788574348.873835:0:18567:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788574348.873858:0:18567:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c84c2616000/0x5bf8706fdac8d28c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d293 expref: -99 pid: 18567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574348.873872:0:18567:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c84c2616000/0x5bf8706fdac8d28c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d293 expref: -99 pid: 18567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788574348.873927:0:18567:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788574348.873929:0:18567:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788574348.873930:0:18567:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788574348.873931:0:18567:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788574348.873933:0:18567:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788574348.873934:0:18567:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788574348.873936:0:18567:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788574348.873938:0:18567:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788574348.873939:0:18567:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788574348.873943:0:18567:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1788574348.873945:0:18567:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788574348.873947:0:18567:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788574348.873948:0:18567:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788574348.873949:0:18567:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788574348.873950:0:18567:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788574348.873952:0:18567:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788574348.873953:0:18567:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788574348.873954:0:18567:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788574348.873955:0:18567:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788574348.874391:0:18567:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788574348.874415:0:18567:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:18567:1875455681689984:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788574348.874507:0:18567:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574348.874561:0:18567:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85fa319cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788574348.874912:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681689984 00000100:00100000:2.0:1788574348.874920:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681689984 00000100:00100000:2.0:1788574348.874969:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788574348.876387:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f7fc1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f73678fb-d8c0-450f-a73b-e6565942045e+21:18567:x1875455681689984:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788574348.876431:0:17062:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788574348.876446:0:17062:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1788574348.877580:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c8601837800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3616:1875455681689856:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788574348.877662:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574348.878811:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681689856 00000100:00100000:3.0:1788574348.878823:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681689856 00000100:00100000:2.0:1788574348.878936:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788574348.878945:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c335dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3616:x1875455681689856:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788574348.878973:0:17068:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 488 last 0 00000020:00000080:2.0:1788574348.879069:0:17068:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x5bf8706fdac8d2bd 00000004:00100000:2.0:1788574348.879179:0:17068:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788574348.879364:0:17068:0:(import.c:65:import_set_state_nolock()) ffff9c85ec196000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788574348.879469:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c335dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875455681689856:12345-0@lo:38:llog_process_th.0 Request processed in 523us (1806us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574348.879477:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 20000000:01000000:2.0:1788574348.882396:0:17062:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788574348.882416:0:17062:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788574348.883614:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f7fc1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f73678fb-d8c0-450f-a73b-e6565942045e+21:18567:x1875455681689984:12345-0@lo:253:mount.lustre.0 Request processed in 8632us (9101us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574348.883628:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 20000000:01000000:0.0:1788574348.883772:0:17083:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788574348.883777:0:17083:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788574348.883805:0:17083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c85d20d6c00/0x5bf8706fdac8d2c4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574348.883822:0:17083:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c85fa32f800/0x5bf8706fdac8d20e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8d207 expref: 20 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574348.883829:0:17083:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c85d08a2e00/0x5bf8706fdac8d21c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8d215 expref: 20 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574348.883835:0:17083:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c85d20d6c00/0x5bf8706fdac8d2c4 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574348.883870:0:17083:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c85d08a2e00/0x5bf8706fdac8d21c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5bf8706fdac8d215 expref: 20 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574348.883883:0:17083:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c85d08a2e00/0x5bf8706fdac8d21c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5bf8706fdac8d215 expref: 20 pid: 17061 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574348.883896:0:17083:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36de300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17083:1875455681690112:0@lo:104: 00000100:00100000:0.0:1788574348.883932:0:17083:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788574348.883976:0:17083:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c85fa32f800/0x5bf8706fdac8d20e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5bf8706fdac8d207 expref: 20 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574348.884448:0:17083:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c85fa32f800/0x5bf8706fdac8d20e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5bf8706fdac8d207 expref: 20 pid: 17062 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574348.884457:0:17083:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36dca80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17083:1875455681690240:0@lo:104: 00000100:00100000:0.0:1788574348.884487:0:17083:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574348.885412:0:17083:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85fa2de0c0 going to sleep for 11 seconds 00010000:00080000:1.0:1788574348.886660:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c8601837800 x1875455681689856/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788574358 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574348.886675:0:3616:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788574348.886686:0:3616:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1788574348.886695:0:3616:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788574348.886700:0:3616:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788574348.886703:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c84c2217800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788574348.886720:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c8601837800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3616:1875455681689856:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788574348.887407:0:18567:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:18567:1875455681689984:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788574348.887423:0:18567:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788574348.887426:0:18567:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788574348.887428:0:18567:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788574348.887429:0:18567:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788574348.887430:0:18567:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788574348.887431:0:18567:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788574348.887433:0:18567:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788574348.887434:0:18567:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788574348.887436:0:18567:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788574348.887437:0:18567:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788574348.887451:0:18567:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1788574348.890614:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681690112 00000100:00100000:0.0:1788574348.890626:0:17051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681690112 00000100:00100000:0.0:1788574348.890672:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681690240 00000100:00100000:0.0:1788574348.890675:0:17051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681690240 00000100:00100000:0.0:1788574348.890692:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788574348.890701:0:17051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f73678fb-d8c0-450f-a73b-e6565942045e+4:17083:x1875455681690112:12345-0@lo:104: 00010000:00010000:0.0:1788574348.890732:0:17051:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff9c84c2617000/0x5bf8706fdac8d215 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8d21c expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574348.890831:0:17051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788574348.890838:0:17051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f73678fb-d8c0-450f-a73b-e6565942045e+4:17083:x1875455681690112:12345-0@lo:104: Request processed in 138us (6905us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574348.890845:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788574348.890861:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788574348.890867:0:17051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e588a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f73678fb-d8c0-450f-a73b-e6565942045e+3:17083:x1875455681690240:12345-0@lo:104: 00010000:00010000:0.0:1788574348.890876:0:17051:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2000/0x5bf8706fdac8d207 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8d20e expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574348.890909:0:17051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788574348.890915:0:17051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e588a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f73678fb-d8c0-450f-a73b-e6565942045e+3:17083:x1875455681690240:12345-0@lo:104: Request processed in 48us (6427us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574348.890922:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1788574348.890965:0:17056:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788574348.890971:0:17056:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c84c2617000/0x5bf8706fdac8d215 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8d21c expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574348.890991:0:17056:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c84c2617000 already unused, calling callback (ffffffffc1472c20) 10000000:00010000:0.0:1788574348.890995:0:17056:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c84c2617000/0x5bf8706fdac8d215 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5bf8706fdac8d21c expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574348.891004:0:17056:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c84c2617000/0x5bf8706fdac8d215 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5bf8706fdac8d21c expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788574348.891019:0:17056:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c84c2617000/0x5bf8706fdac8d215 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5bf8706fdac8d21c expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788574348.891024:0:17056:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788574348.891063:0:17056:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9c84c2617000/0x5bf8706fdac8d215 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8d21c expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574348.891069:0:17056:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788574348.891100:0:17056:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c84c2617000/0x5bf8706fdac8d215 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8d21c expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574348.891108:0:17056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c84c2617000/0x5bf8706fdac8d215 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8d21c expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574348.891120:0:17056:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788574348.891123:0:17056:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2000/0x5bf8706fdac8d207 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8d20e expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574348.891128:0:17056:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d08a2000 already unused, calling callback (ffffffffc1472c20) 10000000:00010000:0.0:1788574348.891132:0:17056:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2000/0x5bf8706fdac8d207 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5bf8706fdac8d20e expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574348.891138:0:17056:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2000/0x5bf8706fdac8d207 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5bf8706fdac8d20e expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788574348.891145:0:17056:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2000/0x5bf8706fdac8d207 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5bf8706fdac8d20e expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788574348.891150:0:17056:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788574348.891170:0:17056:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2000/0x5bf8706fdac8d207 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8d20e expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574348.891175:0:17056:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788574348.891216:0:17056:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2000/0x5bf8706fdac8d207 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8d20e expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574348.891223:0:17056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2000/0x5bf8706fdac8d207 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8d20e expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574348.891235:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574348.891237:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574348.891238:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574348.891244:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574348.891264:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f73678fb-d8c0-450f-a73b-e6565942045e:3620:1875455681690368:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788574348.892695:0:17050:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (1/2 left), rc = 0 00000100:00100000:0.0:1788574348.895116:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574348.895245:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f73678fb-d8c0-450f-a73b-e6565942045e:3617:1875455681690496:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788574348.895425:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574348.895469:0:17054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681690368 00000100:00100000:0.0:1788574348.895476:0:17054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681690368 00010000:00010000:0.0:1788574348.895508:0:17054:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c85d08a2e00/0x5bf8706fdac8d21c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8d215 expref: 21 pid: 17061 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574348.895537:0:17054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681690496 00000100:00100000:0.0:1788574348.895541:0:17054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681690496 00010000:00010000:0.0:1788574348.895554:0:17054:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c85fa32f800/0x5bf8706fdac8d20e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8d207 expref: 22 pid: 17062 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574348.895569:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788574348.895577:0:17054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f73678fb-d8c0-450f-a73b-e6565942045e+22:3620:x1875455681690368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788574348.895602:0:17054:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574348.895608:0:17054:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c85d08a2e00/0x5bf8706fdac8d21c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8d215 expref: 22 pid: 17061 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574348.895620:0:17054:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c85d08a2e00/0x5bf8706fdac8d21c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5bf8706fdac8d215 expref: 22 pid: 17061 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574348.895640:0:17054:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574348.895674:0:17054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f73678fb-d8c0-450f-a73b-e6565942045e+22:3620:x1875455681690368:12345-0@lo:103:ldlm_bl.0 Request processed in 99us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574348.895682:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788574348.895699:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788574348.895705:0:17054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa36f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f73678fb-d8c0-450f-a73b-e6565942045e+21:3617:x1875455681690496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788574348.895713:0:17054:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574348.895717:0:17054:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c85fa32f800/0x5bf8706fdac8d20e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8d207 expref: 21 pid: 17062 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574348.895725:0:17054:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c85fa32f800/0x5bf8706fdac8d20e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5bf8706fdac8d207 expref: 21 pid: 17062 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574348.895737:0:17054:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c85d20d6c00/0x5bf8706fdac8d2c4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574348.895746:0:17054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85d20d6c00/0x5bf8706fdac8d2c4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788574348.896060:0:17054:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.012283329s 00010000:00010000:0.0:1788574348.896066:0:17054:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c85d20d6c00/0x5bf8706fdac8d2c4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574348.896146:0:17054:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c85d20d6c00/0x5bf8706fdac8d2c4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574348.896157:0:17054:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c85d20d6c00/0x5bf8706fdac8d2c4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574348.896164:0:17054:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c85d20d6c00/0x5bf8706fdac8d2c4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574348.896170:0:17054:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d6c00 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:0.0:1788574348.896174:0:17054:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c85d20d6c00/0x5bf8706fdac8d2c4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574348.896183:0:17054:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c85d20d6c00/0x5bf8706fdac8d2c4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574348.896222:0:17054:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c85d20d6c00/0x5bf8706fdac8d2c4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574348.896233:0:17054:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574348.896269:0:17054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa36f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f73678fb-d8c0-450f-a73b-e6565942045e+21:3617:x1875455681690496:12345-0@lo:103:ldlm_bl.0 Request processed in 563us (843us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574348.896276:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788574348.896422:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f73678fb-d8c0-450f-a73b-e6565942045e:3617:1875455681690496:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788574348.896449:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f73678fb-d8c0-450f-a73b-e6565942045e:3620:1875455681690368:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788574348.896473:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85d08a2e00/0x5bf8706fdac8d21c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5bf8706fdac8d215 expref: 20 pid: 17061 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574348.896498:0:17083:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36de300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17083:1875455681690112:0@lo:104: 00010000:00010000:0.0:1788574348.896513:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85fa32f800/0x5bf8706fdac8d20e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5bf8706fdac8d207 expref: 19 pid: 17062 timeout: 588 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574348.896521:0:17083:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36dca80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17083:1875455681690240:0@lo:104: 00010000:00010000:0.0:1788574348.896534:0:17083:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c85d20d6c00/0x5bf8706fdac8d2c4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574348.896543:0:17083:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c85d20d6c00/0x5bf8706fdac8d2c4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574348.896550:0:17083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c85d20d6c00/0x5bf8706fdac8d2c4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574348.896556:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85d20d6c00/0x5bf8706fdac8d2c4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:1.0:1788574348.898635:0:18567:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1788574348.903871:0:18567:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1788574348.903881:0:18567:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1788574348.903919:0:18567:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788574348.903961:0:18567:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.151@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788574348.904060:0:18567:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1788574348.904078:0:18567:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:1.0:1788574348.905404:0:18567:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788574348.905636:0:18567:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788574349.460233:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c2f45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681690624:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788574349.460424:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574349.460613:0:17072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681690624 00000100:00100000:3.0:1788574349.460621:0:17072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681690624 00000100:00100000:3.0:1788574349.460687:0:17072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788574349.460695:0:17072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2f45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681690624:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788574349.460729:0:17072:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788574349.460772:0:17072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2f45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681690624:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574349.460778:0:17072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788574349.461136:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c8601837480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681690752:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788574349.461169:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574349.461355:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681690752 00000100:00100000:2.0:1788574349.461360:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681690752 00000100:00100000:2.0:1788574349.461393:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788574349.461400:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601835500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681690752:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788574349.461421:0:17073:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788574349.461592:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601835500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681690752:12345-0@lo:41:osp-pre-0-1.0 Request processed in 192us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574349.461600:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788574349.461659:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c2f45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681690624:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788574349.461780:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c8601837480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681690752:0@lo:41:osp-pre-0-1.0 00000020:00000004:0.0:1788574349.694540:0:18646:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788574349.695268:0:18646:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788574349.779490:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788574350.420388:0:17064:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788574350.420397:0:17064:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c85c3688000 from 9 10000000:01000000:0.0:1788574350.420403:0:17064:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788574350.420451:0:17064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6a00/0x5bf8706fdac8d2cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574350.420464:0:17064:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6a00/0x5bf8706fdac8d2cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574350.420488:0:17064:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6a00/0x5bf8706fdac8d2cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574350.420512:0:17064:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36dca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f73678fb-d8c0-450f-a73b-e6565942045e:17064:1875455681690880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788574350.420580:0:17064:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574350.420620:0:17064:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85fa2de780 going to sleep for 11 seconds 00000100:00100000:3.0:1788574350.420896:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681690880 00000100:00100000:3.0:1788574350.420904:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681690880 00000100:00100000:3.0:1788574350.420959:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788574350.420968:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f7fc3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f73678fb-d8c0-450f-a73b-e6565942045e+19:17064:x1875455681690880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788574350.420980:0:17061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574350.420994:0:17061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c84c2616a00/0x5bf8706fdac8d2d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8d2cb expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574350.421016:0:17061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c84c2616a00/0x5bf8706fdac8d2d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8d2cb expref: 20 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574350.421026:0:17061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c84c2616a00/0x5bf8706fdac8d2d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8d2cb expref: 20 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574350.421035:0:17061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c84c2616a00, rc 0) 00000100:00100000:3.0:1788574350.421083:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f7fc3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f73678fb-d8c0-450f-a73b-e6565942045e+20:17064:x1875455681690880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574350.421089:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788574350.421135:0:17064:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36dca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f73678fb-d8c0-450f-a73b-e6565942045e:17064:1875455681690880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788574350.421149:0:17064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6a00/0x5bf8706fdac8d2cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d2d2 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574350.421157:0:17064:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6a00/0x5bf8706fdac8d2cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8d2d2 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574350.421558:0:17064:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c8601837480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f73678fb-d8c0-450f-a73b-e6565942045e:17064:1875455681691008:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788574350.421656:0:17064:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574350.421695:0:17064:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c86002133c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788574350.421720:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681691008 00000100:00100000:3.0:1788574350.421725:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681691008 00000100:00100000:3.0:1788574350.421767:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788574350.421775:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f7fc0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f73678fb-d8c0-450f-a73b-e6565942045e+20:17064:x1875455681691008:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788574350.421789:0:17062:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788574350.421805:0:17062:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788574350.421808:0:17062:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:3.0:1788574350.421899:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f7fc0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f73678fb-d8c0-450f-a73b-e6565942045e+20:17064:x1875455681691008:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 125us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574350.421906:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788574350.421938:0:17064:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c8601837480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f73678fb-d8c0-450f-a73b-e6565942045e:17064:1875455681691008:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788574350.422012:0:17064:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788574350.422020:0:17064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6a00/0x5bf8706fdac8d2cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d2d2 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574350.422037:0:17064:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6a00/0x5bf8706fdac8d2cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d2d2 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788574350.422047:0:17064:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788574350.422049:0:17064:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c84c3fd7800 from 9 10000000:01000000:3.0:1788574350.422052:0:17064:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788574350.422071:0:17064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c84c2617400/0x5bf8706fdac8d2d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574350.422078:0:17064:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c84c2617400/0x5bf8706fdac8d2d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574350.422086:0:17064:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c84c2617400/0x5bf8706fdac8d2d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574350.422098:0:17064:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c8601837480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f73678fb-d8c0-450f-a73b-e6565942045e:17064:1875455681691136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788574350.422123:0:17064:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574350.422136:0:17064:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c86002133c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788574350.422146:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681691136 00000100:00100000:3.0:1788574350.422150:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681691136 00000100:00100000:3.0:1788574350.422182:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788574350.422207:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f7fc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f73678fb-d8c0-450f-a73b-e6565942045e+20:17064:x1875455681691136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788574350.422215:0:17062:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574350.422224:0:17062:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c84c2617200/0x5bf8706fdac8d2e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8d2d9 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574350.422240:0:17062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c84c2617200/0x5bf8706fdac8d2e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8d2d9 expref: 21 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574350.422260:0:17062:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c84c2617200/0x5bf8706fdac8d2e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8d2d9 expref: 21 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574350.422267:0:17062:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c84c2617200, rc 0) 00000100:00100000:3.0:1788574350.422295:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f7fc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f73678fb-d8c0-450f-a73b-e6565942045e+21:17064:x1875455681691136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574350.422301:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788574350.422330:0:17064:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c8601837480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f73678fb-d8c0-450f-a73b-e6565942045e:17064:1875455681691136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788574350.422340:0:17064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c84c2617400/0x5bf8706fdac8d2d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d2e0 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574350.422348:0:17064:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c84c2617400/0x5bf8706fdac8d2d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8d2e0 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574350.422385:0:17064:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c8601837480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f73678fb-d8c0-450f-a73b-e6565942045e:17064:1875455681691264:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788574350.422412:0:17064:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574350.422425:0:17064:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c86002133c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788574350.422435:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681691264 00000100:00100000:3.0:1788574350.422438:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681691264 00000100:00100000:3.0:1788574350.422458:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788574350.422464:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f7fc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f73678fb-d8c0-450f-a73b-e6565942045e+21:17064:x1875455681691264:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788574350.422472:0:17062:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788574350.422483:0:17062:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788574350.422486:0:17062:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:3.0:1788574350.422561:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f7fc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f73678fb-d8c0-450f-a73b-e6565942045e+21:17064:x1875455681691264:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 96us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574350.422576:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788574350.422606:0:17064:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c8601837480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f73678fb-d8c0-450f-a73b-e6565942045e:17064:1875455681691264:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788574350.422640:0:17064:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788574350.422645:0:17064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c84c2617400/0x5bf8706fdac8d2d9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d2e0 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574350.422653:0:17064:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c84c2617400/0x5bf8706fdac8d2d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d2e0 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574350.815000:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574351.832271:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788574352.275883:0:17104:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788574352.854728:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574353.875415:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788574354.067427:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788574354.067434:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788574354.067436:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788574354.067439:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788574354.067456:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788574354.067459:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788574354.067461:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788574354.067465:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788574354.067512:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681691776:0@lo:400:kworker.0 00000100:00100000:0.0:1788574354.067635:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574354.067694:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788574354.067702:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f73678fb-d8c0-450f-a73b-e6565942045e:3619:1875455681691392:0@lo:400:kworker.0 00000100:00100000:0.0:1788574354.067769:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574354.067804:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875455681691904:0@lo:400:kworker.0 00000100:00100000:0.0:1788574354.067830:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574354.067863:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681691520:0@lo:400:kworker.0 00000100:00100000:0.0:1788574354.067924:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574354.068137:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1875455681692032:0@lo:400:kworker.0 00000100:00100000:0.0:1788574354.068171:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574354.068211:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788574354.068219:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875455681691648:0@lo:400:kworker.0 00000100:00100000:0.0:1788574354.068244:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574354.068261:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1875455681692160:0@lo:400:kworker.0 00000100:00100000:0.0:1788574354.068283:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574354.068311:0:17072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681691776 00000100:00100000:0.0:1788574354.068319:0:17072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681691776 00000100:00100000:0.0:1788574354.068365:0:17072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681691520 00000100:00100000:0.0:1788574354.068368:0:17072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681691520 00000100:00100000:0.0:1788574354.068385:0:17072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788574354.068393:0:17072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681691776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574354.068452:0:17072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681691776:12345-0@lo:400:kworker.0 Request processed in 60us (818us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574354.068460:0:17072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788574354.068477:0:17072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788574354.068484:0:17072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681691520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574354.068514:0:17072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681691520:12345-0@lo:400:kworker.0 Request processed in 31us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574354.068519:0:17072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788574354.069350:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681691392 00000100:00100000:0.0:1788574354.069357:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681691392 00000100:00100000:0.0:1788574354.069396:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788574354.069403:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f7fc1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f73678fb-d8c0-450f-a73b-e6565942045e+21:3619:x1875455681691392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574354.069457:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f7fc1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f73678fb-d8c0-450f-a73b-e6565942045e+21:3619:x1875455681691392:12345-0@lo:400:kworker.0 Request processed in 55us (1688us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574354.069463:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788574354.069605:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681691904 00000100:00100000:0.0:1788574354.069610:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681691904 00000100:00100000:0.0:1788574354.069635:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681692032 00000100:00100000:0.0:1788574354.069638:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681692032 00000100:00100000:0.0:1788574354.069672:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681691648 00000100:00100000:0.0:1788574354.069684:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681691648 00000100:00100000:0.0:1788574354.069703:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681692160 00000100:00100000:0.0:1788574354.069709:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681692160 00000100:00100000:0.0:1788574354.069729:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788574354.069736:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875455681691904:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788574354.069841:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788574354.069847:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788574354.069904:0:17067:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788574354.069914:0:17067:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1788574354.070051:0:17068:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788574354.070063:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788574354.070072:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875455681692032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574354.070127:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875455681692032:12345-0@lo:400:kworker.0 Request processed in 57us (1955us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574354.070134:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788574354.070150:0:17068:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788574354.070156:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788574354.070162:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875455681691648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574354.070224:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875455681691648:12345-0@lo:400:kworker.0 Request processed in 62us (1980us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574354.070230:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788574354.070242:0:17068:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788574354.070247:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788574354.070254:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875455681692160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574354.070286:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875455681692160:12345-0@lo:400:kworker.0 Request processed in 33us (2003us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574354.070293:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788574354.070307:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f73678fb-d8c0-450f-a73b-e6565942045e:3619:1875455681691392:0@lo:400:kworker.0 00000100:00100000:2.0:1788574354.070326:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681691776:0@lo:400:kworker.0 00010000:00080000:1.0:1788574354.070341:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c84c36ded80 x1875455681691648/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574370 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574354.070353:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875455681691648:0@lo:400:kworker.0 00010000:00080000:1.0:1788574354.070378:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c84c1be3480 x1875455681692160/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574370 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574354.070385:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1875455681692160:0@lo:400:kworker.0 00000100:00100000:1.0:1788574354.070401:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681691520:0@lo:400:kworker.0 00010000:00080000:1.0:1788574354.070414:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c84c36dca80 x1875455681692032/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574370 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574354.070423:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1875455681692032:0@lo:400:kworker.0 00000100:00100000:0.0:1788574354.071510:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875455681691904:12345-0@lo:400:kworker.0 Request processed in 1768us (3672us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574354.071524:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1788574354.072129:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c84c36dc380 x1875455681691904/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574370 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574354.072145:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875455681691904:0@lo:400:kworker.0 00000001:02000400:0.0:1788574354.469633:0:18937:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg451-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1788574354.579333:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788574354.579357:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c8601837480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681692288:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788574354.579424:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574354.579492:0:17072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681692288 00000100:00100000:3.0:1788574354.579499:0:17072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681692288 00000100:00100000:3.0:1788574354.579547:0:17072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788574354.579555:0:17072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601836680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681692288:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788574354.579588:0:17072:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788574354.579672:0:17072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601836680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681692288:12345-0@lo:41:osp-pre-0-1.0 Request processed in 117us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574354.579680:0:17072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788574354.579820:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c8601837480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681692288:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788574354.579983:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788574354.579992:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c8601837480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681692416:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788574354.580018:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574354.580050:0:17807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681692416 00000100:00100000:3.0:1788574354.580054:0:17807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681692416 00000100:00100000:3.0:1788574354.580075:0:17807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788574354.580082:0:17807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601834e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681692416:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788574354.580117:0:17807:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788574354.580214:0:17807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601834e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681692416:12345-0@lo:41:osp-pre-1-0.0 Request processed in 132us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574354.580221:0:17807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788574354.580248:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c8601837480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681692416:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788574354.899422:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788574355.584281:0:18989:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788574355.593841:0:18989:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788574355.924018:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788574356.500038:0:17820:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:3.0:1788574356.779461:0:19039:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788574356.779692:0:19039:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788574356.958171:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574357.975668:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574358.108818:0:3616:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788574343/real 1788574343] req@ffff9c84c3009500 x1875455681684608/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788574358 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574358.108853:0:3616:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c84c3009500 x1875455681684608/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788574358 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574358.108865:0:3616:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788574343/real 1788574343] req@ffff9c84c3008380 x1875455681684736/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788574358 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574358.108895:0:3616:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c84c3008380 x1875455681684736/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788574358 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788574358.108915:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c85ffb1e800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788574358.108937:0:3616:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788574358.108941:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3009500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1875455681684608:0@lo:8:kworker.0 00000100:00080000:2.0:1788574358.108947:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c84c2272000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788574358.108951:0:3616:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788574358.108954:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3008380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1875455681684736:0@lo:8:kworker.0 00000100:00080000:3.0:1788574358.109070:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788574358.109074:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788574358.109077:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788574358.109079:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788574358.109101:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788574358.109104:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788574358.109106:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c85ffb1e800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788574358.109111:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 483 00000100:00080000:3.0:1788574358.109123:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788574358.109129:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9c85ffb1e800 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:3.0:1788574358.109149:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c8601835c00 x1875455681693056/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788574358.109161:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788574358.109164:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788574358.109165:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c84c2272000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788574358.109168:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 483 00000100:00080000:3.0:1788574358.109171:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788574358.109174:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9c84c2272000 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:3.0:1788574358.109182:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c8601836d80 x1875455681693184/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788574358.109242:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c8601835f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681692672:0@lo:400:kworker.0 00000100:00100000:3.0:1788574358.109304:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574358.109351:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c8601834a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3618:1875455681693440:0@lo:400:kworker.0 00000100:00100000:3.0:1788574358.109376:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574358.109395:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788574358.109400:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c8601837480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f73678fb-d8c0-450f-a73b-e6565942045e:3618:1875455681692544:0@lo:400:kworker.0 00000100:00100000:3.0:1788574358.109423:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574358.109444:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c8601837800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875455681693312:0@lo:400:kworker.0 00000100:00100000:3.0:1788574358.109463:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574358.109484:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c8601837100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875455681692800:0@lo:400:kworker.0 00000100:00100000:3.0:1788574358.109503:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574358.109516:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c8601834380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1875455681693568:0@lo:400:kworker.0 00000100:00100000:3.0:1788574358.109543:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574358.109557:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788574358.109562:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c8601834000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681692928:0@lo:400:kworker.0 00000100:00100000:3.0:1788574358.109578:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574358.109603:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c8601835c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1875455681693056:0@lo:8:kworker.0 00000100:00100000:3.0:1788574358.109626:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574358.109639:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c8601836d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1875455681693184:0@lo:8:kworker.0 00000100:00100000:3.0:1788574358.109656:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574358.109688:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681692672 00000100:00100000:3.0:1788574358.109696:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681692672 00000100:00100000:3.0:1788574358.109776:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681692928 00000100:00100000:3.0:1788574358.109779:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681692928 00000100:00100000:3.0:1788574358.109795:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788574358.109803:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601836300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681692672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574358.109850:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601836300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681692672:12345-0@lo:400:kworker.0 Request processed in 48us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574358.109857:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788574358.109874:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788574358.109879:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681692928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574358.109906:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681692928:12345-0@lo:400:kworker.0 Request processed in 27us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574358.109911:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788574358.109932:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681693440 00000100:00100000:3.0:1788574358.109935:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681693440 00000100:00100000:3.0:1788574358.109961:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681693312 00000100:00100000:3.0:1788574358.109964:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681693312 00000100:00100000:3.0:1788574358.109973:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681692800 00000100:00100000:3.0:1788574358.109981:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681692800 00000100:00100000:3.0:1788574358.109994:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681693568 00000100:00100000:3.0:1788574358.109996:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681693568 00000100:00100000:3.0:1788574358.110009:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788574358.110014:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601835180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875455681693440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574358.110059:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601835180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875455681693440:12345-0@lo:400:kworker.0 Request processed in 45us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574358.110064:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788574358.110076:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788574358.110080:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875455681693312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574358.110100:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875455681693312:12345-0@lo:400:kworker.0 Request processed in 21us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574358.110105:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788574358.110114:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788574358.110119:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875455681692800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574358.110140:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875455681692800:12345-0@lo:400:kworker.0 Request processed in 22us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574358.110145:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788574358.110155:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788574358.110160:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875455681693568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574358.110181:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1875455681693568:12345-0@lo:400:kworker.0 Request processed in 21us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574358.110185:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788574358.110222:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681692544 00000100:00100000:3.0:1788574358.110225:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681692544 00000100:00100000:3.0:1788574358.110247:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788574358.110252:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f7fc2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f73678fb-d8c0-450f-a73b-e6565942045e+21:3618:x1875455681692544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574358.110284:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f7fc2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f73678fb-d8c0-450f-a73b-e6565942045e+21:3618:x1875455681692544:12345-0@lo:400:kworker.0 Request processed in 33us (860us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574358.110290:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788574358.110328:0:18571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681693056 00000100:00100000:3.0:1788574358.110331:0:18571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681693056 00000100:00100000:3.0:1788574358.110344:0:18571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681693184 00000100:00100000:3.0:1788574358.110346:0:18571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681693184 00000100:00100000:3.0:1788574358.110353:0:18571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788574358.110358:0:18571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de93bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3616:x1875455681693056:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788574358.110381:0:18571:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 498 last 0 00000020:00000080:3.0:1788574358.110406:0:18571:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5bf8706fdac8d2e7 00002000:00100000:3.0:1788574358.110418:0:18571:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9c84c2212800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a03 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1788574358.110422:0:18571:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:3.0:1788574358.110425:0:18571:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788574358.110608:0:18571:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:3.0:1788574358.110633:0:18571:0:(import.c:65:import_set_state_nolock()) ffff9c84c2214000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788574358.110667:0:18571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de93bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3616:x1875455681693056:12345-0@lo:8:kworker.0 Request processed in 308us (1041us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574358.110674:0:18571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788574358.110687:0:18571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788574358.110690:0:18571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de938000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3616:x1875455681693184:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788574358.110700:0:18571:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:0.0:1788574358.123303:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788574358.123312:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788574358.130590:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c8601834000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681692928:0@lo:400:kworker.0 00010000:00080000:2.0:1788574358.130613:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c8601837100 x1875455681692800/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574358.130624:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c8601837100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875455681692800:0@lo:400:kworker.0 00010000:00080000:2.0:1788574358.130643:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c8601834380 x1875455681693568/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574358.130651:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c8601834380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3619:1875455681693568:0@lo:400:kworker.0 00000100:00100000:2.0:1788574358.130697:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c8601837480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f73678fb-d8c0-450f-a73b-e6565942045e:3618:1875455681692544:0@lo:400:kworker.0 00010000:00080000:2.0:1788574358.130714:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c8601837800 x1875455681693312/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574358.130724:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c8601837800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875455681693312:0@lo:400:kworker.0 00000100:00100000:2.0:1788574358.130736:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c8601835f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681692672:0@lo:400:kworker.0 00010000:00080000:2.0:1788574358.130761:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c8601834a80 x1875455681693440/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574358.130769:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c8601834a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3618:1875455681693440:0@lo:400:kworker.0 00010000:00080000:2.0:1788574358.142400:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c8601835c00 x1875455681693056/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788574378 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574358.142416:0:3616:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788574358.142427:0:3616:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1788574358.142483:0:3616:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788574358.142490:0:3616:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788574358.142494:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c85ffb1e800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788574358.142561:0:3616:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788574358.142568:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c8601835c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1875455681693056:0@lo:8:kworker.0 00000004:00080000:1.0:1788574358.142655:0:17808:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788574358.142752:0:17808:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 498122561169ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788574358.142759:0:17808:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:0.0:1788574358.151521:0:17809:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1788574358.151562:0:17809:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be2300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17809:1875455681693824:0@lo:7:osp-pre-0-1.0 00000100:00100000:0.0:1788574358.151635:0:17809:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574358.151680:0:18573:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788574358.151687:0:18573:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1788574358.151702:0:17809:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c5a41e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788574358.152253:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681693696:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788574358.153561:0:18573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681693824 00000100:00100000:2.0:1788574358.154233:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574358.154448:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681693696 00000100:00100000:1.0:1788574358.154455:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681693696 00000100:00100000:1.0:1788574358.154519:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788574358.154529:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2f45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3620:x1875455681693696:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788574358.154559:0:18575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788574358.154620:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2f45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3620:x1875455681693696:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574358.154627:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788574358.154675:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c84c1be0000 x1875455681693696/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574374 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574358.154695:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681693696:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788574358.155220:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788574358.156229:0:18573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681693824 00000100:00100000:0.0:1788574358.156695:0:19093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788574358.156711:0:19093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17809:x1875455681693824:12345-0@lo:7:osp-pre-0-1.0 00000004:00080000:2.0:1788574358.158871:0:17799:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:0.0:1788574358.168375:0:19093:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1788574358.168388:0:19093:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:0.0:1788574358.168496:0:19093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17809:x1875455681693824:12345-0@lo:7:osp-pre-0-1.0 Request processed in 11783us (16857us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574358.168509:0:19093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788574358.170134:0:17809:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c84c1be2300 x1875455681693824/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788574374 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574358.170154:0:17809:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be2300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17809:1875455681693824:0@lo:7:osp-pre-0-1.0 00000004:00080000:2.0:1788574358.170170:0:17809:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:2.0:1788574358.170235:0:17809:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c2f44380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17809:1875455681693952:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1788574358.170301:0:17809:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574358.170329:0:17809:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c253a900 going to sleep for 11 seconds 00000100:00100000:2.0:1788574358.170356:0:18573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681693952 00000100:00100000:2.0:1788574358.170374:0:18573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681693952 00000100:00100000:2.0:1788574358.170422:0:18573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788574358.170431:0:18573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2f47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17809:x1875455681693952:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1788574358.170458:0:18573:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:2.0:1788574358.170496:0:18573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2f47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17809:x1875455681693952:12345-0@lo:5:osp-pre-0-1.0 Request processed in 65us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574358.170503:0:18573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788574358.170534:0:17809:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c85c2f44380 x1875455681693952/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788574374 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574358.170544:0:17809:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c2f44380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17809:1875455681693952:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1788574358.170553:0:17809:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:2.0:1788574358.170576:0:17809:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c2f44380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17809:1875455681694080:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1788574358.170597:0:17809:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574358.170610:0:17809:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c253a900 going to sleep for 11 seconds 00000100:00100000:0.0:1788574358.171034:0:19093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681694080 00000100:00100000:0.0:1788574358.171049:0:19093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681694080 00000100:00100000:0.0:1788574358.171087:0:19093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788574358.171096:0:19093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2f47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17809:x1875455681694080:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1788574358.171292:0:19093:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:3.0:1788574358.172958:0:18571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de938000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3616:x1875455681693184:12345-0@lo:8:kworker.0 Request processed in 62261us (63295us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788574358.172971:0:18571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1788574358.173293:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c84c2272000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788574358.173299:0:3616:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788574358.173303:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c8601836d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1875455681693184:0@lo:8:kworker.0 00000001:00080000:3.0:1788574358.210771:0:18568:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:3.0:1788574358.210796:0:18568:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1788574358.223033:0:19093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2f47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:17809:x1875455681694080:12345-0@lo:5:osp-pre-0-1.0 Request processed in 51918us (52415us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788574358.223058:0:19093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788574358.233287:0:17809:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c85c2f44380 x1875455681694080/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788574374 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574358.233306:0:17809:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1788574358.233313:0:17809:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c2f44380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17809:1875455681694080:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1788574358.233330:0:17809:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:2.0:1788574358.233389:0:17809:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c2f44380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17809:1875455681694208:0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1788574358.233447:0:17809:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574358.234029:0:17809:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c253a900 going to sleep for 11 seconds 00000100:00100000:1.0:1788574358.237639:0:17078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681694208 00000100:00100000:1.0:1788574358.237654:0:17078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681694208 00000100:00100000:1.0:1788574358.237712:0:17078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788574358.237722:0:17078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2f47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17809:x1875455681694208:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1788574358.238412:0:17078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2f47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17809:x1875455681694208:12345-0@lo:900:osp-pre-0-1.0 Request processed in 689us (4962us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574358.238428:0:17078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788574358.243160:0:17809:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c85c2f44380 x1875455681694208/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788574374 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574358.243444:0:17809:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c2f44380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17809:1875455681694208:0@lo:900:osp-pre-0-1.0 00010000:00010000:2.0:1788574358.996581:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574359.704180:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85de938a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681694336:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788574359.704280:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574359.704334:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788574359.704341:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681694464:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788574359.704364:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681694336 00000100:00100000:2.0:1788574359.704364:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574359.704371:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681694336 00000100:00100000:3.0:1788574359.704416:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681694464 00000100:00100000:3.0:1788574359.704419:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681694464 00000100:00100000:2.0:1788574359.704422:0:17072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788574359.704432:0:17072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2f44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681694336:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788574359.704433:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788574359.704438:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2f46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681694464:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788574359.704466:0:17073:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000004:00000024:2.0:1788574359.704466:0:17072:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788574359.705032:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2f46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681694464:12345-0@lo:41:osp-pre-0-1.0 Request processed in 592us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574359.705048:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788574359.709710:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681694464:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788574359.713002:0:17072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2f44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681694336:12345-0@lo:41:osp-pre-1-0.0 Request processed in 8551us (8702us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574359.713018:0:17072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788574359.713277:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85de938a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681694336:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788574360.021035:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574361.044520:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574362.093701:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788574362.517385:0:17104:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788574363.091386:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788574363.283640:0:470:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788574363.283647:0:470:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788574363.283649:0:470:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788574363.283652:0:470:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788574363.283685:0:470:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788574363.283689:0:470:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788574363.283699:0:470:0:(import.c:65:import_set_state_nolock()) ffff9c84c2272000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788574363.283707:0:470:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 498 00000100:00080000:0.0:1788574363.283713:0:470:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788574363.283720:0:470:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9c84c2272000 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:0.0:1788574363.283743:0:470:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c84c1be3b80 x1875455681695232/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788574363.283798:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f73678fb-d8c0-450f-a73b-e6565942045e:3619:1875455681694592:0@lo:400:kworker.0 00000100:00100000:0.0:1788574363.283869:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574363.283933:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681695104:0@lo:400:kworker.0 00000100:00100000:0.0:1788574363.283963:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574363.283990:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788574363.283996:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681694720:0@lo:400:kworker.0 00000100:00100000:0.0:1788574363.284020:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574363.284038:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875455681695360:0@lo:400:kworker.0 00000100:00100000:0.0:1788574363.284063:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574363.284092:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875455681694848:0@lo:400:kworker.0 00000100:00100000:0.0:1788574363.284113:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574363.284129:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1875455681695488:0@lo:400:kworker.0 00000100:00100000:0.0:1788574363.284606:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574363.284628:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788574363.284636:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681694976:0@lo:400:kworker.0 00000100:00100000:0.0:1788574363.284658:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574363.284676:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1875455681695616:0@lo:400:kworker.0 00000100:00100000:0.0:1788574363.284714:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574363.284757:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1875455681695232:0@lo:8:kworker.0 00000100:00100000:0.0:1788574363.284779:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574363.284811:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681694592 00000100:00100000:0.0:1788574363.284818:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681694592 00000100:00100000:0.0:1788574363.284858:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788574363.284867:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f7fc3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f73678fb-d8c0-450f-a73b-e6565942045e+21:3619:x1875455681694592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574363.284911:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f7fc3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f73678fb-d8c0-450f-a73b-e6565942045e+21:3619:x1875455681694592:12345-0@lo:400:kworker.0 Request processed in 44us (1042us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574363.284919:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788574363.286091:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681695104 00000100:00100000:0.0:1788574363.286098:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681695104 00000100:00100000:0.0:1788574363.286625:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681695232 00000100:00100000:0.0:1788574363.286632:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681695232 00000100:00100000:0.0:1788574363.286657:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788574363.286665:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681695104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574363.286726:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681695104:12345-0@lo:400:kworker.0 Request processed in 63us (2762us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574363.286733:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788574363.286744:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788574363.286748:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2bdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3616:x1875455681695232:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788574363.286769:0:18574:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788574363.289045:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681695360 00000100:00100000:3.0:1788574363.289057:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681695360 00000100:00100000:3.0:1788574363.289094:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681694848 00000100:00100000:3.0:1788574363.289098:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681694848 00000100:00100000:3.0:1788574363.289109:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681695488 00000100:00100000:3.0:1788574363.289112:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681695488 00000100:00100000:3.0:1788574363.289128:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681695616 00000100:00100000:3.0:1788574363.289130:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681695616 00000100:00100000:3.0:1788574363.289148:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788574363.289156:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2bdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875455681695360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574363.289258:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2bdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875455681695360:12345-0@lo:400:kworker.0 Request processed in 103us (5194us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574363.289266:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788574363.289284:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788574363.289290:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2bdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875455681694848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574363.289324:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2bdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875455681694848:12345-0@lo:400:kworker.0 Request processed in 35us (5210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574363.289330:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788574363.289351:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788574363.289357:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2bdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875455681695488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574363.289385:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2bdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875455681695488:12345-0@lo:400:kworker.0 Request processed in 29us (4780us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574363.289390:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788574363.289400:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788574363.289406:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2bdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875455681695616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574363.289433:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2bdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875455681695616:12345-0@lo:400:kworker.0 Request processed in 28us (4718us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574363.289439:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788574363.289459:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681694720 00000100:00100000:3.0:1788574363.289463:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681694720 00000100:00100000:3.0:1788574363.289507:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681694976 00000100:00100000:3.0:1788574363.289511:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681694976 00000100:00100000:3.0:1788574363.289526:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788574363.289532:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681694720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574363.289567:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681694720:12345-0@lo:400:kworker.0 Request processed in 35us (5546us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574363.289572:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788574363.289583:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788574363.289588:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2bdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681694976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574363.289613:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2bdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681694976:12345-0@lo:400:kworker.0 Request processed in 25us (4954us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574363.289618:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788574363.289771:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681694976:0@lo:400:kworker.0 00010000:00080000:3.0:1788574363.289786:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c84c1be2300 x1875455681695616/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574363.289804:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1875455681695616:0@lo:400:kworker.0 00010000:00080000:3.0:1788574363.289818:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c84c1be3800 x1875455681694848/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574363.289827:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875455681694848:0@lo:400:kworker.0 00010000:00080000:3.0:1788574363.289837:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c84c1be0a80 x1875455681695488/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574363.289847:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1875455681695488:0@lo:400:kworker.0 00000100:00080000:3.0:1788574363.289909:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788574363.289914:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788574363.289916:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788574363.295491:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788574363.296010:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c2f44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681695744:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788574363.296091:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574363.296693:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681695744 00000100:00100000:3.0:1788574363.296703:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681695744 00000100:00100000:3.0:1788574363.296757:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788574363.296766:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c335f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681695744:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788574363.296797:0:18575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788574363.296850:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c335f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681695744:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (760us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574363.296857:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788574363.296902:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c85c2f44700 x1875455681695744/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574379 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574363.296937:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c2f44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681695744:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788574363.300800:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681694720:0@lo:400:kworker.0 00010000:00080000:1.0:1788574363.300829:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c84c1be0380 x1875455681695360/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574363.300840:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875455681695360:0@lo:400:kworker.0 00000100:00100000:1.0:1788574363.300853:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f73678fb-d8c0-450f-a73b-e6565942045e:3619:1875455681694592:0@lo:400:kworker.0 00010000:00080000:1.0:1788574363.300865:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c84c1be1180 x1875455681695104/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574363.300873:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681695104:0@lo:400:kworker.0 00000100:00100000:0.0:1788574363.321496:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2bdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3616:x1875455681695232:12345-0@lo:8:kworker.0 Request processed in 34738us (36708us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788574363.323046:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1788574363.324066:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c84c2272000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788574363.324075:0:3616:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788574363.324079:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1875455681695232:0@lo:8:kworker.0 00010000:00010000:3.0:1788574364.120722:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574364.820029:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85de93aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681695872:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788574364.820113:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574364.820176:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681695872 00000100:00100000:3.0:1788574364.820183:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681695872 00000100:00100000:3.0:1788574364.822071:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788574364.822086:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de93b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681695872:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788574364.822125:0:17073:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788574364.822209:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de93b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681695872:12345-0@lo:41:osp-pre-1-0.0 Request processed in 128us (2097us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574364.822764:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788574364.822784:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681696000:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788574364.822831:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574364.823960:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788574364.824166:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85de93aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681695872:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788574364.824954:0:17072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681696000 00000100:00100000:0.0:1788574364.824964:0:17072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681696000 00000100:00100000:0.0:1788574364.825011:0:17072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788574364.825019:0:17072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2bdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681696000:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788574364.825051:0:17072:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788574364.825118:0:17072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2bdf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681696000:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (2286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574364.825125:0:17072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788574364.825162:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681696000:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788574365.144424:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788574365.308377:0:19385:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788574365.308381:0:19385:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:3.0:1788574365.308383:0:19385:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1788574365.313354:0:19385:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9c84c2216000 00000020:01000004:2.0:1788574365.313502:0:19385:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788574365.313521:0:19385:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788574365.313536:0:19385:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9c84c3038000) 00000020:00000080:2.0:1788574365.313554:0:19385:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00000100:00100000:3.0:1788574365.331354:0:3616:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788574345/real 1788574345] req@ffff9c84c3c0ad80 x1875455681686272/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788574365 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574365.331393:0:3616:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c84c3c0ad80 x1875455681686272/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788574365 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574365.331404:0:3616:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788574345/real 1788574345] req@ffff9c84c3c0b100 x1875455681686400/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788574365 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574365.331415:0:3616:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c84c3c0b100 x1875455681686400/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788574365 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788574365.331443:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c85c4edd000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788574365.331464:0:3616:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788574365.331469:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875455681686272:0@lo:8:kworker.0 00000100:00080000:3.0:1788574365.331475:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c84c369e000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788574365.331489:0:3616:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788574365.331492:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875455681686400:0@lo:8:kworker.0 00000100:00080000:1.0:1788574365.331664:0:470:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788574365.331669:0:470:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788574365.331671:0:470:0:(import.c:65:import_set_state_nolock()) ffff9c85c4edd000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788574365.331676:0:470:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 485 00000100:00080000:1.0:1788574365.331687:0:470:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788574365.331693:0:470:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9c85c4edd000 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:1.0:1788574365.331713:0:470:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c84c335fb80 x1875455681696384/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788574365.331724:0:470:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788574365.331727:0:470:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788574365.331729:0:470:0:(import.c:65:import_set_state_nolock()) ffff9c84c369e000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788574365.331732:0:470:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 485 00000100:00080000:1.0:1788574365.331734:0:470:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788574365.331738:0:470:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c84c369e000 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:1.0:1788574365.331749:0:470:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c84c335c700 x1875455681696512/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788574365.331773:0:470:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788574365.331776:0:470:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788574365.331778:0:470:0:(import.c:65:import_set_state_nolock()) ffff9c84c2272000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788574365.331781:0:470:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 503 00000100:00080000:1.0:1788574365.331783:0:470:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788574365.331787:0:470:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9c84c2272000 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:1.0:1788574365.331796:0:470:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c84c335ea00 x1875455681697024/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788574365.331895:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681696768:0@lo:400:kworker.0 00000100:00100000:3.0:1788574365.331959:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574365.331997:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1875455681697408:0@lo:400:kworker.0 00000100:00100000:3.0:1788574365.332020:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574365.332040:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788574365.332046:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f73678fb-d8c0-450f-a73b-e6565942045e:3617:1875455681696128:0@lo:400:kworker.0 00000100:00100000:3.0:1788574365.332070:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574365.332097:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681696896:0@lo:400:kworker.0 00000100:00100000:3.0:1788574365.332115:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574365.332137:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681696256:0@lo:400:kworker.0 00000100:00100000:3.0:1788574365.332156:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574365.332172:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875455681697152:0@lo:400:kworker.0 00000100:00100000:3.0:1788574365.332210:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574365.332503:0:17807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681696768 00000100:00100000:1.0:1788574365.332511:0:17807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681696768 00000100:00100000:1.0:1788574365.332555:0:17807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681696256 00000100:00100000:1.0:1788574365.332559:0:17807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681696256 00000100:00100000:1.0:1788574365.332575:0:17807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788574365.332584:0:17807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de93aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681696768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574365.332652:0:17807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de93aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681696768:12345-0@lo:400:kworker.0 Request processed in 69us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574365.332660:0:17807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788574365.332676:0:17807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788574365.332682:0:17807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de939880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681696256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574365.332706:0:17807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de939880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681696256:12345-0@lo:400:kworker.0 Request processed in 25us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574365.332711:0:17807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788574365.332796:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681696256:0@lo:400:kworker.0 00000100:00100000:3.0:1788574365.332806:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788574365.332811:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875455681696640:0@lo:400:kworker.0 00000100:00100000:3.0:1788574365.332832:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574365.332854:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3619:1875455681697280:0@lo:400:kworker.0 00000100:00100000:3.0:1788574365.332873:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574365.332916:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681697408 00000100:00100000:3.0:1788574365.332920:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681697408 00000100:00100000:3.0:1788574365.332948:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681697152 00000100:00100000:3.0:1788574365.332955:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681697152 00000100:00100000:3.0:1788574365.332968:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681696640 00000100:00100000:3.0:1788574365.332970:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681696640 00000100:00100000:3.0:1788574365.332978:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681697280 00000100:00100000:3.0:1788574365.332980:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681697280 00000100:00100000:3.0:1788574365.332991:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788574365.332996:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de93ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875455681697408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574365.333025:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de93ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875455681697408:12345-0@lo:400:kworker.0 Request processed in 29us (1004us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574365.333031:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788574365.333041:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788574365.333046:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de93b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875455681697152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574365.333072:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de93b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875455681697152:12345-0@lo:400:kworker.0 Request processed in 26us (862us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574365.333077:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788574365.333087:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788574365.333092:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de938700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875455681696640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574365.333113:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de938700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875455681696640:12345-0@lo:400:kworker.0 Request processed in 22us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574365.333118:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788574365.333126:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788574365.333131:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de939180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875455681697280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574365.333151:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de939180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875455681697280:12345-0@lo:400:kworker.0 Request processed in 21us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574365.333156:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788574365.333171:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681696128 00000100:00100000:3.0:1788574365.333174:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681696128 00000100:00100000:3.0:1788574365.334661:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788574365.334679:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1b9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f73678fb-d8c0-450f-a73b-e6565942045e+21:3617:x1875455681696128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574365.334745:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1b9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f73678fb-d8c0-450f-a73b-e6565942045e+21:3617:x1875455681696128:12345-0@lo:400:kworker.0 Request processed in 73us (2672us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574365.334751:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788574365.340802:0:18573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681696896 00000100:00100000:1.0:1788574365.340818:0:18573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681696896 00000100:00100000:1.0:1788574365.340903:0:18573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788574365.340914:0:18573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de939c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681696896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574365.341007:0:18573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de939c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681696896:12345-0@lo:400:kworker.0 Request processed in 96us (8890us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574365.341014:0:18573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788574365.341051:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875455681696384:0@lo:8:kworker.0 00000100:00100000:1.0:1788574365.341094:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574365.341134:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875455681696512:0@lo:8:kworker.0 00000100:00100000:1.0:1788574365.341171:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574365.341211:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1875455681697024:0@lo:8:kworker.0 00000100:00100000:1.0:1788574365.341244:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574365.341276:0:18571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681696384 00000100:00100000:1.0:1788574365.341280:0:18571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681696384 00000100:00100000:1.0:1788574365.341295:0:18571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681696512 00000100:00100000:1.0:1788574365.341298:0:18571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681696512 00000100:00100000:1.0:1788574365.341306:0:18571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681697024 00000100:00100000:1.0:1788574365.341314:0:18571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681697024 00000100:00100000:1.0:1788574365.341327:0:18571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788574365.341331:0:18571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c335c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3616:x1875455681696384:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788574365.341357:0:18571:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 505 last 0 00000020:00000080:1.0:1788574365.341504:0:18571:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5bf8706fdac8d2f5 00002000:00100000:1.0:1788574365.341518:0:18571:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9c85c6e79000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a03 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788574365.341522:0:18571:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1788574365.341525:0:18571:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788574365.341602:0:18571:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788574365.341625:0:18571:0:(import.c:65:import_set_state_nolock()) ffff9c85c6e78000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788574365.341665:0:18571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c335c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3616:x1875455681696384:12345-0@lo:8:kworker.0 Request processed in 332us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574365.341671:0:18571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788574365.341684:0:18571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788574365.341688:0:18571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c335e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3616:x1875455681696512:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788574365.341699:0:18571:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788574365.341720:0:18571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c335e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3616:x1875455681696512:12345-0@lo:8:kworker.0 Request processed in 31us (549us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788574365.341726:0:18571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788574365.341735:0:18571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788574365.341739:0:18571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c335ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3616:x1875455681697024:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788574365.341747:0:18571:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788574365.341764:0:18571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c335ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3616:x1875455681697024:12345-0@lo:8:kworker.0 Request processed in 24us (520us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788574365.341769:0:18571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788574365.341818:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f73678fb-d8c0-450f-a73b-e6565942045e:3617:1875455681696128:0@lo:400:kworker.0 00010000:00080000:1.0:1788574365.341833:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c84c335d500 x1875455681696896/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788574381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574365.341845:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681696896:0@lo:400:kworker.0 00000100:00100000:1.0:1788574365.341855:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681696768:0@lo:400:kworker.0 00010000:00080000:1.0:1788574365.341865:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c84c335c000 x1875455681697408/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574365.341872:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1875455681697408:0@lo:400:kworker.0 00010000:00080000:1.0:1788574365.341918:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c84c335fb80 x1875455681696384/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788574390 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574365.341925:0:3616:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788574365.341932:0:3616:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788574365.341940:0:3616:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788574365.341945:0:3616:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788574365.341948:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c85c4edd000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788574365.341961:0:3616:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788574365.341965:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875455681696384:0@lo:8:kworker.0 00000100:00080000:1.0:1788574365.341974:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c84c369e000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788574365.341978:0:3616:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788574365.341981:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875455681696512:0@lo:8:kworker.0 00000100:00080000:1.0:1788574365.341988:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c84c2272000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788574365.341991:0:3616:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788574365.341994:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1875455681697024:0@lo:8:kworker.0 00000004:00080000:1.0:1788574365.342051:0:17092:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:1.0:1788574365.342069:0:17092:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17092:1875455681697664:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788574365.342093:0:17092:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574365.342109:0:17092:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c82c7e40 going to sleep for 11 seconds 00000004:00080000:1.0:1788574365.342126:0:17091:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788574365.342451:0:17091:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 505322021828ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788574365.342462:0:17091:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1788574365.342490:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681697536:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788574365.342519:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574365.342718:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681697536 00000100:00100000:1.0:1788574365.342724:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681697536 00000100:00100000:1.0:1788574365.342764:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788574365.342773:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c335c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3618:x1875455681697536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788574365.342795:0:18575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788574365.342833:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c335c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3618:x1875455681697536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574365.342840:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788574365.342872:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c84c335ea00 x1875455681697536/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574381 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574365.342898:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681697536:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788574365.342920:0:18571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681697664 00000100:00100000:1.0:1788574365.342923:0:18571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681697664 00000100:00100000:1.0:1788574365.342944:0:18571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788574365.342951:0:18571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c335fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17092:x1875455681697664:12345-0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788574365.347527:0:17047:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00080000:3.0:1788574365.349119:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788574365.349128:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788574365.349132:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788574365.349210:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c84c335d180 x1875455681696640/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574365.349239:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875455681696640:0@lo:400:kworker.0 00010000:00080000:3.0:1788574365.349255:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c84c335f800 x1875455681697280/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574365.349266:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3619:1875455681697280:0@lo:400:kworker.0 00010000:00080000:3.0:1788574365.349279:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c84c335d880 x1875455681697152/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574365.349289:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875455681697152:0@lo:400:kworker.0 00002000:00080000:1.0:1788574365.377316:0:18571:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1788574365.377331:0:18571:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:1.0:1788574365.377359:0:18571:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:33) 00002000:00010000:1.0:1788574365.397123:0:18571:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788574365.397135:0:18571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000dce4c9a/0x5bf8706fdac8d2fc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574365.397320:0:18571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=505s v=(0 0) 00010000:00010000:1.0:1788574365.397325:0:18571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574365.397333:0:18571:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000dce4c9a/0x5bf8706fdac8d2fc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574365.397352:0:18571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000dce4c9a/0x5bf8706fdac8d2fc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574365.397363:0:18571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000dce4c9a/0x5bf8706fdac8d2fc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574365.397386:0:18571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000dce4c9a/0x5bf8706fdac8d2fc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574365.397407:0:18571:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788574365.397801:0:17056:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788574365.397808:0:17056:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000dce4c9a/0x5bf8706fdac8d2fc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.397816:0:17056:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d08a2800 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:3.0:1788574365.397822:0:17056:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000dce4c9a/0x5bf8706fdac8d2fc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.397843:0:17056:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000dce4c9a/0x5bf8706fdac8d2fc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.397861:0:17056:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000dce4c9a/0x5bf8706fdac8d2fc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.397869:0:17056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000dce4c9a/0x5bf8706fdac8d2fc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.397901:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574365.397903:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574365.397905:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788574365.399247:0:18571:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788574365.399264:0:18571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088381fcf/0x5bf8706fdac8d303 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574365.399279:0:18571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=505s v=(0 0) 00010000:00010000:2.0:1788574365.399284:0:18571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574365.399290:0:18571:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088381fcf/0x5bf8706fdac8d303 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574365.399305:0:18571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088381fcf/0x5bf8706fdac8d303 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574365.399315:0:18571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088381fcf/0x5bf8706fdac8d303 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574365.399323:0:18571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088381fcf/0x5bf8706fdac8d303 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574365.399337:0:18571:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788574365.399944:0:17055:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788574365.399952:0:17055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088381fcf/0x5bf8706fdac8d303 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.399961:0:17055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32fc00 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:3.0:1788574365.399966:0:17055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088381fcf/0x5bf8706fdac8d303 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.399975:0:17055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088381fcf/0x5bf8706fdac8d303 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.399990:0:17055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088381fcf/0x5bf8706fdac8d303 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.400011:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088381fcf/0x5bf8706fdac8d303 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.400032:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574365.400034:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574365.400036:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788574365.400139:0:18571:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788574365.400146:0:18571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d6b9d7f/0x5bf8706fdac8d30a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574365.400154:0:18571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=505s v=(0 0) 00010000:00010000:2.0:1788574365.400157:0:18571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574365.400162:0:18571:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d6b9d7f/0x5bf8706fdac8d30a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574365.400171:0:18571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006d6b9d7f/0x5bf8706fdac8d30a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574365.400186:0:18571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d6b9d7f/0x5bf8706fdac8d30a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574365.400225:0:18571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006d6b9d7f/0x5bf8706fdac8d30a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574365.400239:0:18571:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788574365.400658:0:18571:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788574365.400664:0:18571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1cb0df0/0x5bf8706fdac8d311 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574365.400674:0:18571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=505s v=(0 0) 00010000:00010000:2.0:1788574365.400677:0:18571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574365.400681:0:18571:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1cb0df0/0x5bf8706fdac8d311 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574365.400690:0:18571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c1cb0df0/0x5bf8706fdac8d311 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574365.400697:0:18571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1cb0df0/0x5bf8706fdac8d311 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574365.400704:0:18571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c1cb0df0/0x5bf8706fdac8d311 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574365.400728:0:18571:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788574365.401169:0:17055:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788574365.401176:0:17055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006d6b9d7f/0x5bf8706fdac8d30a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.401184:0:17055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32ea00 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:3.0:1788574365.401201:0:17055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006d6b9d7f/0x5bf8706fdac8d30a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.401219:0:17055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006d6b9d7f/0x5bf8706fdac8d30a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.401233:0:17055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006d6b9d7f/0x5bf8706fdac8d30a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.401240:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d6b9d7f/0x5bf8706fdac8d30a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.401256:0:17055:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788574365.401259:0:17055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c1cb0df0/0x5bf8706fdac8d311 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.401285:0:17055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32fe00 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:3.0:1788574365.401288:0:17055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1cb0df0/0x5bf8706fdac8d311 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.401295:0:17055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1cb0df0/0x5bf8706fdac8d311 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.401305:0:17055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c1cb0df0/0x5bf8706fdac8d311 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.401311:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c1cb0df0/0x5bf8706fdac8d311 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.401324:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574365.401326:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574365.401327:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574365.401334:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788574365.401877:0:18571:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788574365.401895:0:18571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094e7cef2/0x5bf8706fdac8d318 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574365.401907:0:18571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=505s v=(0 0) 00010000:00010000:2.0:1788574365.401911:0:18571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574365.401917:0:18571:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094e7cef2/0x5bf8706fdac8d318 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574365.401927:0:18571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094e7cef2/0x5bf8706fdac8d318 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574365.401936:0:18571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094e7cef2/0x5bf8706fdac8d318 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574365.401944:0:18571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000094e7cef2/0x5bf8706fdac8d318 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574365.401968:0:18571:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788574365.403903:0:17055:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788574365.403919:0:17055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000094e7cef2/0x5bf8706fdac8d318 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.403935:0:17055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32e200 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:3.0:1788574365.403940:0:17055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000094e7cef2/0x5bf8706fdac8d318 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.403977:0:17055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000094e7cef2/0x5bf8706fdac8d318 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.404000:0:17055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000094e7cef2/0x5bf8706fdac8d318 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.404008:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094e7cef2/0x5bf8706fdac8d318 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.404038:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574365.404040:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574365.404042:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788574365.407336:0:18571:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788574365.407349:0:18571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042acfec9/0x5bf8706fdac8d31f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574365.407381:0:18571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=505s v=(0 0) 00010000:00010000:1.0:1788574365.407386:0:18571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574365.407393:0:18571:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042acfec9/0x5bf8706fdac8d31f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574365.407417:0:18571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042acfec9/0x5bf8706fdac8d31f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574365.407427:0:18571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042acfec9/0x5bf8706fdac8d31f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574365.407748:0:18571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042acfec9/0x5bf8706fdac8d31f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574365.407772:0:18571:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788574365.408172:0:17056:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788574365.408179:0:17056:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042acfec9/0x5bf8706fdac8d31f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.408218:0:17056:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d08a2400 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:3.0:1788574365.408224:0:17056:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042acfec9/0x5bf8706fdac8d31f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.408234:0:17056:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042acfec9/0x5bf8706fdac8d31f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.408254:0:17056:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042acfec9/0x5bf8706fdac8d31f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.408273:0:17056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042acfec9/0x5bf8706fdac8d31f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.408297:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574365.408299:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574365.408301:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788574365.413784:0:18571:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788574365.413796:0:18571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f082877/0x5bf8706fdac8d326 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574365.413813:0:18571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=505s v=(0 0) 00010000:00010000:0.0:1788574365.413817:0:18571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788574365.413824:0:18571:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f082877/0x5bf8706fdac8d326 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574365.413839:0:18571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009f082877/0x5bf8706fdac8d326 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574365.413850:0:18571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f082877/0x5bf8706fdac8d326 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574365.413858:0:18571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009f082877/0x5bf8706fdac8d326 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574365.413936:0:18571:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788574365.414492:0:18571:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788574365.414500:0:18571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082c72457/0x5bf8706fdac8d32d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574365.414511:0:18571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=505s v=(0 0) 00010000:00010000:0.0:1788574365.414514:0:18571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788574365.414519:0:18571:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082c72457/0x5bf8706fdac8d32d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574365.414527:0:18571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082c72457/0x5bf8706fdac8d32d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574365.414536:0:18571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082c72457/0x5bf8706fdac8d32d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574365.414543:0:18571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000082c72457/0x5bf8706fdac8d32d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.423182:0:17055:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788574365.423215:0:17055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009f082877/0x5bf8706fdac8d326 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.423231:0:17055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d7600 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:3.0:1788574365.423236:0:17055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009f082877/0x5bf8706fdac8d326 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.423248:0:17055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009f082877/0x5bf8706fdac8d326 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.423270:0:17055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009f082877/0x5bf8706fdac8d326 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.423279:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009f082877/0x5bf8706fdac8d326 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574365.423698:0:17055:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788574365.423704:0:17055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000082c72457/0x5bf8706fdac8d32d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574365.423712:0:17055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d6200 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:2.0:1788574365.423727:0:17055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000082c72457/0x5bf8706fdac8d32d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574365.423735:0:17055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000082c72457/0x5bf8706fdac8d32d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574365.423747:0:17055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000082c72457/0x5bf8706fdac8d32d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574365.423756:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574365.423757:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574365.423759:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574365.424722:0:18571:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788574365.424732:0:18571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082c72457/0x5bf8706fdac8d32d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.425040:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788574365.426999:0:18571:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788574365.427010:0:18571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a7ccca15/0x5bf8706fdac8d334 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574365.427034:0:18571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=505s v=(0 0) 00010000:00010000:0.0:1788574365.427038:0:18571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788574365.427045:0:18571:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a7ccca15/0x5bf8706fdac8d334 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574365.427059:0:18571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a7ccca15/0x5bf8706fdac8d334 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574365.427070:0:18571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a7ccca15/0x5bf8706fdac8d334 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574365.427077:0:18571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a7ccca15/0x5bf8706fdac8d334 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574365.427100:0:18571:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788574365.427303:0:17055:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788574365.427311:0:17055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a7ccca15/0x5bf8706fdac8d334 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.427327:0:17055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d7000 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:3.0:1788574365.427332:0:17055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a7ccca15/0x5bf8706fdac8d334 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.427342:0:17055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a7ccca15/0x5bf8706fdac8d334 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.427358:0:17055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a7ccca15/0x5bf8706fdac8d334 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.427366:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a7ccca15/0x5bf8706fdac8d334 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.427404:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574365.427406:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574365.427408:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788574365.429739:0:18571:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788574365.429750:0:18571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e6bf012/0x5bf8706fdac8d33b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574365.429765:0:18571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=505s v=(0 0) 00010000:00010000:0.0:1788574365.429770:0:18571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788574365.429776:0:18571:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e6bf012/0x5bf8706fdac8d33b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574365.429789:0:18571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e6bf012/0x5bf8706fdac8d33b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574365.429810:0:18571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e6bf012/0x5bf8706fdac8d33b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574365.429818:0:18571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002e6bf012/0x5bf8706fdac8d33b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574365.429844:0:18571:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788574365.430251:0:17056:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788574365.430258:0:17056:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002e6bf012/0x5bf8706fdac8d33b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.430266:0:17056:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d6c00 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:3.0:1788574365.430270:0:17056:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002e6bf012/0x5bf8706fdac8d33b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.430278:0:17056:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002e6bf012/0x5bf8706fdac8d33b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.430302:0:17056:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002e6bf012/0x5bf8706fdac8d33b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.430310:0:17056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e6bf012/0x5bf8706fdac8d33b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.430329:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574365.430332:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574365.430334:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788574365.430555:0:18571:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788574365.430561:0:18571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000739b0a1/0x5bf8706fdac8d342 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574365.430570:0:18571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=505s v=(0 0) 00010000:00010000:0.0:1788574365.430574:0:18571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788574365.430578:0:18571:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000739b0a1/0x5bf8706fdac8d342 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574365.430586:0:18571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000739b0a1/0x5bf8706fdac8d342 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574365.430593:0:18571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000739b0a1/0x5bf8706fdac8d342 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574365.430600:0:18571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000739b0a1/0x5bf8706fdac8d342 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574365.430631:0:18571:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788574365.430896:0:17055:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788574365.430901:0:17055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000739b0a1/0x5bf8706fdac8d342 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.430908:0:17055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d7a00 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:3.0:1788574365.430912:0:17055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000739b0a1/0x5bf8706fdac8d342 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.430919:0:17055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000739b0a1/0x5bf8706fdac8d342 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.430929:0:17055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000739b0a1/0x5bf8706fdac8d342 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.430936:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000739b0a1/0x5bf8706fdac8d342 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.430961:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574365.430962:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574365.430964:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788574365.434250:0:18571:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788574365.434264:0:18571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000723000b3/0x5bf8706fdac8d349 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574365.434282:0:18571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=505s v=(0 0) 00010000:00010000:0.0:1788574365.434286:0:18571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788574365.434293:0:18571:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000723000b3/0x5bf8706fdac8d349 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574365.434308:0:18571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000723000b3/0x5bf8706fdac8d349 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574365.434318:0:18571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000723000b3/0x5bf8706fdac8d349 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574365.434325:0:18571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000723000b3/0x5bf8706fdac8d349 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574365.434343:0:18571:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788574365.434925:0:17056:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788574365.434934:0:17056:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000723000b3/0x5bf8706fdac8d349 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.434943:0:17056:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d6600 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:3.0:1788574365.434948:0:17056:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000723000b3/0x5bf8706fdac8d349 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.434958:0:17056:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000723000b3/0x5bf8706fdac8d349 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.434977:0:17056:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000723000b3/0x5bf8706fdac8d349 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.434984:0:17056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000723000b3/0x5bf8706fdac8d349 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.435002:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574365.435004:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574365.435006:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788574365.435091:0:18571:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788574365.435097:0:18571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000110847a6/0x5bf8706fdac8d350 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574365.435106:0:18571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=505s v=(0 0) 00010000:00010000:0.0:1788574365.435116:0:18571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788574365.435121:0:18571:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000110847a6/0x5bf8706fdac8d350 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574365.435130:0:18571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000110847a6/0x5bf8706fdac8d350 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574365.435138:0:18571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000110847a6/0x5bf8706fdac8d350 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574365.435146:0:18571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000110847a6/0x5bf8706fdac8d350 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574365.435165:0:18571:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788574365.435663:0:17055:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788574365.435669:0:17055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000110847a6/0x5bf8706fdac8d350 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.435690:0:17055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85c152f000 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:3.0:1788574365.435694:0:17055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000110847a6/0x5bf8706fdac8d350 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.435703:0:17055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000110847a6/0x5bf8706fdac8d350 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.435715:0:17055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000110847a6/0x5bf8706fdac8d350 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.435722:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000110847a6/0x5bf8706fdac8d350 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.435738:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574365.435740:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574365.435742:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788574365.438599:0:18571:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788574365.438612:0:18571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cbc2156/0x5bf8706fdac8d357 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574365.438630:0:18571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=505s v=(0 0) 00010000:00010000:0.0:1788574365.438634:0:18571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788574365.438640:0:18571:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002cbc2156/0x5bf8706fdac8d357 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574365.438654:0:18571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002cbc2156/0x5bf8706fdac8d357 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574365.438663:0:18571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002cbc2156/0x5bf8706fdac8d357 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574365.438684:0:18571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002cbc2156/0x5bf8706fdac8d357 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574365.438708:0:18571:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788574365.439608:0:18571:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788574365.439616:0:18571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008bb15287/0x5bf8706fdac8d35e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574365.439627:0:18571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=505s v=(0 0) 00010000:00010000:0.0:1788574365.439630:0:18571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788574365.439635:0:18571:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008bb15287/0x5bf8706fdac8d35e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574365.439645:0:18571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008bb15287/0x5bf8706fdac8d35e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574365.439653:0:18571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008bb15287/0x5bf8706fdac8d35e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574365.439661:0:18571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008bb15287/0x5bf8706fdac8d35e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574365.439765:0:18571:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788574365.440458:0:18571:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788574365.440466:0:18571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ef70332/0x5bf8706fdac8d365 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574365.440484:0:18571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=505s v=(0 0) 00010000:00010000:0.0:1788574365.440487:0:18571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788574365.440492:0:18571:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ef70332/0x5bf8706fdac8d365 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574365.440502:0:18571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006ef70332/0x5bf8706fdac8d365 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574365.440510:0:18571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ef70332/0x5bf8706fdac8d365 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574365.440517:0:18571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006ef70332/0x5bf8706fdac8d365 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574365.444002:0:17055:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788574365.444016:0:17055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002cbc2156/0x5bf8706fdac8d357 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574365.444029:0:17055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85c152fe00 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:1.0:1788574365.444035:0:17055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002cbc2156/0x5bf8706fdac8d357 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574365.444046:0:17055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002cbc2156/0x5bf8706fdac8d357 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574365.444067:0:17055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002cbc2156/0x5bf8706fdac8d357 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574365.444074:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002cbc2156/0x5bf8706fdac8d357 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574365.444123:0:17055:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788574365.444126:0:17055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008bb15287/0x5bf8706fdac8d35e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574365.444132:0:17055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85c152fc00 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:1.0:1788574365.444136:0:17055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008bb15287/0x5bf8706fdac8d35e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574365.444153:0:17055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008bb15287/0x5bf8706fdac8d35e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574365.444164:0:17055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008bb15287/0x5bf8706fdac8d35e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574365.444171:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008bb15287/0x5bf8706fdac8d35e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574365.444184:0:17055:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788574365.444202:0:17055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006ef70332/0x5bf8706fdac8d365 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574365.444220:0:17055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85c152ea00 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:1.0:1788574365.444223:0:17055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006ef70332/0x5bf8706fdac8d365 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574365.444244:0:17055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006ef70332/0x5bf8706fdac8d365 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574365.444254:0:17055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006ef70332/0x5bf8706fdac8d365 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574365.444264:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574365.444266:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574365.444268:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574365.456355:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574365.457174:0:18571:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788574365.457185:0:18571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006ef70332/0x5bf8706fdac8d365 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574365.457402:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788574365.459920:0:18571:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788574365.459933:0:18571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6d2d339/0x5bf8706fdac8d36c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574365.459951:0:18571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=505s v=(0 0) 00010000:00010000:2.0:1788574365.459956:0:18571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574365.459963:0:18571:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6d2d339/0x5bf8706fdac8d36c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574365.459978:0:18571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6d2d339/0x5bf8706fdac8d36c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574365.459989:0:18571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6d2d339/0x5bf8706fdac8d36c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574365.459997:0:18571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6d2d339/0x5bf8706fdac8d36c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574365.460028:0:18571:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788574365.460224:0:17056:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788574365.460231:0:17056:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6d2d339/0x5bf8706fdac8d36c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.460239:0:17056:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32f200 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:3.0:1788574365.460243:0:17056:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6d2d339/0x5bf8706fdac8d36c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.460263:0:17056:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6d2d339/0x5bf8706fdac8d36c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.460280:0:17056:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6d2d339/0x5bf8706fdac8d36c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.460287:0:17056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6d2d339/0x5bf8706fdac8d36c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.460306:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574365.460308:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574365.460309:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788574365.462309:0:18571:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788574365.462320:0:18571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea8df3f9/0x5bf8706fdac8d373 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574365.462336:0:18571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=505s v=(0 0) 00010000:00010000:2.0:1788574365.462341:0:18571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574365.462347:0:18571:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea8df3f9/0x5bf8706fdac8d373 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574365.462361:0:18571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea8df3f9/0x5bf8706fdac8d373 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574365.462682:0:18571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea8df3f9/0x5bf8706fdac8d373 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574365.462690:0:18571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ea8df3f9/0x5bf8706fdac8d373 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574365.462714:0:18571:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788574365.463016:0:17055:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788574365.463024:0:17055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ea8df3f9/0x5bf8706fdac8d373 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.463033:0:17055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32f400 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:3.0:1788574365.463039:0:17055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea8df3f9/0x5bf8706fdac8d373 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.463048:0:17055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea8df3f9/0x5bf8706fdac8d373 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.463065:0:17055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ea8df3f9/0x5bf8706fdac8d373 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.463085:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea8df3f9/0x5bf8706fdac8d373 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.463105:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574365.463107:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574365.463108:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788574365.465896:0:18571:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788574365.465909:0:18571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038f238a0/0x5bf8706fdac8d37a lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574365.465925:0:18571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=505s v=(0 0) 00010000:00010000:2.0:1788574365.465936:0:18571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574365.465943:0:18571:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000038f238a0/0x5bf8706fdac8d37a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574365.465958:0:18571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000038f238a0/0x5bf8706fdac8d37a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574365.465969:0:18571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038f238a0/0x5bf8706fdac8d37a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574365.465976:0:18571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000038f238a0/0x5bf8706fdac8d37a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574365.465997:0:18571:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788574365.466074:0:17056:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788574365.466081:0:17056:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000038f238a0/0x5bf8706fdac8d37a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.466089:0:17056:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32f800 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:3.0:1788574365.466093:0:17056:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000038f238a0/0x5bf8706fdac8d37a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.466102:0:17056:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000038f238a0/0x5bf8706fdac8d37a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.466122:0:17056:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000038f238a0/0x5bf8706fdac8d37a lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.466129:0:17056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000038f238a0/0x5bf8706fdac8d37a lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.466158:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574365.466160:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574365.466161:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788574365.467863:0:18571:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788574365.467873:0:18571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7f41403/0x5bf8706fdac8d381 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574365.467899:0:18571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=505s v=(0 0) 00010000:00010000:2.0:1788574365.467903:0:18571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574365.467910:0:18571:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e7f41403/0x5bf8706fdac8d381 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574365.467922:0:18571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e7f41403/0x5bf8706fdac8d381 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574365.467930:0:18571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7f41403/0x5bf8706fdac8d381 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574365.467944:0:18571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e7f41403/0x5bf8706fdac8d381 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574365.468997:0:18571:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788574365.470826:0:18571:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788574365.470841:0:18571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000097d9bd86/0x5bf8706fdac8d388 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574365.470859:0:18571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=505s v=(0 0) 00010000:00010000:2.0:1788574365.470863:0:18571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574365.470869:0:18571:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000097d9bd86/0x5bf8706fdac8d388 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574365.470892:0:18571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000097d9bd86/0x5bf8706fdac8d388 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574365.470902:0:18571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000097d9bd86/0x5bf8706fdac8d388 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574365.470910:0:18571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000097d9bd86/0x5bf8706fdac8d388 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00100000:10000000:1.0:1788574365.471795:0:19385:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00010000:00010000:3.0:1788574365.474002:0:17055:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788574365.474017:0:17055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e7f41403/0x5bf8706fdac8d381 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.474032:0:17055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32fa00 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:3.0:1788574365.474038:0:17055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7f41403/0x5bf8706fdac8d381 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.474050:0:17055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7f41403/0x5bf8706fdac8d381 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.474072:0:17055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e7f41403/0x5bf8706fdac8d381 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.474079:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e7f41403/0x5bf8706fdac8d381 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.474097:0:17055:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788574365.474101:0:17055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000097d9bd86/0x5bf8706fdac8d388 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.474107:0:17055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32e600 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:3.0:1788574365.474111:0:17055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000097d9bd86/0x5bf8706fdac8d388 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.474118:0:17055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000097d9bd86/0x5bf8706fdac8d388 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.474154:0:17055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000097d9bd86/0x5bf8706fdac8d388 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.474163:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574365.474165:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574365.474167:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1788574365.474724:0:19385:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788574365.477447:0:19385:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00010000:00010000:2.0:1788574365.478246:0:18571:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788574365.478257:0:18571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000097d9bd86/0x5bf8706fdac8d388 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.478922:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788574365.479083:0:18571:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788574365.479091:0:18571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000caa9a49e/0x5bf8706fdac8d38f lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574365.479104:0:18571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=505s v=(0 0) 00010000:00010000:2.0:1788574365.479109:0:18571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574365.479114:0:18571:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000caa9a49e/0x5bf8706fdac8d38f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574365.479127:0:18571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000caa9a49e/0x5bf8706fdac8d38f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574365.479146:0:18571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000caa9a49e/0x5bf8706fdac8d38f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574365.479155:0:18571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000caa9a49e/0x5bf8706fdac8d38f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574365.479172:0:18571:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788574365.479739:0:17055:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788574365.479747:0:17055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000caa9a49e/0x5bf8706fdac8d38f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.479757:0:17055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32f000 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:3.0:1788574365.479761:0:17055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000caa9a49e/0x5bf8706fdac8d38f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.479770:0:17055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000caa9a49e/0x5bf8706fdac8d38f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.479787:0:17055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000caa9a49e/0x5bf8706fdac8d38f lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.479794:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000caa9a49e/0x5bf8706fdac8d38f lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.479809:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574365.479819:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574365.479821:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788574365.479975:0:18571:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788574365.479981:0:18571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038f238a0/0x5bf8706fdac8d396 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574365.479990:0:18571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=505s v=(0 0) 00010000:00010000:2.0:1788574365.479993:0:18571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574365.480004:0:18571:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000038f238a0/0x5bf8706fdac8d396 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574365.480014:0:18571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000038f238a0/0x5bf8706fdac8d396 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574365.480022:0:18571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038f238a0/0x5bf8706fdac8d396 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574365.480029:0:18571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000038f238a0/0x5bf8706fdac8d396 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574365.480049:0:18571:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00100000:10000000:1.0:1788574365.480599:0:19385:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00010000:00010000:3.0:1788574365.480917:0:17056:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788574365.480923:0:17056:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000038f238a0/0x5bf8706fdac8d396 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.480933:0:17056:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32f800 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:3.0:1788574365.480937:0:17056:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000038f238a0/0x5bf8706fdac8d396 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.480946:0:17056:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000038f238a0/0x5bf8706fdac8d396 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.480961:0:17056:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000038f238a0/0x5bf8706fdac8d396 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.480968:0:17056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000038f238a0/0x5bf8706fdac8d396 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.480986:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574365.480988:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574365.480989:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1788574365.481087:0:19385:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00002000:00010000:2.0:1788574365.481741:0:18571:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788574365.481749:0:18571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea8df3f9/0x5bf8706fdac8d39d lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574365.481762:0:18571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=505s v=(0 0) 00010000:00010000:2.0:1788574365.481766:0:18571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574365.481772:0:18571:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea8df3f9/0x5bf8706fdac8d39d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574365.481783:0:18571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea8df3f9/0x5bf8706fdac8d39d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574365.481793:0:18571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea8df3f9/0x5bf8706fdac8d39d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574365.481813:0:18571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ea8df3f9/0x5bf8706fdac8d39d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574365.481834:0:18571:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788574365.482151:0:17055:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788574365.482158:0:17055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ea8df3f9/0x5bf8706fdac8d39d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.482167:0:17055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32f400 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:3.0:1788574365.482171:0:17055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea8df3f9/0x5bf8706fdac8d39d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.482229:0:17055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea8df3f9/0x5bf8706fdac8d39d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.482246:0:17055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ea8df3f9/0x5bf8706fdac8d39d lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.482254:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea8df3f9/0x5bf8706fdac8d39d lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.482273:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574365.482275:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574365.482277:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1788574365.482711:0:19385:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00002000:00010000:2.0:1788574365.483097:0:18571:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788574365.483104:0:18571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000097d9bd86/0x5bf8706fdac8d3a4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574365.483116:0:18571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=505s v=(0 0) 00010000:00010000:2.0:1788574365.483119:0:18571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574365.483125:0:18571:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000097d9bd86/0x5bf8706fdac8d3a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574365.483136:0:18571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000097d9bd86/0x5bf8706fdac8d3a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574365.483156:0:18571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000097d9bd86/0x5bf8706fdac8d3a4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574365.483163:0:18571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000097d9bd86/0x5bf8706fdac8d3a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574365.483181:0:18571:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788574365.483793:0:18571:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788574365.483799:0:18571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6d2d339/0x5bf8706fdac8d3ab lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574365.483814:0:18571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=505s v=(0 0) 00010000:00010000:2.0:1788574365.483817:0:18571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574365.483821:0:18571:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6d2d339/0x5bf8706fdac8d3ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574365.483829:0:18571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6d2d339/0x5bf8706fdac8d3ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574365.483837:0:18571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6d2d339/0x5bf8706fdac8d3ab lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574365.483845:0:18571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6d2d339/0x5bf8706fdac8d3ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574365.483862:0:18571:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788574365.484073:0:17055:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788574365.484080:0:17055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000097d9bd86/0x5bf8706fdac8d3a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574365.484089:0:17055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32e600 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:1.0:1788574365.484093:0:17055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000097d9bd86/0x5bf8706fdac8d3a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574365.484100:0:17055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000097d9bd86/0x5bf8706fdac8d3a4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574365.484125:0:17055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000097d9bd86/0x5bf8706fdac8d3a4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574365.484132:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000097d9bd86/0x5bf8706fdac8d3a4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574365.484159:0:17055:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788574365.484162:0:17055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6d2d339/0x5bf8706fdac8d3ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574365.484168:0:17055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32f200 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:1.0:1788574365.484170:0:17055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6d2d339/0x5bf8706fdac8d3ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574365.484177:0:17055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6d2d339/0x5bf8706fdac8d3ab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574365.484185:0:17055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6d2d339/0x5bf8706fdac8d3ab lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574365.484329:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6d2d339/0x5bf8706fdac8d3ab lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574365.484347:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574365.484349:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574365.484356:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1788574365.484533:0:19385:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00010000:00010000:3.0:1788574365.484811:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788574365.485820:0:18571:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788574365.485831:0:18571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094e7cef2/0x5bf8706fdac8d3b2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574365.485846:0:18571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=505s v=(0 0) 00010000:00010000:2.0:1788574365.485851:0:18571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574365.485857:0:18571:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000094e7cef2/0x5bf8706fdac8d3b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574365.485869:0:18571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000094e7cef2/0x5bf8706fdac8d3b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574365.485900:0:18571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000094e7cef2/0x5bf8706fdac8d3b2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574365.485908:0:18571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000094e7cef2/0x5bf8706fdac8d3b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574365.485925:0:18571:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1788574365.485990:0:18571:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00000100:00100000:2.0:1788574365.486090:0:18571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c335fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17092:x1875455681697664:12345-0@lo:5:osp-pre-0-0.0 Request processed in 143136us (143992us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574365.486100:0:18571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:1.0:1788574365.486713:0:17055:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788574365.486721:0:17055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000094e7cef2/0x5bf8706fdac8d3b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574365.486730:0:17055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32e200 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:1.0:1788574365.486734:0:17055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000094e7cef2/0x5bf8706fdac8d3b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574365.486744:0:17055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000094e7cef2/0x5bf8706fdac8d3b2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574365.486762:0:17055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000094e7cef2/0x5bf8706fdac8d3b2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574365.486769:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000094e7cef2/0x5bf8706fdac8d3b2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574365.486792:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574365.486793:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574365.486795:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574365.486965:0:17092:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17092:1875455681697664:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788574365.486982:0:17092:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x6:0x0] 00000100:00100000:3.0:1788574365.487028:0:17092:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85de938380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17092:1875455681697792:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788574365.487073:0:17092:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574365.487105:0:17092:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8600274f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788574365.487961:0:19093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681697792 00000100:00100000:1.0:1788574365.487970:0:19093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681697792 00000100:00100000:1.0:1788574365.488023:0:19093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788574365.488032:0:19093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de93b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17092:x1875455681697792:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1788574365.488072:0:19093:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00080000:01000000:0.0:1788574365.503660:0:19385:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788574365.503874:0:19385:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1788574365.503899:0:19385:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788574365.503912:0:19385:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x5bf8706fdac8d3b9 00000020:01000004:0.0:1788574365.503919:0:19385:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:0.0:1788574365.503940:0:19385:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.151@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788574365.503943:0:19385:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.151@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788574365.503958:0:19385:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1788574365.503985:0:19385:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:0.0:1788574365.503989:0:19385:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.151@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000001:00080000:2.0:1788574365.507954:0:18568:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:2.0:1788574365.507995:0:18568:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788574365.511051:0:19093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de93b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:17092:x1875455681697792:12345-0@lo:5:osp-pre-0-0.0 Request processed in 23014us (23971us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1788574365.511076:0:19093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788574365.516566:0:17092:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:3.0:1788574365.516580:0:17092:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85de938380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17092:1875455681697792:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788574365.516599:0:17092:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00000040:01000000:2.0:1788574365.524915:0:19385:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.151@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788574365.524970:0:19385:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.151@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1788574365.524974:0:19385:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788574365.524976:0:19385:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788574365.524977:0:19385:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788574365.524978:0:19385:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788574365.524980:0:19385:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788574365.524981:0:19385:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788574365.524983:0:19385:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788574365.524984:0:19385:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788574365.524986:0:19385:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788574365.524990:0:19385:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1788574365.524992:0:19385:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788574365.524993:0:19385:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788574365.524994:0:19385:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788574365.524995:0:19385:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788574365.524996:0:19385:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788574365.525004:0:19385:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788574365.525005:0:19385:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788574365.525006:0:19385:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788574365.525007:0:19385:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788574365.525036:0:19385:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788574365.525060:0:19385:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c2f44000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:19385:1875455681697920:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788574365.525695:0:19385:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574365.525810:0:19385:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85e5680cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788574365.525923:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681697920 00000100:00100000:3.0:1788574365.525931:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681697920 00000100:00100000:3.0:1788574365.526018:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788574365.526036:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1b9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f73678fb-d8c0-450f-a73b-e6565942045e+21:19385:x1875455681697920:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788574365.526078:0:17060:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788574365.526081:0:17060:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1788574365.526085:0:17060:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1788574365.526930:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1b9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f73678fb-d8c0-450f-a73b-e6565942045e+21:19385:x1875455681697920:12345-0@lo:253:mount.lustre.0 Request processed in 892us (1233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574365.526940:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788574365.527019:0:19385:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c2f44000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:19385:1875455681697920:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788574365.527034:0:19385:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788574365.527037:0:19385:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788574365.527039:0:19385:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788574365.527040:0:19385:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788574365.527041:0:19385:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788574365.527043:0:19385:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788574365.527044:0:19385:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788574365.527045:0:19385:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788574365.527047:0:19385:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788574365.527048:0:19385:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788574365.527067:0:19385:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c84c2216000 from lustre-OST0001 10000000:01000000:2.0:1788574365.527096:0:19385:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1788574365.527099:0:19385:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788574365.527108:0:19385:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9c85faf48000 local copy 00010000:00010000:2.0:1788574365.527118:0:19385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6800/0x5bf8706fdac8d00f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d016 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574365.527250:0:19385:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c2f44000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:19385:1875455681698048:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788574365.527288:0:19385:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574365.528691:0:19385:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c3e48c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788574365.528766:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681698048 00000100:00100000:0.0:1788574365.528774:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681698048 00000100:00100000:0.0:1788574365.528817:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788574365.528825:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1b9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f73678fb-d8c0-450f-a73b-e6565942045e+21:19385:x1875455681698048:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788574365.528987:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1b9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f73678fb-d8c0-450f-a73b-e6565942045e+21:19385:x1875455681698048:12345-0@lo:501:mount.lustre.0 Request processed in 163us (1700us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788574365.528995:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788574365.529697:0:19385:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c2f44000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:19385:1875455681698048:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788574365.529804:0:19385:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.151@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788574365.529915:0:19385:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.151@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788574365.529923:0:19385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6800/0x5bf8706fdac8d00f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d016 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574365.529934:0:19385:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6800/0x5bf8706fdac8d00f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d016 expref: -99 pid: 17046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788574365.529968:0:19385:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c84c2216000 10000000:01000000:0.0:1788574365.529974:0:19385:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788574365.529980:0:19385:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788574365.529983:0:19385:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788574365.529988:0:19385:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1788574365.529990:0:19385:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788574365.530021:0:19385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85c152ea00/0x5bf8706fdac8d3c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574365.530029:0:19385:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c85c152ea00/0x5bf8706fdac8d3c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574365.530056:0:19385:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c85c152ea00/0x5bf8706fdac8d3c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574365.530074:0:19385:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c2bddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:19385:1875455681698176:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788574365.530112:0:19385:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574365.530311:0:19385:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8600c453c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788574365.530700:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681698176 00000100:00100000:2.0:1788574365.530706:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681698176 00000100:00100000:2.0:1788574365.530793:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788574365.530801:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1b9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f73678fb-d8c0-450f-a73b-e6565942045e+21:19385:x1875455681698176:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788574365.530812:0:17061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574365.530825:0:17061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85fa32fe00/0x5bf8706fdac8d3c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8d3c0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574365.530858:0:17061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85fa32fe00/0x5bf8706fdac8d3c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8d3c0 expref: 22 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574365.530869:0:17061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85fa32fe00/0x5bf8706fdac8d3c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8d3c0 expref: 22 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574365.530888:0:17061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85fa32fe00, rc 0) 00000100:00100000:2.0:1788574365.530936:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1b9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f73678fb-d8c0-450f-a73b-e6565942045e+22:19385:x1875455681698176:12345-0@lo:101:mount.lustre.0 Request processed in 136us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574365.530943:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788574365.531014:0:19385:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c2bddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:19385:1875455681698176:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788574365.531029:0:19385:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c85c152ea00/0x5bf8706fdac8d3c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d3c7 expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574365.531037:0:19385:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c85c152ea00/0x5bf8706fdac8d3c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8d3c7 expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788574365.532964:0:19385:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1788574365.534074:0:19385:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788574365.538121:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1788574365.538707:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1788574365.538724:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1788574365.538735:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1788574365.538746:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1788574365.538757:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1788574365.538782:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1788574365.538787:0:19385:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1788574365.538982:0:19385:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c2bddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:19385:1875455681698304:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788574365.539052:0:19385:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574365.539162:0:19385:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8600c45540 going to sleep for 11 seconds 00000100:00100000:1.0:1788574365.542072:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681698304 00000100:00100000:1.0:1788574365.542089:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681698304 00000100:00100000:1.0:1788574365.542409:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788574365.542421:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1b9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f73678fb-d8c0-450f-a73b-e6565942045e+22:19385:x1875455681698304:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788574365.542634:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1b9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f73678fb-d8c0-450f-a73b-e6565942045e+22:19385:x1875455681698304:12345-0@lo:501:mount.lustre.0 Request processed in 216us (3582us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574365.542642:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788574365.542737:0:19385:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c2bddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:19385:1875455681698304:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788574365.542806:0:19385:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c2bddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:19385:1875455681698432:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788574365.542865:0:19385:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574365.548166:0:19385:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8600c45540 going to sleep for 11 seconds 00000100:00100000:3.0:1788574365.548588:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681698432 00000100:00100000:3.0:1788574365.548598:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681698432 00000100:00100000:3.0:1788574365.548653:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788574365.548664:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1b9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f73678fb-d8c0-450f-a73b-e6565942045e+22:19385:x1875455681698432:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788574365.549731:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1b9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f73678fb-d8c0-450f-a73b-e6565942045e+22:19385:x1875455681698432:12345-0@lo:503:mount.lustre.0 Request processed in 1064us (6860us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574365.549743:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788574365.549910:0:19385:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c2bddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:19385:1875455681698432:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788574365.550559:0:19385:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788574365.550644:0:19385:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c2bddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:19385:1875455681698560:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788574365.550702:0:19385:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574365.550735:0:19385:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8600c453c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788574365.551021:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681698560 00000100:00100000:3.0:1788574365.551027:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681698560 00000100:00100000:3.0:1788574365.551059:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788574365.551068:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1b9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f73678fb-d8c0-450f-a73b-e6565942045e+22:19385:x1875455681698560:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788574365.551782:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1b9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f73678fb-d8c0-450f-a73b-e6565942045e+22:19385:x1875455681698560:12345-0@lo:502:mount.lustre.0 Request processed in 713us (1078us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574365.551791:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788574365.552161:0:19385:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c2bddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:19385:1875455681698560:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788574365.552672:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1788574365.552703:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1788574365.552719:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1788574365.552750:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1788574365.552765:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1788574365.552779:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1788574365.552792:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1788574365.552806:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1788574365.552819:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:0.0:1788574365.552939:0:19385:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c2bddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:19385:1875455681698688:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788574365.552995:0:19385:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574365.553030:0:19385:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8600c453c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788574365.553102:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681698688 00000100:00100000:3.0:1788574365.553108:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681698688 00000100:00100000:3.0:1788574365.553153:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788574365.553162:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1b9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f73678fb-d8c0-450f-a73b-e6565942045e+22:19385:x1875455681698688:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788574365.553611:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1b9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f73678fb-d8c0-450f-a73b-e6565942045e+22:19385:x1875455681698688:12345-0@lo:502:mount.lustre.0 Request processed in 449us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574365.553626:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788574365.553805:0:19385:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c2bddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:19385:1875455681698688:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788574365.553957:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:0.0:1788574365.553968:0:19385:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:3.0:1788574365.555039:0:19389:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788574365.555048:0:19389:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:3.0:1788574365.555054:0:19389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574365.555056:0:19389:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1788574365.555063:0:19389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788574365.555076:0:19389:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9c84c23219c0) 00000020:00000080:3.0:1788574365.555102:0:19389:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788574365.555107:0:19389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788574365.555651:0:19389:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c84c2216000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1788574365.555660:0:19389:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788574365.555666:0:19389:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x5bf8706fdac8d3d5 00010000:00010000:3.0:1788574365.564134:0:19389:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:3.0:1788574365.564968:0:19389:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:3.0:1788574365.566799:0:19389:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:1.0:1788574365.568862:0:19389:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788574365.568874:0:19389:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788574365.568890:0:19389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574365.568892:0:19389:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788574365.568896:0:19389:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788574365.568899:0:19389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574365.568901:0:19389:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788574365.568905:0:19389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788574365.568907:0:19389:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788574365.568909:0:19389:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788574365.568912:0:19389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574365.568913:0:19389:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788574365.568916:0:19389:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788574365.568918:0:19389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574365.568919:0:19389:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788574365.568923:0:19389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788574365.568950:0:19389:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788574365.568953:0:19389:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788574365.568954:0:19389:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788574365.568958:0:19389:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:2.0:1788574365.569185:0:19385:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1788574365.569254:0:19385:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788574365.569273:0:19385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85c152ea00/0x5bf8706fdac8d3c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d3c7 expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574365.569284:0:19385:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c85c152ea00/0x5bf8706fdac8d3c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d3c7 expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788574365.569292:0:19385:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c84c2216000 from 1 10000000:01000000:2.0:1788574365.569294:0:19385:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788574365.569329:0:19385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85fa32ea00/0x5bf8706fdac8d3dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574365.569337:0:19385:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c85fa32ea00/0x5bf8706fdac8d3dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574365.569360:0:19385:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c85fa32ea00/0x5bf8706fdac8d3dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574365.569604:0:19385:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c2f46300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:19385:1875455681698816:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788574365.569672:0:19385:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574365.569725:0:19385:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c3e48240 going to sleep for 11 seconds 00000100:00100000:3.0:1788574365.569785:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681698816 00000100:00100000:3.0:1788574365.569792:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681698816 00000100:00100000:3.0:1788574365.569845:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788574365.569856:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1b9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f73678fb-d8c0-450f-a73b-e6565942045e+22:19385:x1875455681698816:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788574365.569869:0:17060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574365.569892:0:17060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c84c2617000/0x5bf8706fdac8d3e3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8d3dc expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.569916:0:17060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c84c2617000/0x5bf8706fdac8d3e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8d3dc expref: 23 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.569928:0:17060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c84c2617000/0x5bf8706fdac8d3e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8d3dc expref: 23 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.569937:0:17060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c84c2617000, rc 0) 00000100:00100000:3.0:1788574365.569993:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1b9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f73678fb-d8c0-450f-a73b-e6565942045e+23:19385:x1875455681698816:12345-0@lo:101:mount.lustre.0 Request processed in 139us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574365.570000:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788574365.570140:0:19385:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c2f46300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:19385:1875455681698816:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788574365.570156:0:19385:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c85fa32ea00/0x5bf8706fdac8d3dc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d3e3 expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574365.570167:0:19385:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c85fa32ea00/0x5bf8706fdac8d3dc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8d3e3 expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788574365.571586:0:19385:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1788574365.572092:0:19385:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788574365.575754:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1788574365.575807:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1788574365.576325:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1788574365.576334:0:19385:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1788574365.576640:0:19385:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:19385:1875455681698944:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788574365.576706:0:19385:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574365.576809:0:19385:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c82c7780 going to sleep for 11 seconds 00000100:00100000:2.0:1788574365.582601:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681698944 00000100:00100000:2.0:1788574365.582617:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681698944 00000100:00100000:2.0:1788574365.582682:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788574365.582693:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1b9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f73678fb-d8c0-450f-a73b-e6565942045e+23:19385:x1875455681698944:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788574365.582895:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1b9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f73678fb-d8c0-450f-a73b-e6565942045e+23:19385:x1875455681698944:12345-0@lo:501:mount.lustre.0 Request processed in 204us (6187us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574365.582903:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788574365.583675:0:19385:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:19385:1875455681698944:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788574365.583732:0:19385:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:19385:1875455681699072:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788574365.583791:0:19385:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574365.583848:0:19385:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c82c7780 going to sleep for 11 seconds 00000100:00100000:0.0:1788574365.585621:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681699072 00000100:00100000:0.0:1788574365.585635:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681699072 00000100:00100000:0.0:1788574365.585703:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788574365.585713:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1b9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f73678fb-d8c0-450f-a73b-e6565942045e+23:19385:x1875455681699072:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788574365.585874:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1b9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f73678fb-d8c0-450f-a73b-e6565942045e+23:19385:x1875455681699072:12345-0@lo:503:mount.lustre.0 Request processed in 162us (2082us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574365.585891:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788574365.586502:0:19385:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:19385:1875455681699072:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788574365.586975:0:19385:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788574365.587311:0:19385:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:19385:1875455681699200:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788574365.587374:0:19385:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574365.587538:0:19385:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c82c7780 going to sleep for 11 seconds 00000100:00100000:2.0:1788574365.587748:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681699200 00000100:00100000:2.0:1788574365.587754:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681699200 00000100:00100000:2.0:1788574365.587801:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788574365.587809:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1b9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f73678fb-d8c0-450f-a73b-e6565942045e+23:19385:x1875455681699200:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788574365.587928:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1b9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f73678fb-d8c0-450f-a73b-e6565942045e+23:19385:x1875455681699200:12345-0@lo:502:mount.lustre.0 Request processed in 120us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574365.587936:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788574365.588579:0:19385:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:19385:1875455681699200:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788574365.588797:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1788574365.588827:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1788574365.588843:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1788574365.588858:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1788574365.588871:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1788574365.588898:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1788574365.588913:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1788574365.588925:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:1.0:1788574365.588939:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1788574365.588952:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:1.0:1788574365.588966:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:1.0:1788574365.588996:0:19385:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:19385:1875455681699328:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788574365.589049:0:19385:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574365.589081:0:19385:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c82c7780 going to sleep for 11 seconds 00000100:00100000:1.0:1788574365.589098:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681699328 00000100:00100000:1.0:1788574365.589103:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681699328 00000100:00100000:1.0:1788574365.589141:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788574365.589148:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1b9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f73678fb-d8c0-450f-a73b-e6565942045e+23:19385:x1875455681699328:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788574365.590265:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1b9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f73678fb-d8c0-450f-a73b-e6565942045e+23:19385:x1875455681699328:12345-0@lo:502:mount.lustre.0 Request processed in 1114us (1213us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574365.590277:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788574365.590936:0:19385:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:19385:1875455681699328:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788574365.591025:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:2.0:1788574365.591038:0:19385:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1788574365.593014:0:19393:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788574365.593028:0:19393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574365.593031:0:19393:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788574365.593037:0:19393:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c84c2216000 00000020:00000080:3.0:1788574365.593041:0:19393:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788574365.593048:0:19393:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788574365.593050:0:19393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574365.593052:0:19393:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788574365.593054:0:19393:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788574365.593057:0:19393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574365.593058:0:19393:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788574365.593061:0:19393:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c84c2216000 00000020:00000080:3.0:1788574365.593062:0:19393:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788574365.593121:0:19393:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788574365.593125:0:19393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574365.593126:0:19393:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788574365.593128:0:19393:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788574365.593131:0:19393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574365.593132:0:19393:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788574365.593136:0:19393:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c84c2216000 00000020:00000080:3.0:1788574365.593138:0:19393:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788574365.593154:0:19393:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788574365.593158:0:19393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574365.593159:0:19393:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788574365.593161:0:19393:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788574365.593163:0:19393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574365.593164:0:19393:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788574365.593168:0:19393:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c84c2216000 00000020:00000080:3.0:1788574365.593170:0:19393:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788574365.593228:0:19393:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788574365.593238:0:19393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788574365.593240:0:19393:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788574365.593243:0:19393:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:1.0:1788574365.593901:0:19385:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1788574365.593937:0:19385:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788574365.593961:0:19385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85fa32ea00/0x5bf8706fdac8d3dc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d3e3 expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574365.593974:0:19385:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c85fa32ea00/0x5bf8706fdac8d3dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d3e3 expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788574365.594033:0:19385:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788574365.594037:0:19385:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c84c2216000 10000000:01000000:1.0:1788574365.594040:0:19385:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c84c2216000 10000000:01000000:1.0:1788574365.594044:0:19385:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788574365.594050:0:19385:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c84c2216000 from 1 10000000:01000000:1.0:1788574365.594053:0:19385:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788574365.594091:0:19385:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2600/0x5bf8706fdac8d3ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574365.594100:0:19385:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2600/0x5bf8706fdac8d3ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574365.594123:0:19385:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2600/0x5bf8706fdac8d3ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574365.594149:0:19385:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:19385:1875455681699456:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788574365.594253:0:19385:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574365.594295:0:19385:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c82c7d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788574365.594596:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681699456 00000100:00100000:0.0:1788574365.594604:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681699456 00000100:00100000:0.0:1788574365.594656:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788574365.594664:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1b9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f73678fb-d8c0-450f-a73b-e6565942045e+23:19385:x1875455681699456:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788574365.594676:0:17062:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574365.594688:0:17062:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85c152e200/0x5bf8706fdac8d3f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8d3ea expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574365.594716:0:17062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85c152e200/0x5bf8706fdac8d3f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8d3ea expref: 24 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574365.594726:0:17062:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85c152e200/0x5bf8706fdac8d3f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8d3ea expref: 24 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574365.594735:0:17062:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85c152e200, rc 0) 00000100:00100000:0.0:1788574365.594774:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1b9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f73678fb-d8c0-450f-a73b-e6565942045e+24:19385:x1875455681699456:12345-0@lo:101:mount.lustre.0 Request processed in 111us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574365.594780:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788574365.597285:0:19385:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:19385:1875455681699456:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788574365.597314:0:19385:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2600/0x5bf8706fdac8d3ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d3f1 expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574365.597326:0:19385:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2600/0x5bf8706fdac8d3ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8d3f1 expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788574365.598975:0:19385:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:1.0:1788574365.601260:0:19385:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788574365.601491:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1788574365.601517:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1788574365.601531:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1788574365.601542:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1788574365.601553:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1788574365.601564:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1788574365.601576:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1788574365.601589:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1788574365.601602:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1788574365.601615:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1788574365.601625:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1788574365.601637:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1788574365.601648:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1788574365.601660:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1788574365.601698:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1788574365.601712:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1788574365.601725:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1788574365.601736:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1788574365.601747:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1788574365.601757:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1788574365.601769:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1788574365.601781:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1788574365.601792:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1788574365.601804:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1788574365.601817:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:1.0:1788574365.601830:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:1.0:1788574365.601845:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:1.0:1788574365.601859:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:1.0:1788574365.601869:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:1.0:1788574365.601893:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:1.0:1788574365.601919:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:1.0:1788574365.601934:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:1.0:1788574365.601946:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:1.0:1788574365.601958:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:1.0:1788574365.601969:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:1.0:1788574365.601982:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:1.0:1788574365.601994:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:1.0:1788574365.602008:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:1.0:1788574365.602023:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:1.0:1788574365.602035:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:1.0:1788574365.602047:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:1.0:1788574365.602057:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:1.0:1788574365.602067:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:1.0:1788574365.602079:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:1.0:1788574365.602090:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:1.0:1788574365.602102:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:1.0:1788574365.602133:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:1.0:1788574365.602145:0:19385:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:1.0:1788574365.602273:0:19385:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:19385:1875455681699584:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788574365.602342:0:19385:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574365.602390:0:19385:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c82c7e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788574365.614602:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681699584 00000100:00100000:0.0:1788574365.614618:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681699584 00000100:00100000:0.0:1788574365.614688:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788574365.614699:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601806450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f73678fb-d8c0-450f-a73b-e6565942045e+24:19385:x1875455681699584:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788574365.614890:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601806450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f73678fb-d8c0-450f-a73b-e6565942045e+24:19385:x1875455681699584:12345-0@lo:501:mount.lustre.0 Request processed in 192us (12547us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574365.614906:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788574365.615332:0:19385:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:19385:1875455681699584:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788574365.615951:0:19385:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:19385:1875455681699712:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788574365.616573:0:19385:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574365.617317:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681699712 00000100:00100000:0.0:1788574365.617327:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681699712 00000100:00100000:1.0:1788574365.617659:0:19385:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c82c7e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788574365.617726:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788574365.617737:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601804850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f73678fb-d8c0-450f-a73b-e6565942045e+24:19385:x1875455681699712:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788574365.619492:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601804850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f73678fb-d8c0-450f-a73b-e6565942045e+24:19385:x1875455681699712:12345-0@lo:503:mount.lustre.0 Request processed in 1684us (3245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574365.619506:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788574365.620385:0:19385:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:19385:1875455681699712:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788574365.622779:0:19385:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788574365.625318:0:19385:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c2f46300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:19385:1875455681699840:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788574365.625544:0:19385:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574365.625600:0:19385:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c3e48780 going to sleep for 11 seconds 00000100:00100000:0.0:1788574365.625672:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681699840 00000100:00100000:0.0:1788574365.625680:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681699840 00000100:00100000:0.0:1788574365.625738:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788574365.625748:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601806050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f73678fb-d8c0-450f-a73b-e6565942045e+24:19385:x1875455681699840:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788574365.625893:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601806050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f73678fb-d8c0-450f-a73b-e6565942045e+24:19385:x1875455681699840:12345-0@lo:502:mount.lustre.0 Request processed in 145us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574365.625901:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788574365.625967:0:19385:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c2f46300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:19385:1875455681699840:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788574365.626731:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1788574365.626768:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1788574365.626781:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1788574365.626792:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1788574365.626804:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1788574365.626816:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1788574365.626845:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1788574365.626860:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1788574365.626871:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1788574365.626897:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1788574365.626912:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1788574365.626926:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1788574365.626939:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1788574365.626952:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1788574365.626965:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1788574365.629731:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1788574365.629749:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1788574365.629762:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1788574365.629774:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1788574365.629789:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1788574365.629803:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1788574365.629815:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1788574365.629844:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1788574365.629861:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1788574365.629885:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:2.0:1788574365.629902:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:2.0:1788574365.629918:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:2.0:1788574365.629932:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:2.0:1788574365.629946:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:2.0:1788574365.629959:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:2.0:1788574365.629971:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:2.0:1788574365.629984:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:2.0:1788574365.629998:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:2.0:1788574365.630011:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:2.0:1788574365.630023:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:2.0:1788574365.630036:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:2.0:1788574365.630050:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:2.0:1788574365.630064:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:2.0:1788574365.630090:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:2.0:1788574365.630106:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:2.0:1788574365.630118:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:2.0:1788574365.630130:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:2.0:1788574365.630145:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:2.0:1788574365.630160:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:2.0:1788574365.630173:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:2.0:1788574365.630186:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:2.0:1788574365.630235:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:2.0:1788574365.630247:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:2.0:1788574365.630317:0:19385:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c2f46300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:19385:1875455681699968:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788574365.630405:0:19385:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574365.632792:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681699968 00000100:00100000:0.0:1788574365.632806:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681699968 00000100:00100000:0.0:1788574365.632858:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788574365.632868:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601804450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f73678fb-d8c0-450f-a73b-e6565942045e+24:19385:x1875455681699968:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788574365.633586:0:19385:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c3e48780 going to sleep for 11 seconds 00000100:00100000:0.0:1788574365.638447:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601804450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f73678fb-d8c0-450f-a73b-e6565942045e+24:19385:x1875455681699968:12345-0@lo:502:mount.lustre.0 Request processed in 5572us (8034us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574365.638462:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788574365.638792:0:19385:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c2f46300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:19385:1875455681699968:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788574365.639031:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:2.0:1788574365.639062:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:2.0:1788574365.639098:0:19385:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c2f46300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:19385:1875455681700096:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788574365.639152:0:19385:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574365.639204:0:19385:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c3e48780 going to sleep for 11 seconds 00000100:00100000:0.0:1788574365.639546:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681700096 00000100:00100000:0.0:1788574365.639553:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681700096 00000100:00100000:0.0:1788574365.639602:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788574365.639611:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601805c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f73678fb-d8c0-450f-a73b-e6565942045e+24:19385:x1875455681700096:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788574365.639729:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601805c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f73678fb-d8c0-450f-a73b-e6565942045e+24:19385:x1875455681700096:12345-0@lo:502:mount.lustre.0 Request processed in 118us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574365.639737:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788574365.639846:0:19385:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c2f46300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:19385:1875455681700096:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788574365.639908:0:19385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:2.0:1788574365.639917:0:19385:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1788574365.646334:0:19398:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788574365.646353:0:19398:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9c8600d5b380) 00000020:00000080:2.0:1788574365.646393:0:19398:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:2.0:1788574365.646507:0:19398:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c84c2216000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788574365.646511:0:19398:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c84c2216000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788574365.646515:0:19398:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c84c2216000 3 00010000:00080000:2.0:1788574365.646547:0:19398:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c84c44b7000@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.151@tcp at head 00010000:00010000:2.0:1788574365.648055:0:19398:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:1.0:1788574365.653704:0:19398:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1788574365.653749:0:19398:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788574365.653762:0:19398:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x5bf8706fdac8d3ff 00000100:00080000:1.0:1788574365.653772:0:19398:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788574365.653778:0:19398:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c84c44b7000 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:1.0:1788574365.653810:0:19398:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c84c335d500 x1875455681700224/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788574365.662960:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1875455681700224:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788574365.663039:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788574365.664075:0:19398:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788574365.664562:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681700224 00000100:00100000:3.0:1788574365.664573:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681700224 00000100:00100000:3.0:1788574365.664616:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788574365.664623:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c335ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3616:x1875455681700224:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788574365.664652:0:17069:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 505 last 0 00000020:00000080:3.0:1788574365.664704:0:17069:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x5bf8706fdac8d406 00000004:00100000:3.0:1788574365.664722:0:17069:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788574365.664755:0:17069:0:(import.c:65:import_set_state_nolock()) ffff9c84c34c5000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788574365.664843:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c335ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1875455681700224:12345-0@lo:38:llog_process_th.0 Request processed in 205us (1789us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574365.664851:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000020:01000004:3.0:1788574365.666062:0:19398:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788574365.666078:0:19398:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9c84c2320000) 00000020:00000080:3.0:1788574365.666100:0:19398:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:3.0:1788574365.666174:0:19398:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c84c2216000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788574365.666179:0:19398:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c84c2216000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788574365.666181:0:19398:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c84c2216000 3 00010000:00080000:3.0:1788574365.666250:0:19398:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c85c6e78800@lustre-MDT0001-lwp-OST0001: add connection 192.168.204.151@tcp at head 00010000:00080000:1.0:1788574365.666594:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c84c335d500 x1875455681700224/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788574375 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574365.666606:0:3616:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788574365.666616:0:3616:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1788574365.666623:0:3616:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788574365.666627:0:3616:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788574365.666630:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c84c44b7000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788574365.666646:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3616:1875455681700224:0@lo:38:llog_process_th.0 00010000:00010000:0.0:1788574365.674035:0:19398:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:0.0:1788574365.684724:0:19398:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:0.0:1788574365.684787:0:19398:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788574365.684802:0:19398:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x5bf8706fdac8d414 00000100:00080000:0.0:1788574365.684814:0:19398:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788574365.684820:0:19398:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9c85c6e78800 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:0.0:1788574365.684861:0:19398:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c85c2bddc00 x1875455681700352/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788574365.684908:0:19398:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1788574365.685257:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c2bddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3616:1875455681700352:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788574365.685369:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574365.686153:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681700352 00000100:00100000:2.0:1788574365.686163:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681700352 00000100:00100000:2.0:1788574365.686237:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788574365.686245:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2bdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3616:x1875455681700352:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788574365.686277:0:17068:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 505 last 0 00000020:00000080:2.0:1788574365.686328:0:17068:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x5bf8706fdac8d41b 00000004:00100000:2.0:1788574365.686344:0:17068:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788574365.689638:0:17068:0:(import.c:65:import_set_state_nolock()) ffff9c84c44b3000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788574365.689755:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2bdc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875455681700352:12345-0@lo:38:llog_process_th.0 Request processed in 3506us (4384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574365.689765:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788574365.693619:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c85c2bddc00 x1875455681700352/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788574375 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574365.693635:0:3616:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788574365.693644:0:3616:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1788574365.693652:0:3616:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788574365.693656:0:3616:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788574365.693660:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c85c6e78800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788574365.693667:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c2bddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3616:1875455681700352:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1788574365.696102:0:19398:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:1.0:1788574365.696166:0:19385:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1788574365.696213:0:19385:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788574365.696235:0:19385:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2600/0x5bf8706fdac8d3ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d3f1 expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574365.696248:0:19385:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2600/0x5bf8706fdac8d3ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d3f1 expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788574365.696306:0:19385:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788574365.696308:0:19385:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788574365.696309:0:19385:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788574365.696310:0:19385:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788574365.696311:0:19385:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788574365.696313:0:19385:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788574365.696314:0:19385:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788574365.696316:0:19385:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788574365.696317:0:19385:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788574365.696321:0:19385:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1788574365.696324:0:19385:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788574365.696325:0:19385:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788574365.696326:0:19385:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788574365.696327:0:19385:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788574365.696328:0:19385:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788574365.696329:0:19385:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788574365.696330:0:19385:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788574365.696331:0:19385:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788574365.696332:0:19385:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788574365.696356:0:19385:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788574365.699106:0:19385:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:19385:1875455681700480:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788574365.699716:0:19385:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574365.699765:0:19385:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c82c7780 going to sleep for 11 seconds 00000100:00100000:0.0:1788574365.700560:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681700480 00000100:00100000:0.0:1788574365.700570:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681700480 00000100:00100000:0.0:1788574365.700621:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788574365.700642:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601804c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f73678fb-d8c0-450f-a73b-e6565942045e+24:19385:x1875455681700480:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788574365.700674:0:17062:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788574365.700686:0:17062:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788574365.704756:0:17062:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788574365.704783:0:17062:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1788574365.705093:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601804c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f73678fb-d8c0-450f-a73b-e6565942045e+24:19385:x1875455681700480:12345-0@lo:253:mount.lustre.0 Request processed in 4448us (5898us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574365.705117:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788574365.705270:0:19385:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f73678fb-d8c0-450f-a73b-e6565942045e:19385:1875455681700480:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788574365.705283:0:19385:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788574365.705286:0:19385:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788574365.705288:0:19385:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788574365.705289:0:19385:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788574365.705290:0:19385:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788574365.705291:0:19385:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788574365.705292:0:19385:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788574365.705294:0:19385:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788574365.705295:0:19385:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788574365.705296:0:19385:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788574365.705311:0:19385:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:2.0:1788574365.706706:0:17083:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788574365.706715:0:17083:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788574365.706740:0:17083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c85fa32fc00/0x5bf8706fdac8d422 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574365.706759:0:17083:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c84c2616a00/0x5bf8706fdac8d2d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8d2cb expref: 23 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574365.706766:0:17083:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c84c2617200/0x5bf8706fdac8d2e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8d2d9 expref: 23 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574365.706772:0:17083:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c85fa32fc00/0x5bf8706fdac8d422 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574365.706812:0:17083:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c84c2617200/0x5bf8706fdac8d2e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5bf8706fdac8d2d9 expref: 23 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574365.707062:0:17083:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c84c2617200/0x5bf8706fdac8d2e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5bf8706fdac8d2d9 expref: 23 pid: 17062 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574365.707079:0:17083:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c2f46300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17083:1875455681700608:0@lo:104: 00000100:00100000:2.0:1788574365.707139:0:17083:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788574365.707212:0:17083:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c84c2616a00/0x5bf8706fdac8d2d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5bf8706fdac8d2cb expref: 23 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574365.707222:0:17083:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c84c2616a00/0x5bf8706fdac8d2d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5bf8706fdac8d2cb expref: 23 pid: 17061 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574365.707245:0:17083:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c2f45f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17083:1875455681700736:0@lo:104: 00000100:00100000:2.0:1788574365.707269:0:17083:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574365.707293:0:17083:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c32776c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788574365.707331:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681700608 00000100:00100000:2.0:1788574365.707337:0:17051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681700608 00000100:00100000:2.0:1788574365.707384:0:17051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681700736 00000100:00100000:2.0:1788574365.707387:0:17051:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681700736 00000100:00100000:2.0:1788574365.707402:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788574365.707410:0:17051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2f46680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f73678fb-d8c0-450f-a73b-e6565942045e+4:17083:x1875455681700608:12345-0@lo:104: 00010000:00010000:2.0:1788574365.707422:0:17051:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff9c84c2617400/0x5bf8706fdac8d2d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8d2e0 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574365.709004:0:17051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788574365.709013:0:17051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2f46680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f73678fb-d8c0-450f-a73b-e6565942045e+4:17083:x1875455681700608:12345-0@lo:104: Request processed in 1602us (1872us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574365.709023:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788574365.709053:0:17051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788574365.709062:0:17051:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2f45880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f73678fb-d8c0-450f-a73b-e6565942045e+3:17083:x1875455681700736:12345-0@lo:104: 00010000:00010000:2.0:1788574365.709075:0:17051:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6a00/0x5bf8706fdac8d2cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8d2d2 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574365.709109:0:17051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788574365.709113:0:17051:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2f45880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f73678fb-d8c0-450f-a73b-e6565942045e+3:17083:x1875455681700736:12345-0@lo:104: Request processed in 54us (1845us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574365.709119:0:17051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1788574365.710574:0:17056:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788574365.710586:0:17056:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c84c2617400/0x5bf8706fdac8d2d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8d2e0 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574365.710597:0:17056:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c84c2617400 already unused, calling callback (ffffffffc1472c20) 10000000:00010000:1.0:1788574365.710601:0:17056:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c84c2617400/0x5bf8706fdac8d2d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5bf8706fdac8d2e0 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574365.710611:0:17056:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c84c2617400/0x5bf8706fdac8d2d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5bf8706fdac8d2e0 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788574365.710618:0:17056:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c84c2617400/0x5bf8706fdac8d2d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5bf8706fdac8d2e0 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788574365.710624:0:17056:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788574365.710679:0:17056:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9c84c2617400/0x5bf8706fdac8d2d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8d2e0 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574365.710685:0:17056:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788574365.710708:0:17056:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c84c2617400/0x5bf8706fdac8d2d9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8d2e0 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574365.710715:0:17056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c84c2617400/0x5bf8706fdac8d2d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8d2e0 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574365.710732:0:17056:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788574365.710735:0:17056:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6a00/0x5bf8706fdac8d2cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8d2d2 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574365.710764:0:17056:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d6a00 already unused, calling callback (ffffffffc1472c20) 10000000:00010000:1.0:1788574365.710767:0:17056:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6a00/0x5bf8706fdac8d2cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5bf8706fdac8d2d2 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574365.710773:0:17056:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6a00/0x5bf8706fdac8d2cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5bf8706fdac8d2d2 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788574365.710778:0:17056:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6a00/0x5bf8706fdac8d2cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5bf8706fdac8d2d2 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788574365.710783:0:17056:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788574365.710805:0:17056:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6a00/0x5bf8706fdac8d2cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8d2d2 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574365.710811:0:17056:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788574365.710818:0:17056:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6a00/0x5bf8706fdac8d2cb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8d2d2 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574365.710824:0:17056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c85d20d6a00/0x5bf8706fdac8d2cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8d2d2 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574365.710838:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574365.710839:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574365.710841:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574365.710849:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574365.710864:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f73678fb-d8c0-450f-a73b-e6565942045e:3619:1875455681700864:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788574365.710935:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574365.710983:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788574365.710988:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f73678fb-d8c0-450f-a73b-e6565942045e:3619:1875455681700992:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788574365.711015:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574365.711052:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681700864 00000100:00100000:1.0:1788574365.711059:0:17053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681700864 00010000:00010000:1.0:1788574365.711084:0:17053:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c84c2617200/0x5bf8706fdac8d2e0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8d2d9 expref: 24 pid: 17062 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574365.711107:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681700992 00000100:00100000:1.0:1788574365.711110:0:17053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681700992 00010000:00010000:1.0:1788574365.711119:0:17053:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c84c2616a00/0x5bf8706fdac8d2d2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8d2cb expref: 25 pid: 17061 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574365.711131:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788574365.711138:0:17053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c335df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f73678fb-d8c0-450f-a73b-e6565942045e+25:3619:x1875455681700864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788574365.711149:0:17053:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574365.711154:0:17053:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c84c2617200/0x5bf8706fdac8d2e0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8d2d9 expref: 25 pid: 17062 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574365.711164:0:17053:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c84c2617200/0x5bf8706fdac8d2e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5bf8706fdac8d2d9 expref: 25 pid: 17062 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574365.711181:0:17053:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788574365.711231:0:17053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c335df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f73678fb-d8c0-450f-a73b-e6565942045e+25:3619:x1875455681700864:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574365.711239:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788574365.711255:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788574365.711261:0:17053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c335ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f73678fb-d8c0-450f-a73b-e6565942045e+24:3619:x1875455681700992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788574365.711269:0:17053:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574365.711274:0:17053:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c84c2616a00/0x5bf8706fdac8d2d2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8d2cb expref: 24 pid: 17061 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574365.711292:0:17053:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c84c2616a00/0x5bf8706fdac8d2d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5bf8706fdac8d2cb expref: 24 pid: 17061 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574365.711305:0:17053:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c85fa32fc00/0x5bf8706fdac8d422 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574365.711314:0:17053:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85fa32fc00/0x5bf8706fdac8d422 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788574365.711329:0:17053:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.012283329s 00010000:00010000:1.0:1788574365.711334:0:17053:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c85fa32fc00/0x5bf8706fdac8d422 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574365.711341:0:17053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c85fa32fc00/0x5bf8706fdac8d422 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574365.711348:0:17053:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c85fa32fc00/0x5bf8706fdac8d422 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574365.711353:0:17053:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c85fa32fc00/0x5bf8706fdac8d422 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574365.711359:0:17053:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32fc00 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:1.0:1788574365.711363:0:17053:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c85fa32fc00/0x5bf8706fdac8d422 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574365.711371:0:17053:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c85fa32fc00/0x5bf8706fdac8d422 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574365.711380:0:17053:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c85fa32fc00/0x5bf8706fdac8d422 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574365.711396:0:17053:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788574365.711420:0:17053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c335ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f73678fb-d8c0-450f-a73b-e6565942045e+24:3619:x1875455681700992:12345-0@lo:103:ldlm_bl.0 Request processed in 159us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574365.711426:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788574365.711464:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f73678fb-d8c0-450f-a73b-e6565942045e:3619:1875455681700992:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788574365.711473:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f73678fb-d8c0-450f-a73b-e6565942045e:3619:1875455681700864:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788574365.717357:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c84c2617200/0x5bf8706fdac8d2e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5bf8706fdac8d2d9 expref: 23 pid: 17062 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574365.717397:0:17083:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c2f46300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17083:1875455681700608:0@lo:104: 00010000:00010000:3.0:1788574365.717413:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c84c2616a00/0x5bf8706fdac8d2d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5bf8706fdac8d2cb expref: 22 pid: 17061 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574365.717422:0:17083:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c2f45f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17083:1875455681700736:0@lo:104: 00010000:00010000:3.0:1788574365.717691:0:17083:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c85fa32fc00/0x5bf8706fdac8d422 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.717702:0:17083:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c85fa32fc00/0x5bf8706fdac8d422 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.717709:0:17083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c85fa32fc00/0x5bf8706fdac8d422 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574365.717715:0:17083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85fa32fc00/0x5bf8706fdac8d422 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:2.0:1788574365.724498:0:19385:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1788574365.727138:0:19385:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1788574365.727155:0:19385:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1788574365.727308:0:19385:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788574365.727350:0:19385:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.151@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788574365.727536:0:19385:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1788574365.727571:0:19385:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:2.0:1788574365.728657:0:19385:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788574365.728948:0:19385:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788574366.167378:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788574366.741366:0:17820:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:2.0:1788574366.765680:0:19452:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788574366.766173:0:19452:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:3.0:1788574366.870221:0:17064:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788574366.870231:0:17064:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c85c3688000 from 10 10000000:01000000:3.0:1788574366.870237:0:17064:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788574366.870293:0:17064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c84c2616a00/0x5bf8706fdac8d429 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574366.870306:0:17064:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c84c2616a00/0x5bf8706fdac8d429 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574366.870318:0:17064:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c84c2616a00/0x5bf8706fdac8d429 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574366.870349:0:17064:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85de938380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f73678fb-d8c0-450f-a73b-e6565942045e:17064:1875455681701120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788574366.870422:0:17064:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574366.870470:0:17064:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85d10e9300 going to sleep for 11 seconds 00000100:00100000:2.0:1788574366.871221:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681701120 00000100:00100000:2.0:1788574366.871231:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681701120 00000100:00100000:2.0:1788574366.871281:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788574366.871291:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601805450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f73678fb-d8c0-450f-a73b-e6565942045e+22:17064:x1875455681701120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788574366.871304:0:17060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574366.871322:0:17060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85fa32f200/0x5bf8706fdac8d430 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8d429 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574366.871347:0:17060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85fa32f200/0x5bf8706fdac8d430 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8d429 expref: 23 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574366.871358:0:17060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85fa32f200/0x5bf8706fdac8d430 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8d429 expref: 23 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574366.871367:0:17060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85fa32f200, rc 0) 00000100:00100000:2.0:1788574366.871421:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601805450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f73678fb-d8c0-450f-a73b-e6565942045e+23:17064:x1875455681701120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (996us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574366.871427:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788574366.871488:0:17064:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85de938380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f73678fb-d8c0-450f-a73b-e6565942045e:17064:1875455681701120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788574366.871505:0:17064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c84c2616a00/0x5bf8706fdac8d429 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d430 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574366.871536:0:17064:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c84c2616a00/0x5bf8706fdac8d429 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8d430 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574366.871591:0:17064:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c2f44e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f73678fb-d8c0-450f-a73b-e6565942045e:17064:1875455681701248:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788574366.871623:0:17064:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574366.871659:0:17064:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85e57dcd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788574366.871830:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681701248 00000100:00100000:1.0:1788574366.871835:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681701248 00000100:00100000:1.0:1788574366.871875:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788574366.871883:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601807c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f73678fb-d8c0-450f-a73b-e6565942045e+23:17064:x1875455681701248:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788574366.871897:0:17061:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788574366.871914:0:17061:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788574366.871917:0:17061:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:1.0:1788574366.872007:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601807c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f73678fb-d8c0-450f-a73b-e6565942045e+23:17064:x1875455681701248:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 125us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574366.872014:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788574366.872100:0:17064:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c2f44e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f73678fb-d8c0-450f-a73b-e6565942045e:17064:1875455681701248:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788574366.872162:0:17064:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788574366.872169:0:17064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c84c2616a00/0x5bf8706fdac8d429 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d430 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574366.872177:0:17064:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c84c2616a00/0x5bf8706fdac8d429 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d430 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788574366.872186:0:17064:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788574366.872209:0:17064:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c84c3fd7800 from 10 10000000:01000000:0.0:1788574366.872212:0:17064:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788574366.872231:0:17064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85c152f600/0x5bf8706fdac8d437 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574366.872247:0:17064:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c85c152f600/0x5bf8706fdac8d437 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574366.872255:0:17064:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c85c152f600/0x5bf8706fdac8d437 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574366.872269:0:17064:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c2bddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f73678fb-d8c0-450f-a73b-e6565942045e:17064:1875455681701376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788574366.872296:0:17064:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574366.872318:0:17064:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c860198e600 going to sleep for 11 seconds 00000100:00100000:1.0:1788574366.872538:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681701376 00000100:00100000:1.0:1788574366.872544:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681701376 00000100:00100000:1.0:1788574366.872576:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788574366.872583:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601804050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f73678fb-d8c0-450f-a73b-e6565942045e+23:17064:x1875455681701376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788574366.872591:0:17061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574366.872601:0:17061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85d08a3400/0x5bf8706fdac8d43e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8d437 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574366.872641:0:17061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85d08a3400/0x5bf8706fdac8d43e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8d437 expref: 24 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574366.872651:0:17061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85d08a3400/0x5bf8706fdac8d43e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8d437 expref: 24 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574366.872659:0:17061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d08a3400, rc 0) 00000100:00100000:1.0:1788574366.872692:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601804050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f73678fb-d8c0-450f-a73b-e6565942045e+24:17064:x1875455681701376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574366.872699:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788574366.872730:0:17064:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c2bddc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f73678fb-d8c0-450f-a73b-e6565942045e:17064:1875455681701376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788574366.872741:0:17064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c85c152f600/0x5bf8706fdac8d437 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d43e expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574366.872750:0:17064:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c85c152f600/0x5bf8706fdac8d437 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8d43e expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574366.872791:0:17064:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f73678fb-d8c0-450f-a73b-e6565942045e:17064:1875455681701504:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788574366.872819:0:17064:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574366.872841:0:17064:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85e5680a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788574366.872863:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681701504 00000100:00100000:1.0:1788574366.872867:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681701504 00000100:00100000:1.0:1788574366.872884:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788574366.872889:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601806c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f73678fb-d8c0-450f-a73b-e6565942045e+24:17064:x1875455681701504:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788574366.872898:0:17061:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788574366.872909:0:17061:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788574366.872915:0:17061:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:1.0:1788574366.872975:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601806c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f73678fb-d8c0-450f-a73b-e6565942045e+24:17064:x1875455681701504:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 85us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574366.872981:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788574366.873007:0:17064:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f73678fb-d8c0-450f-a73b-e6565942045e:17064:1875455681701504:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788574366.873045:0:17064:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788574366.873051:0:17064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85c152f600/0x5bf8706fdac8d437 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d43e expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574366.873058:0:17064:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c85c152f600/0x5bf8706fdac8d437 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d43e expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574367.187700:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574368.212011:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574368.403750:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c2f44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681701632:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788574368.403842:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574368.405178:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681701632 00000100:00100000:0.0:1788574368.405227:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681701632 00000100:00100000:0.0:1788574368.405310:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788574368.405322:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c335e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681701632:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788574368.405356:0:18575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788574368.405439:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c335e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681701632:12345-0@lo:13:osp-pre-0-1.0 Request processed in 121us (1597us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574368.405447:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788574368.405637:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c2f44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681701632:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788574368.405805:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788574369.235516:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574369.941031:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788574369.941065:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c2bdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681701888:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788574369.941177:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574369.941265:0:17807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681701888 00000100:00100000:0.0:1788574369.941275:0:17807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681701888 00000100:00100000:0.0:1788574369.941347:0:17807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788574369.941358:0:17807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2bde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681701888:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788574369.941400:0:17807:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788574369.941809:0:17807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2bde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681701888:12345-0@lo:41:osp-pre-0-1.0 Request processed in 450us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574369.941903:0:17807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788574369.941975:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c2bdce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681701888:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788574369.942112:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788574369.942141:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85de939f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681701760:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788574369.942223:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574369.942281:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681701760 00000100:00100000:2.0:1788574369.942285:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681701760 00000100:00100000:2.0:1788574369.942338:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788574369.942346:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2f44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681701760:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788574369.942374:0:17073:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788574369.942414:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2f44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681701760:12345-0@lo:41:osp-pre-1-0.0 Request processed in 69us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574369.942421:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788574369.942672:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85de939f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681701760:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788574370.261210:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574370.451760:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788574370.451795:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85de93a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681702016:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788574370.451871:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574370.451948:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681702016 00000100:00100000:3.0:1788574370.451956:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681702016 00000100:00100000:3.0:1788574370.452018:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788574370.452028:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de93a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681702016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788574370.452058:0:18575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788574370.452102:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de93a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681702016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574370.452110:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1788574370.452131:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788574370.452171:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85de93a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681702016:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788574370.963713:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788574370.963719:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788574370.963723:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c84c369e000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788574370.963731:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 505 00000100:00080000:3.0:1788574370.963736:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788574370.963743:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c84c369e000 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:3.0:1788574370.963766:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c85de939500 x1875455681702400/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788574370.963826:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788574370.963830:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788574370.963831:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c84c2272000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788574370.963835:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 505 00000100:00080000:3.0:1788574370.963838:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788574370.963841:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9c84c2272000 using connection 192.168.204.151@tcp/0@lo 00000100:00100000:3.0:1788574370.963854:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c84c3c0b100 x1875455681702912/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788574370.964033:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85de939500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875455681702400:0@lo:8:kworker.0 00000100:00100000:0.0:1788574370.964217:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85de93a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f73678fb-d8c0-450f-a73b-e6565942045e:3617:1875455681702144:0@lo:400:kworker.0 00000100:00100000:0.0:1788574370.964273:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574370.964319:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85de938a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681702784:0@lo:400:kworker.0 00000100:00100000:0.0:1788574370.964355:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574370.964525:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3617:1875455681703424:0@lo:400:kworker.0 00000100:00100000:0.0:1788574370.964556:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574370.964579:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788574370.964585:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85de938e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681702272:0@lo:400:kworker.0 00000100:00100000:0.0:1788574370.964609:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574370.964628:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875455681703040:0@lo:400:kworker.0 00000100:00100000:0.0:1788574370.964649:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574370.964666:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1875455681703552:0@lo:400:kworker.0 00000100:00100000:0.0:1788574370.964685:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574370.965184:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574370.965221:0:3616:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1875455681702912:0@lo:8:kworker.0 00000100:00100000:2.0:1788574370.965443:0:18571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681702784 00000100:00100000:2.0:1788574370.965452:0:18571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681702784 00000100:00100000:2.0:1788574370.965506:0:18571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681702400 00000100:00100000:2.0:1788574370.965510:0:18571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681702400 00000100:00100000:2.0:1788574370.965530:0:18571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788574370.965547:0:18571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2bdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681702784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574370.965742:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681702144 00000100:00100000:0.0:1788574370.965747:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681702144 00000100:00100000:0.0:1788574370.965788:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788574370.965795:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c536a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f73678fb-d8c0-450f-a73b-e6565942045e+24:3617:x1875455681702144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574370.978109:0:19093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788574370.978122:0:19093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3616:x1875455681702400:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788574370.978166:0:19093:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 510 last 0 00000020:00000080:2.0:1788574370.978215:0:19093:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5bf8706fdac8d445 00002000:00100000:2.0:1788574370.978232:0:19093:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9c84c44b1800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a03 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1788574370.978236:0:19093:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1788574370.978239:0:19093:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788574370.978440:0:19093:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788574370.978470:0:19093:0:(import.c:65:import_set_state_nolock()) ffff9c84c44b0000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788574370.978548:0:19093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3616:x1875455681702400:12345-0@lo:8:kworker.0 Request processed in 427us (13365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574370.978556:0:19093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788574370.978698:0:18571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2bdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681702784:12345-0@lo:400:kworker.0 Request processed in 13153us (14341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574370.978706:0:18571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788574370.978754:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681703424 00000100:00100000:2.0:1788574370.978762:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681703424 00000100:00100000:2.0:1788574370.978813:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681703040 00000100:00100000:2.0:1788574370.978817:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681703040 00000100:00100000:2.0:1788574370.978829:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681703552 00000100:00100000:2.0:1788574370.978832:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681703552 00000100:00100000:2.0:1788574370.978847:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788574370.978853:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2bdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875455681703424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574370.978890:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2bdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875455681703424:12345-0@lo:400:kworker.0 Request processed in 37us (14334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574370.978897:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788574370.978921:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788574370.978927:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2bded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875455681703040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574370.978958:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2bded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875455681703040:12345-0@lo:400:kworker.0 Request processed in 32us (14308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574370.978964:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788574370.978975:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788574370.978981:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2bde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875455681703552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574370.979009:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2bde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875455681703552:12345-0@lo:400:kworker.0 Request processed in 29us (14323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574370.979015:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788574370.979039:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85de938380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681702656:0@lo:400:kworker.0 00000100:00100000:2.0:1788574370.979077:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574370.979111:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3620:1875455681703296:0@lo:400:kworker.0 00000100:00100000:2.0:1788574370.979133:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574370.979154:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788574370.979161:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85de939f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875455681702528:0@lo:400:kworker.0 00000100:00100000:2.0:1788574370.979183:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574370.979223:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3620:1875455681703168:0@lo:400:kworker.0 00000100:00100000:2.0:1788574370.979245:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574370.979269:0:18898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681703296 00000100:00100000:2.0:1788574370.979272:0:18898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681703296 00000100:00100000:2.0:1788574370.979308:0:18898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681702528 00000100:00100000:2.0:1788574370.979311:0:18898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681702528 00000100:00100000:2.0:1788574370.979322:0:18898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681703168 00000100:00100000:2.0:1788574370.979325:0:18898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681703168 00000100:00100000:2.0:1788574370.979337:0:18898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788574370.979343:0:18898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2f45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875455681703296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574370.982562:0:18898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2f45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875455681703296:12345-0@lo:400:kworker.0 Request processed in 3208us (3417us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574370.982578:0:18898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788574370.982616:0:18898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788574370.982627:0:18898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2f46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875455681702528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574370.982668:0:18898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2f46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875455681702528:12345-0@lo:400:kworker.0 Request processed in 45us (3484us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574370.982675:0:18898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788574370.982687:0:18898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788574370.982694:0:18898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2f44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875455681703168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574370.982721:0:18898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2f44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875455681703168:12345-0@lo:400:kworker.0 Request processed in 29us (3477us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574370.982727:0:18898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:2.0:1788574370.982787:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85de939f80 x1875455681702528/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574386 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574370.982801:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85de939f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875455681702528:0@lo:400:kworker.0 00010000:00080000:2.0:1788574370.982814:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c1be3b80 x1875455681703168/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574386 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574370.982822:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3620:1875455681703168:0@lo:400:kworker.0 00010000:00080000:2.0:1788574370.982832:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c1be1180 x1875455681703296/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574386 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574370.982839:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3620:1875455681703296:0@lo:400:kworker.0 00000100:00080000:2.0:1788574370.982898:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788574370.982916:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788574370.982919:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788574370.982940:0:17807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681702272 00000100:00100000:2.0:1788574370.982946:0:17807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681702272 00000100:00100000:2.0:1788574370.982983:0:17807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681702656 00000100:00100000:2.0:1788574370.982986:0:17807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681702656 00000100:00100000:2.0:1788574370.982998:0:17807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788574370.983004:0:17807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2bddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681702272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574370.983042:0:17807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2bddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681702272:12345-0@lo:400:kworker.0 Request processed in 37us (18431us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574370.983047:0:17807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788574370.983058:0:17807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788574370.983063:0:17807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2f44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681702656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574370.983106:0:17807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2f44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681702656:12345-0@lo:400:kworker.0 Request processed in 43us (4028us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574370.983112:0:17807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788574370.983137:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85de938380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681702656:0@lo:400:kworker.0 00000100:00100000:3.0:1788574370.989412:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574370.989499:0:19093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681702912 00000100:00100000:3.0:1788574370.989510:0:19093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681702912 00000100:00100000:3.0:1788574370.989553:0:19093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788574370.989562:0:19093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3616:x1875455681702912:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788574370.989600:0:19093:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 510 last 0 00000020:00000080:3.0:1788574370.989634:0:19093:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5bf8706fdac8d44c 00002000:00100000:3.0:1788574370.989650:0:19093:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9c85c6e7d800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a03 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1788574370.989654:0:19093:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:3.0:1788574370.989657:0:19093:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788574370.989720:0:19093:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1788574370.989748:0:19093:0:(import.c:65:import_set_state_nolock()) ffff9c85c6e7e000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788574370.989814:0:19093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3616:x1875455681702912:12345-0@lo:8:kworker.0 Request processed in 252us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574370.989821:0:19093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1788574370.989878:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3c0b100 x1875455681702912/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788574395 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574370.989888:0:3616:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788574370.989897:0:3616:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1788574370.989904:0:3616:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788574370.989910:0:3616:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788574370.989912:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c84c2272000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788574370.989940:0:3616:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788574370.989947:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3616:1875455681702912:0@lo:8:kworker.0 00000004:00080000:3.0:1788574370.989975:0:17810:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788574370.990041:0:17810:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 510969850905ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788574370.990048:0:17810:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00010000:00080000:3.0:1788574370.990255:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85de939500 x1875455681702400/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788574395 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574370.990547:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c536a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f73678fb-d8c0-450f-a73b-e6565942045e+24:3617:x1875455681702144:12345-0@lo:400:kworker.0 Request processed in 24751us (26272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574370.990557:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788574370.990686:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85de938e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681702272:0@lo:400:kworker.0 00010000:00080000:0.0:1788574370.990732:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3c0ad80 x1875455681703040/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574386 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574370.990743:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875455681703040:0@lo:400:kworker.0 00010000:00080000:0.0:1788574370.990754:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c1be0380 x1875455681703552/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574386 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574370.990763:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1875455681703552:0@lo:400:kworker.0 00000100:00100000:0.0:1788574370.990783:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85de93a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f73678fb-d8c0-450f-a73b-e6565942045e:3617:1875455681702144:0@lo:400:kworker.0 00000100:00100000:0.0:1788574370.990796:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85de938a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681702784:0@lo:400:kworker.0 00010000:00080000:0.0:1788574370.990812:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c1be2680 x1875455681703424/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574386 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574370.990820:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3617:1875455681703424:0@lo:400:kworker.0 00000100:00100000:3.0:1788574370.990913:0:3616:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788574370.990920:0:3616:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788574370.990929:0:3616:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788574370.990932:0:3616:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788574370.990934:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9c84c369e000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788574370.990953:0:3616:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788574370.990958:0:3616:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85de939500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3616:1875455681702400:0@lo:8:kworker.0 00000004:00080000:3.0:1788574370.991610:0:17811:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1788574370.991632:0:17811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be2300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17811:1875455681703808:0@lo:7:osp-pre-1-1.0 00000100:00100000:3.0:1788574370.991673:0:17811:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574370.991691:0:17811:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85cbce3cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788574370.991701:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788574370.991709:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681703680:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788574370.991729:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574370.991752:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681703680 00000100:00100000:3.0:1788574370.991758:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681703680 00000100:00100000:3.0:1788574370.991810:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788574370.991819:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3620:x1875455681703680:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788574370.991842:0:18575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788574370.991892:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3620:x1875455681703680:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574370.991899:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788574370.991930:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c1be3800 x1875455681703680/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574386 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574370.991946:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681703680:0@lo:13:osp-pre-1-1.0 00000004:00080000:0.0:1788574370.992067:0:17094:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x5:0x0] 00000100:00100000:0.0:1788574370.992082:0:17094:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c2bdf480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17094:1875455681704064:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788574370.992116:0:17094:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574370.992131:0:17094:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85d20f1e40 going to sleep for 11 seconds 00000004:00080000:0.0:1788574370.992143:0:17093:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788574370.992240:0:17093:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 510972049499ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788574370.992246:0:17093:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1788574370.992313:0:19093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681703808 00000100:00100000:0.0:1788574370.992318:0:19093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681703808 00000100:00100000:0.0:1788574370.992344:0:19093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681704064 00000100:00100000:0.0:1788574370.992347:0:19093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681704064 00000100:00100000:0.0:1788574370.992563:0:19093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788574370.992571:0:19093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17811:x1875455681703808:12345-0@lo:7:osp-pre-1-1.0 00000100:00100000:0.0:1788574370.992846:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788574370.992854:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2bdf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17094:x1875455681704064:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788574370.992943:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788574370.992956:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c2bdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681703936:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788574370.992992:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788574370.993032:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788574370.993480:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681703936 00000100:00100000:0.0:1788574370.993487:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681703936 00000100:00100000:0.0:1788574370.993525:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788574370.993532:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2f44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3619:x1875455681703936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788574370.993545:0:18575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788574370.993591:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2f44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3619:x1875455681703936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574370.993598:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788574370.994514:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85c2bdea00 x1875455681703936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788574386 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574370.994537:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c2bdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681703936:0@lo:13:osp-pre-1-0.0 00000004:00080000:2.0:1788574370.998404:0:17047:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:0.0:1788574370.998983:0:17799:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00080000:0.0:1788574371.013517:0:19093:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:0.0:1788574371.013528:0:19093:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1788574371.013624:0:19093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17811:x1875455681703808:12345-0@lo:7:osp-pre-1-1.0 Request processed in 21050us (21946us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574371.013635:0:19093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1788574371.013734:0:17811:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c1be2300 x1875455681703808/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788574386 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574371.013751:0:17811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be2300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17811:1875455681703808:0@lo:7:osp-pre-1-1.0 00000004:00080000:3.0:1788574371.013767:0:17811:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1788574371.013824:0:17811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be2300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17811:1875455681704192:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1788574371.013861:0:17811:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574371.013893:0:17811:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85cbce3cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788574371.014954:0:18571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681704192 00000100:00100000:0.0:1788574371.014963:0:18571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681704192 00000100:00100000:0.0:1788574371.015011:0:18571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788574371.015020:0:18571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17811:x1875455681704192:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1788574371.015047:0:18571:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:0.0:1788574371.015113:0:18571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17811:x1875455681704192:12345-0@lo:5:osp-pre-1-1.0 Request processed in 94us (1251us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574371.015120:0:18571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1788574371.015248:0:17811:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c1be2300 x1875455681704192/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788574387 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574371.015271:0:17811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be2300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17811:1875455681704192:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1788574371.015283:0:17811:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1788574371.015317:0:17811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be2300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17811:1875455681704320:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1788574371.015360:0:17811:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574371.015381:0:17811:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85cbce3cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788574371.015530:0:19093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681704320 00000100:00100000:0.0:1788574371.015535:0:19093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681704320 00000100:00100000:0.0:1788574371.015572:0:19093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788574371.015588:0:19093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17811:x1875455681704320:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1788574371.015615:0:19093:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00002000:00080000:2.0:1788574371.020951:0:18574:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:2.0:1788574371.020965:0:18574:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:2.0:1788574371.020981:0:18574:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6 to 0x2c0000401:33) 00002000:00010000:0.0:1788574371.044421:0:18574:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788574371.044433:0:18574:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f946ba40/0x5bf8706fdac8d453 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574371.044462:0:18574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=511s v=(0 0) 00010000:00010000:0.0:1788574371.044466:0:18574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788574371.044472:0:18574:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f946ba40/0x5bf8706fdac8d453 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574371.044490:0:18574:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f946ba40/0x5bf8706fdac8d453 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574371.044501:0:18574:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f946ba40/0x5bf8706fdac8d453 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574371.044509:0:18574:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f946ba40/0x5bf8706fdac8d453 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574371.044528:0:18574:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788574371.045279:0:17055:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788574371.045287:0:17055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f946ba40/0x5bf8706fdac8d453 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.045298:0:17055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85c152f400 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:2.0:1788574371.045302:0:17055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f946ba40/0x5bf8706fdac8d453 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.045311:0:17055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f946ba40/0x5bf8706fdac8d453 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.045329:0:17055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f946ba40/0x5bf8706fdac8d453 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.045338:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f946ba40/0x5bf8706fdac8d453 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.045607:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574371.045610:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574371.045612:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788574371.048963:0:18574:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788574371.048977:0:18574:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000caa9a49e/0x5bf8706fdac8d45a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.048994:0:18574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=511s v=(0 0) 00010000:00010000:2.0:1788574371.048999:0:18574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574371.049013:0:18574:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000caa9a49e/0x5bf8706fdac8d45a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.049028:0:18574:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000caa9a49e/0x5bf8706fdac8d45a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.049039:0:18574:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000caa9a49e/0x5bf8706fdac8d45a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.049046:0:18574:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000caa9a49e/0x5bf8706fdac8d45a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.049069:0:18574:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788574371.050310:0:17056:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788574371.050320:0:17056:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000caa9a49e/0x5bf8706fdac8d45a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574371.050427:0:17056:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32f000 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:0.0:1788574371.050433:0:17056:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000caa9a49e/0x5bf8706fdac8d45a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574371.050451:0:17056:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000caa9a49e/0x5bf8706fdac8d45a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574371.050472:0:17056:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000caa9a49e/0x5bf8706fdac8d45a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574371.050479:0:17056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000caa9a49e/0x5bf8706fdac8d45a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574371.050500:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574371.050502:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788574371.050503:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788574371.051080:0:18574:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788574371.051088:0:18574:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7f41403/0x5bf8706fdac8d461 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.051175:0:18574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=511s v=(0 0) 00010000:00010000:2.0:1788574371.051179:0:18574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574371.051185:0:18574:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7f41403/0x5bf8706fdac8d461 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.051220:0:18574:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e7f41403/0x5bf8706fdac8d461 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.051230:0:18574:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7f41403/0x5bf8706fdac8d461 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.051249:0:18574:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e7f41403/0x5bf8706fdac8d461 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.051264:0:18574:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788574371.051275:0:17055:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788574371.051280:0:17055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e7f41403/0x5bf8706fdac8d461 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.051287:0:17055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32fa00 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:2.0:1788574371.051291:0:17055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7f41403/0x5bf8706fdac8d461 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.051300:0:17055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7f41403/0x5bf8706fdac8d461 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.051312:0:17055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e7f41403/0x5bf8706fdac8d461 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.051319:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7f41403/0x5bf8706fdac8d461 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.051345:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574371.051346:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574371.051348:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788574371.064476:0:18574:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788574371.064494:0:18574:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a77489b/0x5bf8706fdac8d468 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574371.064512:0:18574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=511s v=(0 0) 00010000:00010000:0.0:1788574371.064517:0:18574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788574371.064523:0:18574:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a77489b/0x5bf8706fdac8d468 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574371.064540:0:18574:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a77489b/0x5bf8706fdac8d468 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574371.064552:0:18574:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a77489b/0x5bf8706fdac8d468 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574371.064569:0:18574:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000a77489b/0x5bf8706fdac8d468 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574371.064591:0:18574:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788574371.065216:0:17056:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788574371.065225:0:17056:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000a77489b/0x5bf8706fdac8d468 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574371.065235:0:17056:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85c152f200 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:1.0:1788574371.065240:0:17056:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000a77489b/0x5bf8706fdac8d468 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574371.065250:0:17056:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000a77489b/0x5bf8706fdac8d468 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574371.065281:0:17056:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000a77489b/0x5bf8706fdac8d468 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574371.065289:0:17056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a77489b/0x5bf8706fdac8d468 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574371.065312:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574371.065314:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574371.065315:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788574371.066627:0:18574:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788574371.066638:0:18574:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000110847a6/0x5bf8706fdac8d46f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574371.066653:0:18574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=511s v=(0 0) 00010000:00010000:0.0:1788574371.066657:0:18574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788574371.066663:0:18574:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000110847a6/0x5bf8706fdac8d46f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574371.066675:0:18574:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000110847a6/0x5bf8706fdac8d46f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574371.066684:0:18574:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000110847a6/0x5bf8706fdac8d46f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574371.066691:0:18574:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000110847a6/0x5bf8706fdac8d46f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574371.066748:0:18574:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788574371.071767:0:18574:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788574371.071802:0:18574:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7f41403/0x5bf8706fdac8d476 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.071819:0:18574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=511s v=(0 0) 00010000:00010000:2.0:1788574371.071824:0:18574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574371.071830:0:18574:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7f41403/0x5bf8706fdac8d476 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.071846:0:18574:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e7f41403/0x5bf8706fdac8d476 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.071857:0:18574:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7f41403/0x5bf8706fdac8d476 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.071864:0:18574:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e7f41403/0x5bf8706fdac8d476 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574371.075703:0:17055:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788574371.075718:0:17055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000110847a6/0x5bf8706fdac8d46f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574371.075754:0:17055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85c152f000 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:3.0:1788574371.075759:0:17055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000110847a6/0x5bf8706fdac8d46f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574371.075780:0:17055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000110847a6/0x5bf8706fdac8d46f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574371.075807:0:17055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000110847a6/0x5bf8706fdac8d46f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574371.075816:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000110847a6/0x5bf8706fdac8d46f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574371.075843:0:17055:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788574371.075848:0:17055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e7f41403/0x5bf8706fdac8d476 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574371.075854:0:17055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32fa00 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:3.0:1788574371.075857:0:17055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7f41403/0x5bf8706fdac8d476 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574371.075865:0:17055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7f41403/0x5bf8706fdac8d476 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574371.075875:0:17055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e7f41403/0x5bf8706fdac8d476 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574371.075890:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574371.075892:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574371.075894:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788574371.076345:0:19386:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:3.0:1788574371.076370:0:19386:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1788574371.076376:0:19386:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1788574371.077374:0:18574:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788574371.077386:0:18574:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7f41403/0x5bf8706fdac8d476 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574371.077510:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788574371.087815:0:18574:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788574371.087829:0:18574:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000caa9a49e/0x5bf8706fdac8d47d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.087846:0:18574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=511s v=(0 0) 00010000:00010000:2.0:1788574371.087851:0:18574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574371.087865:0:18574:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000caa9a49e/0x5bf8706fdac8d47d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.087882:0:18574:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000caa9a49e/0x5bf8706fdac8d47d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.087892:0:18574:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000caa9a49e/0x5bf8706fdac8d47d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.087900:0:18574:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000caa9a49e/0x5bf8706fdac8d47d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.087922:0:18574:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788574371.087934:0:17055:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788574371.087940:0:17055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000caa9a49e/0x5bf8706fdac8d47d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.087947:0:17055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32f000 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:2.0:1788574371.087951:0:17055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000caa9a49e/0x5bf8706fdac8d47d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.087961:0:17055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000caa9a49e/0x5bf8706fdac8d47d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.087977:0:17055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000caa9a49e/0x5bf8706fdac8d47d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.087995:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000caa9a49e/0x5bf8706fdac8d47d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.088014:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574371.088016:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574371.088018:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788574371.089354:0:18574:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788574371.089365:0:18574:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000038f238a0/0x5bf8706fdac8d484 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.089380:0:18574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=511s v=(0 0) 00010000:00010000:2.0:1788574371.089384:0:18574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574371.089390:0:18574:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000038f238a0/0x5bf8706fdac8d484 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.089401:0:18574:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000038f238a0/0x5bf8706fdac8d484 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.089409:0:18574:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000038f238a0/0x5bf8706fdac8d484 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.089416:0:18574:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000038f238a0/0x5bf8706fdac8d484 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.089432:0:18574:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788574371.090037:0:17056:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788574371.090047:0:17056:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000038f238a0/0x5bf8706fdac8d484 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574371.090056:0:17056:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32f800 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:1.0:1788574371.090060:0:17056:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000038f238a0/0x5bf8706fdac8d484 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574371.090069:0:17056:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000038f238a0/0x5bf8706fdac8d484 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574371.090086:0:17056:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000038f238a0/0x5bf8706fdac8d484 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574371.090105:0:17056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000038f238a0/0x5bf8706fdac8d484 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574371.090139:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574371.090141:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574371.090143:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788574371.092380:0:18574:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788574371.092394:0:18574:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a209186/0x5bf8706fdac8d48b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574371.092411:0:18574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=511s v=(0 0) 00010000:00010000:3.0:1788574371.092415:0:18574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574371.092421:0:18574:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a209186/0x5bf8706fdac8d48b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574371.092436:0:18574:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a209186/0x5bf8706fdac8d48b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574371.092445:0:18574:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a209186/0x5bf8706fdac8d48b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574371.092452:0:18574:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007a209186/0x5bf8706fdac8d48b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574371.092475:0:18574:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788574371.092995:0:17055:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788574371.093003:0:17055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007a209186/0x5bf8706fdac8d48b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574371.093013:0:17055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c84c2617200 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:1.0:1788574371.093018:0:17055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007a209186/0x5bf8706fdac8d48b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574371.093027:0:17055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007a209186/0x5bf8706fdac8d48b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574371.093044:0:17055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007a209186/0x5bf8706fdac8d48b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574371.093052:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a209186/0x5bf8706fdac8d48b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574371.093072:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574371.093074:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574371.093076:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788574371.093270:0:18574:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788574371.093285:0:18574:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4394f93/0x5bf8706fdac8d492 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574371.093293:0:18574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=511s v=(0 0) 00010000:00010000:3.0:1788574371.093296:0:18574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574371.093300:0:18574:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4394f93/0x5bf8706fdac8d492 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574371.093309:0:18574:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c4394f93/0x5bf8706fdac8d492 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574371.093318:0:18574:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4394f93/0x5bf8706fdac8d492 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574371.093512:0:18574:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c4394f93/0x5bf8706fdac8d492 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574371.093528:0:18574:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788574371.093793:0:17056:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788574371.093799:0:17056:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c4394f93/0x5bf8706fdac8d492 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574371.093819:0:17056:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c84c2617c00 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:1.0:1788574371.093823:0:17056:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4394f93/0x5bf8706fdac8d492 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574371.093831:0:17056:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4394f93/0x5bf8706fdac8d492 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574371.093843:0:17056:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c4394f93/0x5bf8706fdac8d492 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574371.093850:0:17056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c4394f93/0x5bf8706fdac8d492 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574371.093865:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574371.093867:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574371.093868:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574371.094013:0:19093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:17811:x1875455681704320:12345-0@lo:5:osp-pre-1-1.0 Request processed in 78422us (78649us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788574371.094023:0:19093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788574371.094076:0:17811:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1788574371.094084:0:17811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be2300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17811:1875455681704320:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1788574371.094240:0:17811:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1788574371.094297:0:17811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17811:1875455681704448:0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1788574371.094343:0:17811:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574371.094479:0:17811:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85cbce3cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788574371.094498:0:17078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681704448 00000100:00100000:1.0:1788574371.094504:0:17078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681704448 00000100:00100000:1.0:1788574371.094549:0:17078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788574371.094559:0:17078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c335c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17811:x1875455681704448:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1788574371.094609:0:17078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c335c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17811:x1875455681704448:12345-0@lo:900:osp-pre-1-1.0 Request processed in 52us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574371.094616:0:17078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788574371.094649:0:17811:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c335d500 x1875455681704448/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788574387 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574371.094659:0:17811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17811:1875455681704448:0@lo:900:osp-pre-1-1.0 00002000:00010000:3.0:1788574371.095521:0:18574:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788574371.095530:0:18574:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008db64c4d/0x5bf8706fdac8d499 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574371.095544:0:18574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=511s v=(0 0) 00010000:00010000:3.0:1788574371.095548:0:18574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574371.095554:0:18574:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008db64c4d/0x5bf8706fdac8d499 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574371.095566:0:18574:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008db64c4d/0x5bf8706fdac8d499 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574371.095584:0:18574:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008db64c4d/0x5bf8706fdac8d499 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574371.095591:0:18574:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008db64c4d/0x5bf8706fdac8d499 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574371.095606:0:18574:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788574371.097065:0:17055:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788574371.097077:0:17055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008db64c4d/0x5bf8706fdac8d499 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574371.098207:0:17055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c84c2617400 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:1.0:1788574371.098214:0:17055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008db64c4d/0x5bf8706fdac8d499 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574371.098228:0:17055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008db64c4d/0x5bf8706fdac8d499 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574371.098250:0:17055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008db64c4d/0x5bf8706fdac8d499 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574371.098257:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008db64c4d/0x5bf8706fdac8d499 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574371.098292:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574371.098295:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574371.098297:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788574371.099812:0:18574:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788574371.099825:0:18574:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006315ccc8/0x5bf8706fdac8d4a0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574371.099840:0:18574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=511s v=(0 0) 00010000:00010000:3.0:1788574371.099845:0:18574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574371.099851:0:18574:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006315ccc8/0x5bf8706fdac8d4a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574371.099865:0:18574:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006315ccc8/0x5bf8706fdac8d4a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574371.099874:0:18574:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006315ccc8/0x5bf8706fdac8d4a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574371.099881:0:18574:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006315ccc8/0x5bf8706fdac8d4a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574371.099918:0:18574:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788574371.100479:0:18574:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788574371.100486:0:18574:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054f395a1/0x5bf8706fdac8d4a7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574371.100495:0:18574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=511s v=(0 0) 00010000:00010000:3.0:1788574371.100499:0:18574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574371.100503:0:18574:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054f395a1/0x5bf8706fdac8d4a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574371.100513:0:18574:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000054f395a1/0x5bf8706fdac8d4a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574371.100521:0:18574:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054f395a1/0x5bf8706fdac8d4a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574371.100528:0:18574:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000054f395a1/0x5bf8706fdac8d4a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574371.100543:0:18574:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788574371.102141:0:17056:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788574371.102153:0:17056:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006315ccc8/0x5bf8706fdac8d4a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574371.102167:0:17056:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85faea2400 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:1.0:1788574371.102171:0:17056:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006315ccc8/0x5bf8706fdac8d4a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574371.102182:0:17056:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006315ccc8/0x5bf8706fdac8d4a0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574371.102218:0:17056:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006315ccc8/0x5bf8706fdac8d4a0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574371.102227:0:17056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006315ccc8/0x5bf8706fdac8d4a0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574371.102249:0:17056:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788574371.102253:0:17056:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000054f395a1/0x5bf8706fdac8d4a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574371.102259:0:17056:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85faea2a00 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:1.0:1788574371.102277:0:17056:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000054f395a1/0x5bf8706fdac8d4a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574371.102285:0:17056:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000054f395a1/0x5bf8706fdac8d4a7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574371.102297:0:17056:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000054f395a1/0x5bf8706fdac8d4a7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574371.102303:0:17056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054f395a1/0x5bf8706fdac8d4a7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574371.102317:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574371.102318:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574371.102320:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574371.102340:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788574371.103416:0:18574:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788574371.103428:0:18574:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ded2c3cf/0x5bf8706fdac8d4ae lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574371.103443:0:18574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=511s v=(0 0) 00010000:00010000:3.0:1788574371.103453:0:18574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574371.103460:0:18574:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ded2c3cf/0x5bf8706fdac8d4ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574371.103475:0:18574:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ded2c3cf/0x5bf8706fdac8d4ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574371.103484:0:18574:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ded2c3cf/0x5bf8706fdac8d4ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574371.103491:0:18574:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ded2c3cf/0x5bf8706fdac8d4ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574371.103508:0:18574:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788574371.104068:0:18574:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788574371.104074:0:18574:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049b5e2c1/0x5bf8706fdac8d4b5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574371.104084:0:18574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=511s v=(0 0) 00010000:00010000:3.0:1788574371.104087:0:18574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574371.104091:0:18574:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049b5e2c1/0x5bf8706fdac8d4b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574371.104101:0:18574:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049b5e2c1/0x5bf8706fdac8d4b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574371.104109:0:18574:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000049b5e2c1/0x5bf8706fdac8d4b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574371.104122:0:18574:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000049b5e2c1/0x5bf8706fdac8d4b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574371.104208:0:18574:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788574371.106421:0:18574:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788574371.106434:0:18574:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074960dfc/0x5bf8706fdac8d4bc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574371.106451:0:18574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=511s v=(0 0) 00010000:00010000:3.0:1788574371.106456:0:18574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574371.106490:0:18574:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074960dfc/0x5bf8706fdac8d4bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574371.106515:0:18574:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074960dfc/0x5bf8706fdac8d4bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574371.106539:0:18574:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074960dfc/0x5bf8706fdac8d4bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574371.106546:0:18574:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000074960dfc/0x5bf8706fdac8d4bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.115557:0:17055:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788574371.115588:0:17055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ded2c3cf/0x5bf8706fdac8d4ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.115602:0:17055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85faea3c00 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:2.0:1788574371.115608:0:17055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ded2c3cf/0x5bf8706fdac8d4ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.115620:0:17055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ded2c3cf/0x5bf8706fdac8d4ae lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.115642:0:17055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ded2c3cf/0x5bf8706fdac8d4ae lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.115650:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ded2c3cf/0x5bf8706fdac8d4ae lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.115679:0:17055:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788574371.115684:0:17055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000049b5e2c1/0x5bf8706fdac8d4b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.115691:0:17055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85faea3a00 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:2.0:1788574371.115694:0:17055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000049b5e2c1/0x5bf8706fdac8d4b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.115701:0:17055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000049b5e2c1/0x5bf8706fdac8d4b5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.115724:0:17055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000049b5e2c1/0x5bf8706fdac8d4b5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.115731:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049b5e2c1/0x5bf8706fdac8d4b5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.115745:0:17055:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788574371.115748:0:17055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000074960dfc/0x5bf8706fdac8d4bc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.115755:0:17055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85faea3400 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:2.0:1788574371.115758:0:17055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000074960dfc/0x5bf8706fdac8d4bc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.115765:0:17055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000074960dfc/0x5bf8706fdac8d4bc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.115786:0:17055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000074960dfc/0x5bf8706fdac8d4bc lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.115793:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574371.115795:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574371.115797:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574371.116033:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574371.116633:0:18574:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788574371.116641:0:18574:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074960dfc/0x5bf8706fdac8d4bc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.117474:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788574371.123393:0:18574:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788574371.123411:0:18574:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000caa9a49e/0x5bf8706fdac8d4c3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.123445:0:18574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=511s v=(0 0) 00010000:00010000:2.0:1788574371.123449:0:18574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574371.123456:0:18574:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000caa9a49e/0x5bf8706fdac8d4c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.123471:0:18574:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000caa9a49e/0x5bf8706fdac8d4c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.123482:0:18574:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000caa9a49e/0x5bf8706fdac8d4c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.123490:0:18574:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000caa9a49e/0x5bf8706fdac8d4c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.123517:0:18574:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788574371.127495:0:18574:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788574371.127509:0:18574:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7f41403/0x5bf8706fdac8d4ca lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.127526:0:18574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=511s v=(0 0) 00010000:00010000:2.0:1788574371.127530:0:18574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574371.127537:0:18574:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7f41403/0x5bf8706fdac8d4ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.127551:0:18574:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e7f41403/0x5bf8706fdac8d4ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.127575:0:18574:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7f41403/0x5bf8706fdac8d4ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.127582:0:18574:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e7f41403/0x5bf8706fdac8d4ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.127599:0:18574:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788574371.127611:0:17055:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788574371.127617:0:17055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000caa9a49e/0x5bf8706fdac8d4c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.127625:0:17055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32f000 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:2.0:1788574371.127630:0:17055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000caa9a49e/0x5bf8706fdac8d4c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.127640:0:17055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000caa9a49e/0x5bf8706fdac8d4c3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.127657:0:17055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000caa9a49e/0x5bf8706fdac8d4c3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.127665:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000caa9a49e/0x5bf8706fdac8d4c3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.127683:0:17055:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788574371.127693:0:17055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e7f41403/0x5bf8706fdac8d4ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.127699:0:17055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32fa00 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:2.0:1788574371.127702:0:17055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7f41403/0x5bf8706fdac8d4ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.127709:0:17055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7f41403/0x5bf8706fdac8d4ca lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.127718:0:17055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e7f41403/0x5bf8706fdac8d4ca lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.127724:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7f41403/0x5bf8706fdac8d4ca lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.127736:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574371.127738:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574371.127740:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574371.133160:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788574371.133667:0:18574:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788574371.133679:0:18574:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea8df3f9/0x5bf8706fdac8d4d1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.133696:0:18574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=511s v=(0 0) 00010000:00010000:2.0:1788574371.133701:0:18574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574371.133708:0:18574:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea8df3f9/0x5bf8706fdac8d4d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.133738:0:18574:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea8df3f9/0x5bf8706fdac8d4d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.133749:0:18574:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea8df3f9/0x5bf8706fdac8d4d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.133758:0:18574:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ea8df3f9/0x5bf8706fdac8d4d1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.133785:0:18574:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788574371.133796:0:17055:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788574371.133801:0:17055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ea8df3f9/0x5bf8706fdac8d4d1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.133809:0:17055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32f400 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:2.0:1788574371.133814:0:17055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea8df3f9/0x5bf8706fdac8d4d1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.133823:0:17055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea8df3f9/0x5bf8706fdac8d4d1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.133839:0:17055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ea8df3f9/0x5bf8706fdac8d4d1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.133847:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea8df3f9/0x5bf8706fdac8d4d1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.133872:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574371.133873:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574371.133875:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788574371.134894:0:18574:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788574371.134903:0:18574:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097d9bd86/0x5bf8706fdac8d4d8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.134915:0:18574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=511s v=(0 0) 00010000:00010000:2.0:1788574371.134918:0:18574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574371.134923:0:18574:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000097d9bd86/0x5bf8706fdac8d4d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.134934:0:18574:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000097d9bd86/0x5bf8706fdac8d4d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.134942:0:18574:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097d9bd86/0x5bf8706fdac8d4d8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.134949:0:18574:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000097d9bd86/0x5bf8706fdac8d4d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.134969:0:18574:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788574371.135315:0:17056:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788574371.135328:0:17056:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000097d9bd86/0x5bf8706fdac8d4d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574371.135336:0:17056:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32e600 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:1.0:1788574371.135340:0:17056:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000097d9bd86/0x5bf8706fdac8d4d8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574371.135349:0:17056:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000097d9bd86/0x5bf8706fdac8d4d8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574371.135376:0:17056:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000097d9bd86/0x5bf8706fdac8d4d8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574371.135383:0:17056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000097d9bd86/0x5bf8706fdac8d4d8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574371.135399:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574371.135401:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574371.135403:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788574371.140532:0:18574:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788574371.140547:0:18574:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094e7cef2/0x5bf8706fdac8d4df lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.140584:0:18574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=511s v=(0 0) 00010000:00010000:2.0:1788574371.140589:0:18574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574371.140596:0:18574:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000094e7cef2/0x5bf8706fdac8d4df lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.140611:0:18574:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000094e7cef2/0x5bf8706fdac8d4df lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.140621:0:18574:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094e7cef2/0x5bf8706fdac8d4df lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.140628:0:18574:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000094e7cef2/0x5bf8706fdac8d4df lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.140658:0:18574:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788574371.140900:0:17055:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788574371.140907:0:17055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000094e7cef2/0x5bf8706fdac8d4df lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574371.140916:0:17055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32e200 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:3.0:1788574371.140921:0:17055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000094e7cef2/0x5bf8706fdac8d4df lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574371.140930:0:17055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000094e7cef2/0x5bf8706fdac8d4df lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574371.140948:0:17055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000094e7cef2/0x5bf8706fdac8d4df lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574371.140955:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000094e7cef2/0x5bf8706fdac8d4df lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574371.140975:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574371.140977:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574371.140979:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788574371.142017:0:18574:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788574371.142027:0:18574:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088381fcf/0x5bf8706fdac8d4e6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.142042:0:18574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=511s v=(0 0) 00010000:00010000:2.0:1788574371.142046:0:18574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574371.142052:0:18574:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088381fcf/0x5bf8706fdac8d4e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.142062:0:18574:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088381fcf/0x5bf8706fdac8d4e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.142096:0:18574:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088381fcf/0x5bf8706fdac8d4e6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.142104:0:18574:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000088381fcf/0x5bf8706fdac8d4e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.142125:0:18574:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788574371.142536:0:17056:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788574371.142543:0:17056:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000088381fcf/0x5bf8706fdac8d4e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574371.142551:0:17056:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32fc00 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:1.0:1788574371.142555:0:17056:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000088381fcf/0x5bf8706fdac8d4e6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574371.142563:0:17056:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000088381fcf/0x5bf8706fdac8d4e6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574371.142579:0:17056:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000088381fcf/0x5bf8706fdac8d4e6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574371.142586:0:17056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088381fcf/0x5bf8706fdac8d4e6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574371.142615:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574371.142617:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574371.142618:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788574371.147927:0:18574:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788574371.147944:0:18574:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000038f238a0/0x5bf8706fdac8d4ed lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.147962:0:18574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=511s v=(0 0) 00010000:00010000:2.0:1788574371.147967:0:18574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574371.147973:0:18574:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000038f238a0/0x5bf8706fdac8d4ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.147988:0:18574:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000038f238a0/0x5bf8706fdac8d4ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.147999:0:18574:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000038f238a0/0x5bf8706fdac8d4ed lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.148006:0:18574:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000038f238a0/0x5bf8706fdac8d4ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.148047:0:18574:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788574371.148602:0:17055:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788574371.148610:0:17055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000038f238a0/0x5bf8706fdac8d4ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574371.148619:0:17055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32f800 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:3.0:1788574371.148630:0:17055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000038f238a0/0x5bf8706fdac8d4ed lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574371.148639:0:17055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000038f238a0/0x5bf8706fdac8d4ed lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574371.148656:0:17055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000038f238a0/0x5bf8706fdac8d4ed lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574371.148663:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000038f238a0/0x5bf8706fdac8d4ed lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574371.148682:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574371.148684:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574371.148686:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788574371.148781:0:18574:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788574371.148788:0:18574:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007fd618c/0x5bf8706fdac8d4f4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.148797:0:18574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=511s v=(0 0) 00010000:00010000:2.0:1788574371.148800:0:18574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574371.148805:0:18574:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000007fd618c/0x5bf8706fdac8d4f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.148814:0:18574:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000007fd618c/0x5bf8706fdac8d4f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.148822:0:18574:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007fd618c/0x5bf8706fdac8d4f4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.148829:0:18574:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000007fd618c/0x5bf8706fdac8d4f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.148850:0:18574:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788574371.149158:0:17056:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788574371.149164:0:17056:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000007fd618c/0x5bf8706fdac8d4f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574371.149173:0:17056:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c860217fc00 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:1.0:1788574371.149176:0:17056:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000007fd618c/0x5bf8706fdac8d4f4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574371.149185:0:17056:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000007fd618c/0x5bf8706fdac8d4f4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574371.149224:0:17056:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000007fd618c/0x5bf8706fdac8d4f4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574371.149231:0:17056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000007fd618c/0x5bf8706fdac8d4f4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574371.149247:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574371.149249:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574371.149250:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788574371.149371:0:18574:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788574371.149377:0:18574:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d1084fd/0x5bf8706fdac8d4fb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.149391:0:18574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=511s v=(0 0) 00010000:00010000:2.0:1788574371.149403:0:18574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574371.149408:0:18574:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d1084fd/0x5bf8706fdac8d4fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.149418:0:18574:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d1084fd/0x5bf8706fdac8d4fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.149425:0:18574:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d1084fd/0x5bf8706fdac8d4fb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.149431:0:18574:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005d1084fd/0x5bf8706fdac8d4fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574371.149450:0:18574:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788574371.149574:0:17055:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788574371.149580:0:17055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005d1084fd/0x5bf8706fdac8d4fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574371.149586:0:17055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c860217e000 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:3.0:1788574371.149589:0:17055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005d1084fd/0x5bf8706fdac8d4fb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574371.149597:0:17055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005d1084fd/0x5bf8706fdac8d4fb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574371.149606:0:17055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005d1084fd/0x5bf8706fdac8d4fb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574371.149619:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d1084fd/0x5bf8706fdac8d4fb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574371.149635:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574371.149637:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574371.149639:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788574371.152569:0:18574:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788574371.152584:0:18574:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074960dfc/0x5bf8706fdac8d502 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574371.152601:0:18574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=511s v=(0 0) 00010000:00010000:3.0:1788574371.152606:0:18574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574371.152612:0:18574:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074960dfc/0x5bf8706fdac8d502 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574371.152626:0:18574:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074960dfc/0x5bf8706fdac8d502 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574371.152636:0:18574:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074960dfc/0x5bf8706fdac8d502 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574371.152643:0:18574:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000074960dfc/0x5bf8706fdac8d502 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574371.152660:0:18574:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788574371.153108:0:18574:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788574371.153120:0:18574:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000871b6422/0x5bf8706fdac8d509 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574371.153130:0:18574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=511s v=(0 0) 00010000:00010000:3.0:1788574371.153133:0:18574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574371.153137:0:18574:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000871b6422/0x5bf8706fdac8d509 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574371.153146:0:18574:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000871b6422/0x5bf8706fdac8d509 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574371.153153:0:18574:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000871b6422/0x5bf8706fdac8d509 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574371.153161:0:18574:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000871b6422/0x5bf8706fdac8d509 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574371.153173:0:18574:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788574371.153543:0:18574:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788574371.153549:0:18574:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089634dfb/0x5bf8706fdac8d510 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574371.153558:0:18574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=511s v=(0 0) 00010000:00010000:3.0:1788574371.153561:0:18574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574371.153565:0:18574:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000089634dfb/0x5bf8706fdac8d510 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574371.153573:0:18574:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000089634dfb/0x5bf8706fdac8d510 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574371.153586:0:18574:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089634dfb/0x5bf8706fdac8d510 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574371.153594:0:18574:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000089634dfb/0x5bf8706fdac8d510 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574371.153602:0:18574:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00080000:3.0:1788574371.153633:0:18574:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:5 00000100:00100000:3.0:1788574371.153733:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2bdf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:17094:x1875455681704064:12345-0@lo:5:osp-pre-1-0.0 Request processed in 160876us (161611us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574371.153742:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:1.0:1788574371.153844:0:17056:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788574371.153851:0:17056:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000074960dfc/0x5bf8706fdac8d502 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574371.153870:0:17056:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85faea3400 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:1.0:1788574371.153875:0:17056:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000074960dfc/0x5bf8706fdac8d502 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574371.153886:0:17056:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000074960dfc/0x5bf8706fdac8d502 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574371.153903:0:17056:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000074960dfc/0x5bf8706fdac8d502 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574371.153911:0:17056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074960dfc/0x5bf8706fdac8d502 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574371.153927:0:17056:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788574371.153930:0:17056:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000871b6422/0x5bf8706fdac8d509 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574371.153936:0:17056:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85faea3000 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:1.0:1788574371.153939:0:17056:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000871b6422/0x5bf8706fdac8d509 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574371.153945:0:17056:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000871b6422/0x5bf8706fdac8d509 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574371.153955:0:17056:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000871b6422/0x5bf8706fdac8d509 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574371.153968:0:17056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000871b6422/0x5bf8706fdac8d509 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574371.153980:0:17056:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788574371.153983:0:17056:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000089634dfb/0x5bf8706fdac8d510 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574371.153989:0:17056:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85faea3200 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:1.0:1788574371.153991:0:17056:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000089634dfb/0x5bf8706fdac8d510 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574371.154000:0:17056:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000089634dfb/0x5bf8706fdac8d510 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574371.154009:0:17056:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000089634dfb/0x5bf8706fdac8d510 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574371.154016:0:17056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000089634dfb/0x5bf8706fdac8d510 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574371.154026:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574371.154028:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574371.154029:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574371.156276:0:17094:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c2bdf480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17094:1875455681704064:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788574371.156307:0:17094:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x5:0x0] 00000100:00100000:0.0:1788574371.156521:0:17094:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c2bdf480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17094:1875455681704576:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788574371.156587:0:17094:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574371.156629:0:17094:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85d20f1e40 going to sleep for 11 seconds 00010000:00010000:2.0:1788574371.156817:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574371.156867:0:18571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681704576 00000100:00100000:3.0:1788574371.156875:0:18571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681704576 00000100:00100000:3.0:1788574371.156932:0:18571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788574371.156941:0:18571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2bdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:17094:x1875455681704576:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1788574371.156980:0:18571:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00000100:00100000:0.0:1788574371.175936:0:18571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2bdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17094:x1875455681704576:12345-0@lo:5:osp-pre-1-0.0 Request processed in 18988us (19341us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1788574371.175948:0:18571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788574371.179425:0:17094:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c2bdf480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17094:1875455681704576:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788574371.179451:0:17094:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00010000:00010000:1.0:1788574371.284695:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788574372.311998:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788574372.758626:0:17104:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788574373.331392:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574373.524544:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788574373.524572:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c2f45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681704704:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788574373.524646:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574373.524852:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681704704 00000100:00100000:2.0:1788574373.524860:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681704704 00000100:00100000:2.0:1788574373.524929:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788574373.524940:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681704704:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788574373.524972:0:18575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788574373.525028:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681704704:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574373.525035:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788574373.525083:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c2f45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681704704:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788574373.525140:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:2.0:1788574374.245370:0:19742:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg451-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788574374.367368:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574375.059655:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788574375.059691:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c2bddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681704832:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788574375.059771:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574375.059941:0:17807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681704832 00000100:00100000:0.0:1788574375.059949:0:17807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681704832 00000100:00100000:0.0:1788574375.060002:0:17807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788574375.060025:0:17807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c335d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681704832:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788574375.060059:0:17807:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788574375.060105:0:17807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c335d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681704832:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574375.060113:0:17807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788574375.060490:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c2bddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681704832:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788574375.062547:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788574375.062568:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681704960:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788574375.062641:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574375.062714:0:17072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681704960 00000100:00100000:3.0:1788574375.062722:0:17072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681704960 00000100:00100000:3.0:1788574375.062915:0:17072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788574375.062925:0:17072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681704960:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788574375.062957:0:17072:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788574375.063003:0:17072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681704960:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574375.063010:0:17072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788574375.063054:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681704960:0@lo:41:osp-pre-1-0.0 00000020:00000004:2.0:1788574375.223434:0:19795:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788574375.223668:0:19795:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788574375.379406:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574375.575554:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681705088:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788574375.575632:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574375.575708:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681705088 00000100:00100000:3.0:1788574375.575715:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681705088 00000100:00100000:3.0:1788574375.575783:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788574375.575792:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681705088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788574375.575826:0:18575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788574375.575865:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681705088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574375.575877:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1788574375.575896:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788574375.575929:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681705088:0@lo:13:osp-pre-0-0.0 00000020:00000004:0.0:1788574376.061858:0:19845:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788574376.062390:0:19845:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788574376.084775:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681705344:0@lo:400:kworker.0 00000100:00100000:3.0:1788574376.084855:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574376.085784:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3da5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681705856:0@lo:400:kworker.0 00000100:00100000:3.0:1788574376.085831:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574376.085850:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3da4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3618:1875455681706368:0@lo:400:kworker.0 00000100:00100000:1.0:1788574376.086011:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3c0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f73678fb-d8c0-450f-a73b-e6565942045e:3617:1875455681705216:0@lo:400:kworker.0 00000100:00100000:0.0:1788574376.088253:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681705344 00000100:00100000:0.0:1788574376.088270:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681705344 00000100:00100000:0.0:1788574376.088315:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681705856 00000100:00100000:0.0:1788574376.088318:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681705856 00000100:00100000:0.0:1788574376.088332:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788574376.088339:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3da6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681705344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574376.090242:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574376.090296:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3da5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875455681705728:0@lo:400:kworker.0 00000100:00100000:1.0:1788574376.090329:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574376.090362:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3da5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875455681706240:0@lo:400:kworker.0 00000100:00100000:1.0:1788574376.090382:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574376.090398:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3da6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1875455681706752:0@lo:400:kworker.0 00000100:00100000:1.0:1788574376.090421:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574376.090446:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788574376.090454:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681706880:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788574376.090484:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574376.090516:0:18898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681705728 00000100:00100000:1.0:1788574376.090523:0:18898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681705728 00000100:00100000:1.0:1788574376.090559:0:18898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681706240 00000100:00100000:2.0:1788574376.090734:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681705216 00000100:00100000:2.0:1788574376.090739:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681705216 00000100:00100000:1.0:1788574376.090781:0:18898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681706240 00000100:00100000:1.0:1788574376.090797:0:18898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681706752 00000100:00100000:1.0:1788574376.090799:0:18898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681706752 00000100:00100000:1.0:1788574376.090825:0:18898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788574376.090833:0:18898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c335f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875455681705728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574376.090998:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788574376.091007:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c536ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f73678fb-d8c0-450f-a73b-e6565942045e+24:3617:x1875455681705216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574376.091052:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c536ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f73678fb-d8c0-450f-a73b-e6565942045e+24:3617:x1875455681705216:12345-0@lo:400:kworker.0 Request processed in 47us (817us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574376.091059:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788574376.091119:0:18898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c335f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875455681705728:12345-0@lo:400:kworker.0 Request processed in 286us (789us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574376.091126:0:18898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788574376.091139:0:18898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788574376.091156:0:18898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c335d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875455681706240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574376.091186:0:18898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c335d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875455681706240:12345-0@lo:400:kworker.0 Request processed in 31us (803us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574376.091210:0:18898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788574376.091249:0:18898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788574376.091256:0:18898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c335f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875455681706752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574376.091328:0:18898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c335f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875455681706752:12345-0@lo:400:kworker.0 Request processed in 73us (906us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574376.091345:0:18898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788574376.091373:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681706880 00000100:00100000:1.0:1788574376.091378:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681706880 00000100:00100000:1.0:1788574376.091407:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788574376.091413:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3727800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681706880:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788574376.091437:0:18575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788574376.091468:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3727800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681706880:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (983us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574376.091473:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1788574376.091490:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788574376.091494:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788574376.091529:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681706880:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788574376.091540:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3c0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f73678fb-d8c0-450f-a73b-e6565942045e:3617:1875455681705216:0@lo:400:kworker.0 00010000:00080000:1.0:1788574376.091552:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3da5880 x1875455681705728/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574392 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574376.091802:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3da5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681705600:0@lo:400:kworker.0 00000100:00100000:2.0:1788574376.091832:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574376.091855:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3da6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681706112:0@lo:400:kworker.0 00000100:00100000:1.0:1788574376.091939:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3da5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875455681705728:0@lo:400:kworker.0 00010000:00080000:1.0:1788574376.091956:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3da5500 x1875455681706240/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574392 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574376.091974:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3da5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875455681706240:0@lo:400:kworker.0 00010000:00080000:1.0:1788574376.091987:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3da6300 x1875455681706752/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574392 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574376.091995:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3da6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1875455681706752:0@lo:400:kworker.0 00000100:00100000:1.0:1788574376.092038:0:19093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681705600 00000100:00100000:1.0:1788574376.092042:0:19093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681705600 00000100:00100000:1.0:1788574376.092074:0:19093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788574376.092080:0:19093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de939500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3620:x1875455681705600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574376.092111:0:19093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de939500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3620:x1875455681705600:12345-0@lo:400:kworker.0 Request processed in 32us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574376.092117:0:19093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1788574376.092131:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788574376.092322:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574376.092464:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3da4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3620:1875455681706624:0@lo:400:kworker.0 00000100:00100000:2.0:1788574376.092495:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574376.092522:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3da5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681705600:0@lo:400:kworker.0 00000100:00100000:2.0:1788574376.092532:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1788574376.092538:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3da6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681705472:0@lo:400:kworker.0 00000100:00100000:2.0:1788574376.092557:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574376.092892:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574376.092934:0:17072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788574376.092944:0:17072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3da5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681705856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574376.092985:0:17072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3da5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681705856:12345-0@lo:400:kworker.0 Request processed in 43us (7153us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574376.093003:0:17072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788574376.093146:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3da7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681705984:0@lo:400:kworker.0 00000100:00100000:2.0:1788574376.093180:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574376.093291:0:18573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681706112 00000100:00100000:1.0:1788574376.093296:0:18573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681706112 00000100:00100000:0.0:1788574376.093341:0:18571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681705472 00000100:00100000:0.0:1788574376.093347:0:18571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681705472 00000100:00100000:1.0:1788574376.093348:0:18573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788574376.093357:0:18573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de938a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681706112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574376.093398:0:18573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de938a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681706112:12345-0@lo:400:kworker.0 Request processed in 42us (1076us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574376.093405:0:18573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788574376.093422:0:18898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681706624 00000100:00100000:1.0:1788574376.093425:0:18898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681706624 00000100:00100000:1.0:1788574376.093448:0:18898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681706368 00000100:00100000:1.0:1788574376.093451:0:18898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681706368 00000100:00100000:1.0:1788574376.093467:0:18898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788574376.093472:0:18898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de93a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875455681706624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574376.093515:0:18898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de93a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875455681706624:12345-0@lo:400:kworker.0 Request processed in 43us (1019us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574376.093522:0:18898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788574376.093533:0:18898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788574376.093539:0:18898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3da7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875455681706368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574376.093600:0:18571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788574376.093607:0:18571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de938e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681705472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574376.093646:0:18571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de938e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681705472:12345-0@lo:400:kworker.0 Request processed in 40us (1088us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574376.093781:0:18898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3da7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3618:x1875455681706368:12345-0@lo:400:kworker.0 Request processed in 24us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574376.093788:0:18898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:1.0:1788574376.093812:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788574376.093970:0:18571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788574376.094154:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681705344:0@lo:400:kworker.0 00000100:00100000:0.0:1788574376.094211:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3da6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681705344:12345-0@lo:400:kworker.0 Request processed in 5848us (9333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574376.094220:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788574376.094381:0:19093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681705984 00000100:00100000:1.0:1788574376.094386:0:19093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681705984 00000100:00100000:1.0:1788574376.094421:0:19093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788574376.094428:0:19093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de938380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681705984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574376.094468:0:19093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de938380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681705984:12345-0@lo:400:kworker.0 Request processed in 40us (1287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574376.094474:0:19093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1788574376.094488:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788574376.098941:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3da7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681705984:0@lo:400:kworker.0 00000100:00100000:2.0:1788574376.098960:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3da7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3620:1875455681706496:0@lo:400:kworker.0 00000100:00100000:2.0:1788574376.099035:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574376.099093:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c2f45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681707008:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788574376.099121:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574376.099261:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3da6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681706112:0@lo:400:kworker.0 00010000:00080000:2.0:1788574376.099276:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3da4e00 x1875455681706624/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574392 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574376.099287:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3da4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3620:1875455681706624:0@lo:400:kworker.0 00000100:00100000:2.0:1788574376.099319:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3da6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681705472:0@lo:400:kworker.0 00000100:00100000:3.0:1788574376.099348:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3da5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681705856:0@lo:400:kworker.0 00000100:00100000:1.0:1788574376.099444:0:18898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681706496 00000100:00100000:1.0:1788574376.099451:0:18898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681706496 00000100:00100000:1.0:1788574376.099510:0:18898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788574376.099519:0:18898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85de939f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875455681706496:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1788574376.099557:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3da4380 x1875455681706368/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574392 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574376.099569:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3da4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3618:1875455681706368:0@lo:400:kworker.0 00000100:00100000:1.0:1788574376.099711:0:18898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85de939f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875455681706496:12345-0@lo:400:kworker.0 Request processed in 193us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574376.099719:0:18898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:1.0:1788574376.099742:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1788574376.099940:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3da7800 x1875455681706496/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574392 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788574376.099962:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3da7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3620:1875455681706496:0@lo:400:kworker.0 00000100:00100000:0.0:1788574376.100077:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681707008 00000100:00100000:0.0:1788574376.100082:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681707008 00000100:00100000:0.0:1788574376.100326:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788574376.100347:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601836d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3620:x1875455681707008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788574376.100365:0:18575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788574376.100415:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601836d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3620:x1875455681707008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (1293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574376.100422:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788574376.100481:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c2f45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681707008:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788574376.384423:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574376.384665:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669031936 00000100:00100000:2.0:1788574376.384696:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669031936 00000100:00100000:2.0:1788574376.384807:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 116 00000100:00100000:2.0:1788574376.384816:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c536b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2392:x1875455669031936:12345-192.168.204.51@tcp:250:mount.lustre.0 00010000:00080000:2.0:1788574376.384875:0:17062:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 1980da70-ec0a-4d33-8959-8ff61c9350d5@192.168.204.51@tcp t0 exp 0000000000000000 cur 516 last 0 00000020:00000080:2.0:1788574376.384968:0:17062:0:(genops.c:1385:class_connect()) connect: client 1980da70-ec0a-4d33-8959-8ff61c9350d5, cookie 0x5bf8706fdac8d517 00000100:00080000:2.0:1788574376.385330:0:17062:0:(import.c:65:import_set_state_nolock()) ffff9c84c44b5000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788574376.385474:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c536b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1980da70-ec0a-4d33-8959-8ff61c9350d5+5:2392:x1875455669031936:12345-192.168.204.51@tcp:250:mount.lustre.0 Request processed in 655us (1059us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574376.385484:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 116 00000100:00100000:1.0:1788574376.397435:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574376.397603:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669032064 00000100:00100000:2.0:1788574376.397615:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669032064 00000100:00100000:2.0:1788574376.397762:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 117 00000100:00100000:2.0:1788574376.397775:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c536a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1980da70-ec0a-4d33-8959-8ff61c9350d5+5:14890:x1875455669032064:12345-192.168.204.51@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788574376.397797:0:17061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574376.397821:0:17061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c860217ee00/0x5bf8706fdac8d51e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6b37 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574376.397857:0:17061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c860217ee00/0x5bf8706fdac8d51e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6b37 expref: 6 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574376.397869:0:17061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c860217ee00/0x5bf8706fdac8d51e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6b37 expref: 6 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574376.397880:0:17061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c860217ee00, rc 0) 00000100:00100000:2.0:1788574376.397944:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c536a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1980da70-ec0a-4d33-8959-8ff61c9350d5+6:14890:x1875455669032064:12345-192.168.204.51@tcp:101:mount.lustre.0 Request processed in 171us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574376.397952:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 117 00000100:00100000:3.0:1788574376.401247:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574376.401401:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669032192 00000100:00100000:1.0:1788574376.401423:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669032192 00000100:00100000:1.0:1788574376.401471:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 118 00000100:00100000:1.0:1788574376.401480:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c5369c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1980da70-ec0a-4d33-8959-8ff61c9350d5+6:14890:x1875455669032192:12345-192.168.204.51@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788574376.401616:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c5369c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1980da70-ec0a-4d33-8959-8ff61c9350d5+6:14890:x1875455669032192:12345-192.168.204.51@tcp:501:mount.lustre.0 Request processed in 137us (381us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788574376.401625:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 118 00010000:00010000:3.0:1788574376.407011:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574376.412520:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574376.412616:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669032320 00000100:00100000:0.0:1788574376.412625:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669032320 00000100:00100000:0.0:1788574376.412691:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 119 00000100:00100000:0.0:1788574376.412702:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85cbd5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1980da70-ec0a-4d33-8959-8ff61c9350d5+6:14890:x1875455669032320:12345-192.168.204.51@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788574376.412719:0:17060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574376.412746:0:17060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85c152e000/0x5bf8706fdac8d525 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6b3e expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574376.412778:0:17060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85c152e000/0x5bf8706fdac8d525 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6b3e expref: 7 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574376.412790:0:17060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85c152e000/0x5bf8706fdac8d525 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6b3e expref: 7 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574376.412816:0:17060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85c152e000, rc 0) 00000100:00100000:0.0:1788574376.412879:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85cbd5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1980da70-ec0a-4d33-8959-8ff61c9350d5+7:14890:x1875455669032320:12345-192.168.204.51@tcp:101:mount.lustre.0 Request processed in 180us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574376.412887:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 119 00000100:00100000:3.0:1788574376.423391:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574376.423503:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669032448 00000100:00100000:2.0:1788574376.423520:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669032448 00000100:00100000:2.0:1788574376.423609:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 120 00000100:00100000:2.0:1788574376.423620:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85cbd5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1980da70-ec0a-4d33-8959-8ff61c9350d5+7:14890:x1875455669032448:12345-192.168.204.51@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788574376.423828:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85cbd5e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1980da70-ec0a-4d33-8959-8ff61c9350d5+8:14890:x1875455669032448:12345-192.168.204.51@tcp:501:mount.lustre.0 Request processed in 209us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574376.423836:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 120 00000100:00100000:1.0:1788574376.443926:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574376.444034:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669032576 00000100:00100000:3.0:1788574376.444044:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669032576 00000100:00100000:3.0:1788574376.444104:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 121 00000100:00100000:3.0:1788574376.444113:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e0bdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1980da70-ec0a-4d33-8959-8ff61c9350d5+8:14890:x1875455669032576:12345-192.168.204.51@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788574376.444337:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e0bdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1980da70-ec0a-4d33-8959-8ff61c9350d5+8:14890:x1875455669032576:12345-192.168.204.51@tcp:503:mount.lustre.0 Request processed in 223us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574376.444345:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 121 00000100:00100000:1.0:1788574376.457874:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574376.458264:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669032704 00000100:00100000:0.0:1788574376.458274:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669032704 00000100:00100000:0.0:1788574376.458335:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 122 00000100:00100000:0.0:1788574376.458346:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85cbd5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1980da70-ec0a-4d33-8959-8ff61c9350d5+8:14909:x1875455669032704:12345-192.168.204.51@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788574376.458512:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85cbd5c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1980da70-ec0a-4d33-8959-8ff61c9350d5+8:14909:x1875455669032704:12345-192.168.204.51@tcp:502:llog_process_th.0 Request processed in 167us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574376.458521:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 122 00000100:00100000:3.0:1788574376.503743:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574376.504213:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669032832 00000100:00100000:2.0:1788574376.504224:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669032832 00000100:00100000:2.0:1788574376.504281:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 123 00000100:00100000:2.0:1788574376.504292:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e0bdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1980da70-ec0a-4d33-8959-8ff61c9350d5+8:14909:x1875455669032832:12345-192.168.204.51@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788574376.504455:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e0bdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1980da70-ec0a-4d33-8959-8ff61c9350d5+8:14909:x1875455669032832:12345-192.168.204.51@tcp:502:llog_process_th.0 Request processed in 165us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574376.504463:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 123 00000100:00100000:1.0:1788574376.509151:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574376.512109:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669032960 00000100:00100000:3.0:1788574376.512126:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669032960 00000100:00100000:2.0:1788574376.512791:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 124 00000100:00100000:2.0:1788574376.512804:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e0bdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1980da70-ec0a-4d33-8959-8ff61c9350d5+8:14909:x1875455669032960:12345-192.168.204.51@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788574376.512989:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e0bdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1980da70-ec0a-4d33-8959-8ff61c9350d5+8:14909:x1875455669032960:12345-192.168.204.51@tcp:502:llog_process_th.0 Request processed in 186us (3850us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574376.512999:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 124 00000100:00100000:1.0:1788574376.520625:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574376.523677:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669033088 00000100:00100000:0.0:1788574376.523698:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669033088 00000100:00100000:0.0:1788574376.523781:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 125 00000100:00100000:0.0:1788574376.523791:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e0bd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1980da70-ec0a-4d33-8959-8ff61c9350d5+8:14890:x1875455669033088:12345-192.168.204.51@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788574376.523810:0:17060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574376.523831:0:17060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85c152ee00/0x5bf8706fdac8d52c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6b6f expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574376.523869:0:17060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85c152ee00/0x5bf8706fdac8d52c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6b6f expref: 9 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574376.523881:0:17060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85c152ee00/0x5bf8706fdac8d52c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6b6f expref: 9 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574376.523890:0:17060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85c152ee00, rc 0) 00000100:00100000:0.0:1788574376.524008:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e0bd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1980da70-ec0a-4d33-8959-8ff61c9350d5+9:14890:x1875455669033088:12345-192.168.204.51@tcp:101:mount.lustre.0 Request processed in 218us (3392us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574376.524015:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 125 00000100:00100000:3.0:1788574376.538640:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574376.538749:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669033216 00000100:00100000:2.0:1788574376.538759:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669033216 00000100:00100000:2.0:1788574376.538819:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 126 00000100:00100000:2.0:1788574376.538830:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e0bda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1980da70-ec0a-4d33-8959-8ff61c9350d5+9:14890:x1875455669033216:12345-192.168.204.51@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788574376.538857:0:17062:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788574376.538882:0:17062:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788574376.538887:0:17062:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788574376.538890:0:17062:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788574376.538903:0:17062:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1788574376.538906:0:17062:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:2.0:1788574376.542970:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e0bda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1980da70-ec0a-4d33-8959-8ff61c9350d5+9:14890:x1875455669033216:12345-192.168.204.51@tcp:256:mount.lustre.0 Request processed in 4127us (4324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574376.542989:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 126 00000100:00100000:1.0:1788574376.546906:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574376.547044:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669033344 00000100:00100000:2.0:1788574376.547054:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669033344 00000100:00100000:2.0:1788574376.547111:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 127 00000100:00100000:2.0:1788574376.547119:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85e0bd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1980da70-ec0a-4d33-8959-8ff61c9350d5+9:14890:x1875455669033344:12345-192.168.204.51@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788574376.547161:0:17061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574376.547181:0:17061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c860217f200/0x5bf8706fdac8d533 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6b76 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574376.547408:0:17061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c860217f200/0x5bf8706fdac8d533 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6b76 expref: 10 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574376.547421:0:17061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c860217f200/0x5bf8706fdac8d533 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6b76 expref: 10 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574376.547431:0:17061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c860217f200, rc 0) 00000100:00100000:2.0:1788574376.547539:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85e0bd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1980da70-ec0a-4d33-8959-8ff61c9350d5+10:14890:x1875455669033344:12345-192.168.204.51@tcp:101:mount.lustre.0 Request processed in 418us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574376.547547:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 127 00000100:00100000:3.0:1788574376.553491:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574376.553635:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669033472 00000100:00100000:2.0:1788574376.553646:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669033472 00000100:00100000:2.0:1788574376.553719:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 128 00000100:00100000:2.0:1788574376.553730:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3267850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1980da70-ec0a-4d33-8959-8ff61c9350d5+10:14890:x1875455669033472:12345-192.168.204.51@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788574376.553916:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3267850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1980da70-ec0a-4d33-8959-8ff61c9350d5+10:14890:x1875455669033472:12345-192.168.204.51@tcp:501:mount.lustre.0 Request processed in 186us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574376.553924:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 128 00000100:00100000:3.0:1788574376.555857:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574376.556123:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669033600 00000100:00100000:2.0:1788574376.556133:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669033600 00000100:00100000:2.0:1788574376.556282:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 129 00000100:00100000:2.0:1788574376.556293:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3265050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1980da70-ec0a-4d33-8959-8ff61c9350d5+10:14890:x1875455669033600:12345-192.168.204.51@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788574376.556440:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3265050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1980da70-ec0a-4d33-8959-8ff61c9350d5+10:14890:x1875455669033600:12345-192.168.204.51@tcp:503:mount.lustre.0 Request processed in 148us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574376.556456:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 129 00000100:00100000:1.0:1788574376.561477:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574376.566624:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669033728 00000100:00100000:0.0:1788574376.566642:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669033728 00000100:00100000:0.0:1788574376.566711:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 130 00000100:00100000:0.0:1788574376.566721:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3265c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1980da70-ec0a-4d33-8959-8ff61c9350d5+10:14914:x1875455669033728:12345-192.168.204.51@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788574376.566983:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3265c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1980da70-ec0a-4d33-8959-8ff61c9350d5+10:14914:x1875455669033728:12345-192.168.204.51@tcp:502:llog_process_th.0 Request processed in 261us (5513us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574376.566992:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 130 00000100:00100000:3.0:1788574376.575852:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574376.576243:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669033856 00000100:00100000:0.0:1788574376.576254:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669033856 00000100:00100000:0.0:1788574376.576316:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 131 00000100:00100000:0.0:1788574376.576328:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3265450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1980da70-ec0a-4d33-8959-8ff61c9350d5+10:14914:x1875455669033856:12345-192.168.204.51@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788574376.576488:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3265450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1980da70-ec0a-4d33-8959-8ff61c9350d5+10:14914:x1875455669033856:12345-192.168.204.51@tcp:502:llog_process_th.0 Request processed in 163us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574376.576496:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 131 00000100:00100000:1.0:1788574376.591337:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574376.591400:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574376.596437:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669033984 00000100:00100000:3.0:1788574376.596456:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669033984 00000100:00100000:3.0:1788574376.596513:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669034240 00000100:00100000:3.0:1788574376.596517:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669034240 00000100:00100000:3.0:1788574376.596545:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 7 00000100:00100000:3.0:1788574376.596555:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3725c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2392:x1875455669033984:12345-192.168.204.51@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788574376.596588:0:17068:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 74bce780-6a9f-42e0-9637-fe6b1665ce5b@192.168.204.51@tcp t0 exp 0000000000000000 cur 516 last 0 00000020:00000080:3.0:1788574376.596639:0:17068:0:(genops.c:1385:class_connect()) connect: client 74bce780-6a9f-42e0-9637-fe6b1665ce5b, cookie 0x5bf8706fdac8d53a 00000004:00100000:3.0:1788574376.596676:0:17068:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788574376.596894:0:17068:0:(import.c:65:import_set_state_nolock()) ffff9c85c6e7d000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788574376.596972:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3725c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74bce780-6a9f-42e0-9637-fe6b1665ce5b+6:2392:x1875455669033984:12345-192.168.204.51@tcp:38:mount.lustre.0 Request processed in 418us (5645us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574376.596981:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 7 00000100:00100000:3.0:1788574376.597002:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 8 00000100:00100000:3.0:1788574376.597007:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3726680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2392:x1875455669034240:12345-192.168.204.51@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788574376.597024:0:17068:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 74bce780-6a9f-42e0-9637-fe6b1665ce5b@192.168.204.51@tcp t0 exp 0000000000000000 cur 516 last 0 00000020:00000080:3.0:1788574376.597058:0:17068:0:(genops.c:1385:class_connect()) connect: client 74bce780-6a9f-42e0-9637-fe6b1665ce5b, cookie 0x5bf8706fdac8d541 00000004:00100000:3.0:1788574376.597072:0:17068:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788574376.598367:0:17068:0:(import.c:65:import_set_state_nolock()) ffff9c85fbbdf800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788574376.598418:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3726680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74bce780-6a9f-42e0-9637-fe6b1665ce5b+6:2392:x1875455669034240:12345-192.168.204.51@tcp:38:mount.lustre.0 Request processed in 1408us (7016us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574376.598436:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 8 00000100:00100000:1.0:1788574376.602648:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574376.602694:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574376.602732:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574376.605113:0:17067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669034112 00000100:00100000:3.0:1788574376.605129:0:17067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669034112 00000100:00100000:3.0:1788574376.605214:0:17067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669034368 00000100:00100000:3.0:1788574376.605218:0:17067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669034368 00000100:00100000:3.0:1788574376.605238:0:17067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669034496 00000100:00100000:3.0:1788574376.605241:0:17067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669034496 00000100:00080000:1.0:1788574376.605360:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788574376.605366:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788574376.605415:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 9 00000100:00100000:3.0:1788574376.605426:0:17067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3726300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74bce780-6a9f-42e0-9637-fe6b1665ce5b+7:0:x1875455669034112:12345-192.168.204.51@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788574376.605465:0:17067:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788574376.605570:0:17067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3726300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74bce780-6a9f-42e0-9637-fe6b1665ce5b+7:0:x1875455669034112:12345-192.168.204.51@tcp:41:mount.lustre.0 Request processed in 145us (2931us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574376.605578:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 9 00000100:00100000:0.0:1788574376.605602:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 10 00000100:00100000:3.0:1788574376.605617:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 11 00000100:00100000:3.0:1788574376.605626:0:17067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3727100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74bce780-6a9f-42e0-9637-fe6b1665ce5b+6:14890:x1875455669034496:12345-192.168.204.51@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788574376.605639:0:17067:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788574376.605662:0:17067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3727100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74bce780-6a9f-42e0-9637-fe6b1665ce5b+6:14890:x1875455669034496:12345-192.168.204.51@tcp:41:mount.lustre.0 Request processed in 38us (2931us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574376.605682:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 11 00000100:00100000:0.0:1788574376.606411:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3725880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74bce780-6a9f-42e0-9637-fe6b1665ce5b+6:0:x1875455669034368:12345-192.168.204.51@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788574376.606439:0:17069:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788574376.606508:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3725880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74bce780-6a9f-42e0-9637-fe6b1665ce5b+6:0:x1875455669034368:12345-192.168.204.51@tcp:41:mount.lustre.0 Request processed in 898us (3814us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574376.606516:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 10 00000100:00100000:1.0:1788574376.614537:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574376.614636:0:17067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669034624 00000100:00100000:3.0:1788574376.614647:0:17067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669034624 00000100:00100000:3.0:1788574376.614722:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 12 00000100:00100000:3.0:1788574376.614733:0:17067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3726d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74bce780-6a9f-42e0-9637-fe6b1665ce5b+6:14890:x1875455669034624:12345-192.168.204.51@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788574376.614818:0:17067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3726d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74bce780-6a9f-42e0-9637-fe6b1665ce5b+6:14890:x1875455669034624:12345-192.168.204.51@tcp:40:mount.lustre.0 Request processed in 86us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574376.614843:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 12 00000100:00100000:3.0:1788574376.617133:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574376.617569:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669034752 00000100:00100000:0.0:1788574376.617579:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669034752 00000100:00100000:0.0:1788574376.617644:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 18 00000100:00100000:0.0:1788574376.617652:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3da4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2392:x1875455669034752:12345-192.168.204.51@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788574376.617700:0:18574:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 74bce780-6a9f-42e0-9637-fe6b1665ce5b@192.168.204.51@tcp t0 exp 0000000000000000 cur 516 last 0 00000020:00000080:0.0:1788574376.617734:0:18574:0:(genops.c:1385:class_connect()) connect: client 74bce780-6a9f-42e0-9637-fe6b1665ce5b, cookie 0x5bf8706fdac8d548 00002000:00100000:0.0:1788574376.617748:0:18574:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 74bce780-6a9f-42e0-9637-fe6b1665ce5b/ffff9c85c5f13000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788574376.617760:0:18574:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788574376.617936:0:18574:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788574376.617968:0:18574:0:(import.c:65:import_set_state_nolock()) ffff9c85c5f11800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788574376.618094:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3da4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:74bce780-6a9f-42e0-9637-fe6b1665ce5b+6:2392:x1875455669034752:12345-192.168.204.51@tcp:8:mount.lustre.0 Request processed in 440us (968us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574376.618102:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 18 00000100:00100000:1.0:1788574376.626556:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574376.626708:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574376.626974:0:19093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669034880 00000100:00100000:0.0:1788574376.626984:0:19093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669034880 00000100:00100000:0.0:1788574376.627034:0:19093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 19 00000100:00100000:0.0:1788574376.627052:0:19093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3724700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2392:x1875455669034880:12345-192.168.204.51@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788574376.627089:0:19093:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 74bce780-6a9f-42e0-9637-fe6b1665ce5b@192.168.204.51@tcp t0 exp 0000000000000000 cur 516 last 0 00000020:00000080:0.0:1788574376.627122:0:19093:0:(genops.c:1385:class_connect()) connect: client 74bce780-6a9f-42e0-9637-fe6b1665ce5b, cookie 0x5bf8706fdac8d54f 00002000:00100000:0.0:1788574376.627135:0:19093:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 74bce780-6a9f-42e0-9637-fe6b1665ce5b/ffff9c85c5f12800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788574376.627146:0:19093:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788574376.627379:0:19093:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788574376.627414:0:19093:0:(import.c:65:import_set_state_nolock()) ffff9c85c5f10800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788574376.627476:0:19093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3724700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:74bce780-6a9f-42e0-9637-fe6b1665ce5b+6:2392:x1875455669034880:12345-192.168.204.51@tcp:8:mount.lustre.0 Request processed in 423us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574376.627484:0:19093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 19 00000100:00100000:2.0:1788574376.627710:0:17078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669035008 00000100:00100000:2.0:1788574376.627715:0:17078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669035008 00000100:00100000:2.0:1788574376.627761:0:17078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 3 00000100:00100000:2.0:1788574376.627769:0:17078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3727b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:74bce780-6a9f-42e0-9637-fe6b1665ce5b+6:14890:x1875455669035008:12345-192.168.204.51@tcp:900:mount.lustre.0 00000100:00100000:2.0:1788574376.627810:0:17078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3727b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:74bce780-6a9f-42e0-9637-fe6b1665ce5b+6:14890:x1875455669035008:12345-192.168.204.51@tcp:900:mount.lustre.0 Request processed in 43us (1266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574376.627818:0:17078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 3 00000001:00100000:3.0:1788574376.631674:0:19386:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 74bce780-6a9f-42e0-9637-fe6b1665ce5b 00000001:00080000:3.0:1788574376.631690:0:19386:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000100:00100000:1.0:1788574376.635054:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574376.635358:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669035136 00000100:00100000:2.0:1788574376.635368:0:17070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669035136 00000100:00100000:2.0:1788574376.635418:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 0 00000100:00100000:2.0:1788574376.635427:0:17070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3724000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:74bce780-6a9f-42e0-9637-fe6b1665ce5b+6:14890:x1875455669035136:12345-192.168.204.51@tcp:33:mount.lustre.0 00000004:00080000:2.0:1788574376.639381:0:17070:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 3867us 00000004:00200000:3.0:1788574376.663979:0:17070:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788574376.664110:0:17070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3724000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:74bce780-6a9f-42e0-9637-fe6b1665ce5b+6:14890:x1875455669035136:12345-192.168.204.51@tcp:33:mount.lustre.0 Request processed in 28678us (29070us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574376.664125:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 0 00000100:00100000:3.0:1788574376.963796:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574376.963917:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669035264 00000100:00100000:0.0:1788574376.963929:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669035264 00000100:00100000:0.0:1788574376.964001:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 13 00000100:00100000:0.0:1788574376.964012:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3da5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74bce780-6a9f-42e0-9637-fe6b1665ce5b+6:14936:x1875455669035264:12345-192.168.204.51@tcp:101:mkdir.0 00010000:00010000:0.0:1788574376.964035:0:17069:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574376.964063:0:17069:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152e600/0x5bf8706fdac8d556 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6ba7 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574376.964143:0:17069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8d55d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574376.964168:0:17069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8d55d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574376.964377:0:17069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8d55d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788574376.964432:0:17069:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788574376.964436:0:17069:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788574376.964471:0:17069:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8d55d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574376.964543:0:17069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152e600/0x5bf8706fdac8d556 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ba7 expref: 8 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574376.964564:0:17069:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8d55d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ba7 expref: 7 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574376.964697:0:17069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c85c6b82a00) 00010000:00010000:0.0:1788574376.964701:0:17069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788574376.964718:0:17069:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85c152f400, rc 0) 00000100:00100000:0.0:1788574376.964905:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3da5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74bce780-6a9f-42e0-9637-fe6b1665ce5b+7:14936:x1875455669035264:12345-192.168.204.51@tcp:101:mkdir.0 Request processed in 893us (1119us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574376.964913:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 13 00000040:00080000:2.0:1788574376.980081:0:17820:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788574377.427425:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574378.453295:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574378.643891:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788574378.643919:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c8601835c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681707136:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788574378.643997:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574378.644183:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681707136 00000100:00100000:1.0:1788574378.644217:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681707136 00000100:00100000:1.0:1788574378.644287:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788574378.644296:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2bddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681707136:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788574378.644338:0:18576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788574378.644385:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2bddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681707136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574378.644412:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788574378.644733:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c8601835c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681707136:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788574378.644927:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788574379.096493:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574379.096733:0:17067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669035392 00000100:00100000:3.0:1788574379.096756:0:17067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669035392 00000100:00100000:3.0:1788574379.096845:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 14 00000100:00100000:3.0:1788574379.096857:0:17067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3724e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74bce780-6a9f-42e0-9637-fe6b1665ce5b+7:14989:x1875455669035392:12345-192.168.204.51@tcp:41:lfs.0 00000004:00000024:3.0:1788574379.096903:0:17067:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788574379.097015:0:17067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3724e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74bce780-6a9f-42e0-9637-fe6b1665ce5b+7:14989:x1875455669035392:12345-192.168.204.51@tcp:41:lfs.0 Request processed in 161us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574379.097023:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 14 00000100:00080000:2.0:1788574379.097115:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788574379.100565:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574379.112796:0:18898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669035520 00000100:00100000:2.0:1788574379.112814:0:18898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669035520 00000100:00100000:2.0:1788574379.112925:0:18898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 15 00000100:00100000:2.0:1788574379.112940:0:18898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3727480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74bce780-6a9f-42e0-9637-fe6b1665ce5b+6:14989:x1875455669035520:12345-192.168.204.51@tcp:41:lfs.0 00000004:00000024:2.0:1788574379.112985:0:18898:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788574379.113109:0:18898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3727480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74bce780-6a9f-42e0-9637-fe6b1665ce5b+6:14989:x1875455669035520:12345-192.168.204.51@tcp:41:lfs.0 Request processed in 173us (12555us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574379.113117:0:18898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 15 00000100:00080000:1.0:1788574379.113400:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788574379.117874:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574379.118024:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669035648 00000100:00100000:3.0:1788574379.118034:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669035648 00000100:00100000:3.0:1788574379.118114:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 12 00000100:00100000:3.0:1788574379.118125:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3725500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:74bce780-6a9f-42e0-9637-fe6b1665ce5b+6:14989:x1875455669035648:12345-192.168.204.51@tcp:13:lfs.0 00002000:00000024:3.0:1788574379.118152:0:18576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788574379.118315:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3725500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:74bce780-6a9f-42e0-9637-fe6b1665ce5b+6:14989:x1875455669035648:12345-192.168.204.51@tcp:13:lfs.0 Request processed in 191us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574379.118333:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 12 00000100:00080000:1.0:1788574379.119569:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788574379.125911:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574379.131636:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669035776 00000100:00100000:1.0:1788574379.131653:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669035776 00000100:00100000:1.0:1788574379.131802:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 13 00000100:00100000:1.0:1788574379.131816:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3da4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:74bce780-6a9f-42e0-9637-fe6b1665ce5b+5:14989:x1875455669035776:12345-192.168.204.51@tcp:13:lfs.0 00002000:00000024:1.0:1788574379.133287:0:18576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788574379.133408:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3da4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:74bce780-6a9f-42e0-9637-fe6b1665ce5b+5:14989:x1875455669035776:12345-192.168.204.51@tcp:13:lfs.0 Request processed in 1591us (7504us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574379.133419:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 13 00000100:00080000:2.0:1788574379.135394:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788574379.394943:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574379.395044:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669035904 00000100:00100000:3.0:1788574379.395057:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669035904 00000100:00100000:3.0:1788574379.395288:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 132 00000100:00100000:3.0:1788574379.395300:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3266850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1980da70-ec0a-4d33-8959-8ff61c9350d5+10:15021:x1875455669035904:12345-192.168.204.51@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788574379.395321:0:17060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574379.395342:0:17060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85faea2800/0x5bf8706fdac8d564 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6bae expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574379.395380:0:17060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85faea2800/0x5bf8706fdac8d564 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6bae expref: 11 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574379.395393:0:17060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85faea2800/0x5bf8706fdac8d564 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6bae expref: 11 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574379.395403:0:17060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85faea2800, rc 0) 00000100:00100000:3.0:1788574379.395475:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3266850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1980da70-ec0a-4d33-8959-8ff61c9350d5+11:15021:x1875455669035904:12345-192.168.204.51@tcp:101:mount.lustre.0 Request processed in 176us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574379.395482:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 132 00000100:00100000:1.0:1788574379.419356:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574379.419466:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669036032 00000100:00100000:2.0:1788574379.419477:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669036032 00000100:00100000:2.0:1788574379.419677:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 133 00000100:00100000:2.0:1788574379.419691:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3267c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1980da70-ec0a-4d33-8959-8ff61c9350d5+11:15021:x1875455669036032:12345-192.168.204.51@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788574379.420945:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3267c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1980da70-ec0a-4d33-8959-8ff61c9350d5+11:15021:x1875455669036032:12345-192.168.204.51@tcp:501:mount.lustre.0 Request processed in 1251us (1592us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574379.420957:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 133 00000100:00100000:1.0:1788574379.429773:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574379.431987:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669036160 00000100:00100000:3.0:1788574379.432002:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669036160 00000100:00100000:3.0:1788574379.432296:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 134 00000100:00100000:3.0:1788574379.432307:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3265850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1980da70-ec0a-4d33-8959-8ff61c9350d5+11:15021:x1875455669036160:12345-192.168.204.51@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788574379.432544:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3265850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1980da70-ec0a-4d33-8959-8ff61c9350d5+11:15021:x1875455669036160:12345-192.168.204.51@tcp:503:mount.lustre.0 Request processed in 237us (2782us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574379.432563:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 134 00000100:00100000:1.0:1788574379.440805:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574379.440910:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669036288 00000100:00100000:2.0:1788574379.440922:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669036288 00000100:00100000:2.0:1788574379.440978:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 135 00000100:00100000:2.0:1788574379.440990:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3266450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1980da70-ec0a-4d33-8959-8ff61c9350d5+11:15029:x1875455669036288:12345-192.168.204.51@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788574379.441339:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3266450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1980da70-ec0a-4d33-8959-8ff61c9350d5+11:15029:x1875455669036288:12345-192.168.204.51@tcp:502:llog_process_th.0 Request processed in 350us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574379.441347:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 135 00000100:00100000:1.0:1788574379.473961:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574379.474778:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669036416 00000100:00100000:0.0:1788574379.474791:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669036416 00000100:00100000:0.0:1788574379.474859:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 136 00000100:00100000:0.0:1788574379.474870:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3266c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1980da70-ec0a-4d33-8959-8ff61c9350d5+11:15029:x1875455669036416:12345-192.168.204.51@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788574379.475180:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3266c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1980da70-ec0a-4d33-8959-8ff61c9350d5+11:15029:x1875455669036416:12345-192.168.204.51@tcp:502:llog_process_th.0 Request processed in 311us (1229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574379.475292:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 136 00010000:00010000:2.0:1788574379.475442:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574379.482576:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574379.482819:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669036544 00000100:00100000:3.0:1788574379.482830:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669036544 00000100:00100000:3.0:1788574379.482950:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 137 00000100:00100000:3.0:1788574379.482961:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3267450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1980da70-ec0a-4d33-8959-8ff61c9350d5+11:15029:x1875455669036544:12345-192.168.204.51@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788574379.483149:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3267450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1980da70-ec0a-4d33-8959-8ff61c9350d5+11:15029:x1875455669036544:12345-192.168.204.51@tcp:502:llog_process_th.0 Request processed in 189us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574379.483156:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 137 00000100:00100000:1.0:1788574379.488550:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574379.498285:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669036672 00000100:00100000:0.0:1788574379.498302:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669036672 00000100:00100000:0.0:1788574379.498574:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 138 00000100:00100000:0.0:1788574379.498586:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3264c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1980da70-ec0a-4d33-8959-8ff61c9350d5+11:15021:x1875455669036672:12345-192.168.204.51@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788574379.498605:0:17062:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574379.498635:0:17062:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85c152e600/0x5bf8706fdac8d56b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6bdf expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574379.498667:0:17062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85c152e600/0x5bf8706fdac8d56b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6bdf expref: 12 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574379.498680:0:17062:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85c152e600/0x5bf8706fdac8d56b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6bdf expref: 12 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574379.498720:0:17062:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85c152e600, rc 0) 00000100:00100000:0.0:1788574379.498800:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3264c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1980da70-ec0a-4d33-8959-8ff61c9350d5+12:15021:x1875455669036672:12345-192.168.204.51@tcp:101:mount.lustre.0 Request processed in 216us (10260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574379.498807:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 138 00000100:00100000:1.0:1788574379.504789:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574379.505182:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669036800 00000100:00100000:3.0:1788574379.505233:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669036800 00000100:00100000:3.0:1788574379.505285:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 139 00000100:00100000:3.0:1788574379.505296:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3264850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1980da70-ec0a-4d33-8959-8ff61c9350d5+12:15021:x1875455669036800:12345-192.168.204.51@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788574379.505323:0:17060:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788574379.505360:0:17060:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788574379.505364:0:17060:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788574379.505368:0:17060:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788574379.505371:0:17060:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1788574379.505373:0:17060:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:0.0:1788574379.509379:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3264850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1980da70-ec0a-4d33-8959-8ff61c9350d5+12:15021:x1875455669036800:12345-192.168.204.51@tcp:256:mount.lustre.0 Request processed in 4073us (4588us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574379.509395:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 139 00000100:00100000:1.0:1788574379.512480:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574379.512583:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669036928 00000100:00100000:2.0:1788574379.512594:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669036928 00000100:00100000:2.0:1788574379.512668:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 140 00000100:00100000:2.0:1788574379.512680:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f7fc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1980da70-ec0a-4d33-8959-8ff61c9350d5+12:15021:x1875455669036928:12345-192.168.204.51@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788574379.512698:0:17061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574379.512717:0:17061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c860217fa00/0x5bf8706fdac8d572 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6be6 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574379.512748:0:17061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c860217fa00/0x5bf8706fdac8d572 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6be6 expref: 13 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574379.512781:0:17061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c860217fa00/0x5bf8706fdac8d572 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6be6 expref: 13 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574379.512791:0:17061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c860217fa00, rc 0) 00000100:00100000:2.0:1788574379.512895:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f7fc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1980da70-ec0a-4d33-8959-8ff61c9350d5+13:15021:x1875455669036928:12345-192.168.204.51@tcp:101:mount.lustre.0 Request processed in 217us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574379.512903:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 140 00000100:00100000:1.0:1788574379.516494:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574379.518592:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669037056 00000100:00100000:0.0:1788574379.518607:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669037056 00000100:00100000:0.0:1788574379.518695:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 141 00000100:00100000:0.0:1788574379.518707:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f7fc0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1980da70-ec0a-4d33-8959-8ff61c9350d5+13:15021:x1875455669037056:12345-192.168.204.51@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788574379.518886:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f7fc0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1980da70-ec0a-4d33-8959-8ff61c9350d5+13:15021:x1875455669037056:12345-192.168.204.51@tcp:501:mount.lustre.0 Request processed in 181us (2402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574379.518895:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 141 00000100:00100000:2.0:1788574379.522129:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574379.522304:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669037184 00000100:00100000:0.0:1788574379.522315:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669037184 00000100:00100000:0.0:1788574379.522490:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 142 00000100:00100000:0.0:1788574379.522502:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f7fc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1980da70-ec0a-4d33-8959-8ff61c9350d5+13:15021:x1875455669037184:12345-192.168.204.51@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788574379.522688:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f7fc1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1980da70-ec0a-4d33-8959-8ff61c9350d5+13:15021:x1875455669037184:12345-192.168.204.51@tcp:503:mount.lustre.0 Request processed in 187us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574379.522696:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 142 00000100:00100000:1.0:1788574379.528658:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574379.529074:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669037312 00000100:00100000:2.0:1788574379.529087:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669037312 00000100:00100000:2.0:1788574379.529169:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 143 00000100:00100000:2.0:1788574379.529179:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f7fc2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1980da70-ec0a-4d33-8959-8ff61c9350d5+13:15032:x1875455669037312:12345-192.168.204.51@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788574379.529390:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f7fc2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1980da70-ec0a-4d33-8959-8ff61c9350d5+13:15032:x1875455669037312:12345-192.168.204.51@tcp:502:llog_process_th.0 Request processed in 212us (741us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574379.529399:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 143 00000100:00100000:1.0:1788574379.539411:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574379.542244:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669037440 00000100:00100000:3.0:1788574379.542264:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669037440 00000100:00100000:3.0:1788574379.542357:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 144 00000100:00100000:3.0:1788574379.542368:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f7fc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1980da70-ec0a-4d33-8959-8ff61c9350d5+13:15032:x1875455669037440:12345-192.168.204.51@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788574379.542569:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f7fc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1980da70-ec0a-4d33-8959-8ff61c9350d5+13:15032:x1875455669037440:12345-192.168.204.51@tcp:502:llog_process_th.0 Request processed in 202us (3175us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574379.542578:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 144 00000100:00100000:1.0:1788574379.553970:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574379.557341:0:17067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669037568 00000100:00100000:3.0:1788574379.557360:0:17067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669037568 00000100:00100000:3.0:1788574379.557412:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 16 00000100:00100000:3.0:1788574379.557421:0:17067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3724a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2392:x1875455669037568:12345-192.168.204.51@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788574379.557455:0:17067:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 408a814b-bde8-48f8-9467-4baee1a765d4@192.168.204.51@tcp t0 exp 0000000000000000 cur 519 last 0 00000020:00000080:3.0:1788574379.557503:0:17067:0:(genops.c:1385:class_connect()) connect: client 408a814b-bde8-48f8-9467-4baee1a765d4, cookie 0x5bf8706fdac8d579 00000004:00100000:3.0:1788574379.557531:0:17067:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788574379.557650:0:17067:0:(import.c:65:import_set_state_nolock()) ffff9c85fbbdb000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788574379.557760:0:17067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3724a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:408a814b-bde8-48f8-9467-4baee1a765d4+6:2392:x1875455669037568:12345-192.168.204.51@tcp:38:mount.lustre.0 Request processed in 339us (3800us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574379.557769:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 16 00000100:00100000:2.0:1788574379.557996:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574379.558511:0:18898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669037824 00000100:00100000:3.0:1788574379.558518:0:18898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669037824 00000100:00100000:3.0:1788574379.558597:0:18898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 17 00000100:00100000:3.0:1788574379.558603:0:18898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601834a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2392:x1875455669037824:12345-192.168.204.51@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788574379.558637:0:18898:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 408a814b-bde8-48f8-9467-4baee1a765d4@192.168.204.51@tcp t0 exp 0000000000000000 cur 519 last 0 00000020:00000080:3.0:1788574379.558699:0:18898:0:(genops.c:1385:class_connect()) connect: client 408a814b-bde8-48f8-9467-4baee1a765d4, cookie 0x5bf8706fdac8d580 00000004:00100000:3.0:1788574379.558725:0:18898:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788574379.558801:0:18898:0:(import.c:65:import_set_state_nolock()) ffff9c85fbbdd000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788574379.558863:0:18898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601834a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:408a814b-bde8-48f8-9467-4baee1a765d4+6:2392:x1875455669037824:12345-192.168.204.51@tcp:38:mount.lustre.0 Request processed in 258us (867us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574379.558870:0:18898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 17 00000100:00100000:2.0:1788574379.565320:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574379.565836:0:17067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669037952 00000100:00100000:3.0:1788574379.565848:0:17067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669037952 00000100:00080000:2.0:1788574379.565986:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788574379.567893:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 18 00000100:00100000:3.0:1788574379.567919:0:17067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601835f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:408a814b-bde8-48f8-9467-4baee1a765d4+6:0:x1875455669037952:12345-192.168.204.51@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788574379.567980:0:17067:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788574379.568070:0:17067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601835f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:408a814b-bde8-48f8-9467-4baee1a765d4+6:0:x1875455669037952:12345-192.168.204.51@tcp:41:mount.lustre.0 Request processed in 162us (2760us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574379.568077:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 18 00000100:00100000:0.0:1788574379.568231:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574379.570296:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669037696 00000100:00100000:1.0:1788574379.570311:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669037696 00000100:00100000:1.0:1788574379.570685:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 19 00000100:00100000:1.0:1788574379.570696:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8ab3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:408a814b-bde8-48f8-9467-4baee1a765d4+6:0:x1875455669037696:12345-192.168.204.51@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788574379.570726:0:17069:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788574379.570793:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8ab3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:408a814b-bde8-48f8-9467-4baee1a765d4+6:0:x1875455669037696:12345-192.168.204.51@tcp:41:mount.lustre.0 Request processed in 100us (2563us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574379.570799:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 19 00000100:00080000:0.0:1788574379.570887:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788574379.572294:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574379.573347:0:18898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669038080 00000100:00100000:3.0:1788574379.573360:0:18898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669038080 00000100:00100000:0.0:1788574379.573500:0:18898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 20 00000100:00100000:0.0:1788574379.573524:0:18898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601837800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:408a814b-bde8-48f8-9467-4baee1a765d4+6:15021:x1875455669038080:12345-192.168.204.51@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788574379.573555:0:18898:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788574379.573719:0:18898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601837800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:408a814b-bde8-48f8-9467-4baee1a765d4+6:15021:x1875455669038080:12345-192.168.204.51@tcp:41:mount.lustre.0 Request processed in 197us (1430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574379.573727:0:18898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 20 00000100:00100000:1.0:1788574379.576484:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574379.576618:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669038208 00000100:00100000:2.0:1788574379.576629:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669038208 00000100:00100000:2.0:1788574379.576745:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 21 00000100:00100000:2.0:1788574379.576756:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3725f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:408a814b-bde8-48f8-9467-4baee1a765d4+6:15021:x1875455669038208:12345-192.168.204.51@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788574379.576844:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3725f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:408a814b-bde8-48f8-9467-4baee1a765d4+6:15021:x1875455669038208:12345-192.168.204.51@tcp:40:mount.lustre.0 Request processed in 90us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574379.576870:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 21 00000100:00100000:3.0:1788574379.579786:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574379.579889:0:17078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669038592 00000100:00100000:1.0:1788574379.579900:0:17078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669038592 00000100:00100000:1.0:1788574379.579958:0:17078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 4 00000100:00100000:1.0:1788574379.579968:0:17078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3da4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:408a814b-bde8-48f8-9467-4baee1a765d4+6:15021:x1875455669038592:12345-192.168.204.51@tcp:900:mount.lustre.0 00000100:00100000:1.0:1788574379.580041:0:17078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3da4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:408a814b-bde8-48f8-9467-4baee1a765d4+6:15021:x1875455669038592:12345-192.168.204.51@tcp:900:mount.lustre.0 Request processed in 74us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574379.580048:0:17078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 4 00000100:00100000:1.0:1788574379.582583:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574379.582634:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574379.582663:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574379.582847:0:17071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669038720 00000100:00100000:0.0:1788574379.582860:0:17071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669038720 00000100:00100000:2.0:1788574379.582862:0:18571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669038336 00000100:00100000:2.0:1788574379.582869:0:18571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669038336 00000100:00100000:2.0:1788574379.582910:0:18571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669038464 00000100:00100000:0.0:1788574379.582911:0:17071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 1 00000100:00100000:2.0:1788574379.582916:0:18571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669038464 00000100:00100000:0.0:1788574379.582924:0:17071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3724380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:408a814b-bde8-48f8-9467-4baee1a765d4+6:15021:x1875455669038720:12345-192.168.204.51@tcp:33:mount.lustre.0 00000100:00100000:2.0:1788574379.582936:0:18571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 20 00000100:00100000:2.0:1788574379.582943:0:18571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3725180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2392:x1875455669038336:12345-192.168.204.51@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788574379.582977:0:18571:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 408a814b-bde8-48f8-9467-4baee1a765d4@192.168.204.51@tcp t0 exp 0000000000000000 cur 519 last 0 00000020:00000080:2.0:1788574379.583013:0:18571:0:(genops.c:1385:class_connect()) connect: client 408a814b-bde8-48f8-9467-4baee1a765d4, cookie 0x5bf8706fdac8d587 00000004:00200000:0.0:1788574379.583014:0:17071:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00002000:00100000:2.0:1788574379.583027:0:18571:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 408a814b-bde8-48f8-9467-4baee1a765d4/ffff9c84c325a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788574379.583040:0:18571:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:0.0:1788574379.583095:0:17071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3724380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:408a814b-bde8-48f8-9467-4baee1a765d4+6:15021:x1875455669038720:12345-192.168.204.51@tcp:33:mount.lustre.0 Request processed in 173us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574379.583103:0:17071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 1 00002000:00080000:2.0:1788574379.583121:0:18571:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:1.0:1788574379.583224:0:19093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 21 00000100:00100000:1.0:1788574379.583230:0:19093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3726a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2392:x1875455669038464:12345-192.168.204.51@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788574379.583249:0:19093:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 408a814b-bde8-48f8-9467-4baee1a765d4@192.168.204.51@tcp t0 exp 0000000000000000 cur 519 last 0 00000020:00000080:1.0:1788574379.583269:0:19093:0:(genops.c:1385:class_connect()) connect: client 408a814b-bde8-48f8-9467-4baee1a765d4, cookie 0x5bf8706fdac8d58e 00002000:00100000:1.0:1788574379.583294:0:19093:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 408a814b-bde8-48f8-9467-4baee1a765d4/ffff9c84c2211000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000100:00080000:2.0:1788574379.583301:0:18571:0:(import.c:65:import_set_state_nolock()) ffff9c84c325d800 : changing import state from RECOVER to FULL 00002000:00100000:1.0:1788574379.583302:0:19093:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:2.0:1788574379.583337:0:18571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3725180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:408a814b-bde8-48f8-9467-4baee1a765d4+6:2392:x1875455669038336:12345-192.168.204.51@tcp:8:mount.lustre.0 Request processed in 393us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574379.583346:0:18571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 20 00002000:00080000:1.0:1788574379.583366:0:19093:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788574379.583393:0:19093:0:(import.c:65:import_set_state_nolock()) ffff9c84c2215000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788574379.583418:0:19093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3726a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:408a814b-bde8-48f8-9467-4baee1a765d4+6:2392:x1875455669038464:12345-192.168.204.51@tcp:8:mount.lustre.0 Request processed in 187us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574379.583424:0:19093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 21 00000100:00100000:3.0:1788574379.821093:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574379.821182:0:18898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669038848 00000100:00100000:0.0:1788574379.821232:0:18898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669038848 00000100:00100000:0.0:1788574379.821365:0:18898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 22 00000100:00100000:0.0:1788574379.821491:0:18898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3da7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:408a814b-bde8-48f8-9467-4baee1a765d4+6:15056:x1875455669038848:12345-192.168.204.51@tcp:101:mkdir.0 00010000:00010000:0.0:1788574379.821513:0:18898:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574379.821536:0:18898:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f200/0x5bf8706fdac8d595 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6c17 expref: -99 pid: 18898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574379.821619:0:18898:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f000/0x5bf8706fdac8d59c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574379.821633:0:18898:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f000/0x5bf8706fdac8d59c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574379.821663:0:18898:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f000/0x5bf8706fdac8d59c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788574379.821711:0:18898:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788574379.821715:0:18898:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788574379.821735:0:18898:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f000/0x5bf8706fdac8d59c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574379.821773:0:18898:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f200/0x5bf8706fdac8d595 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6c17 expref: 8 pid: 18898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574379.821792:0:18898:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f000/0x5bf8706fdac8d59c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6c17 expref: 7 pid: 18898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574379.821801:0:18898:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c85c6b82a00) 00010000:00010000:0.0:1788574379.821804:0:18898:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788574379.821807:0:18898:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85c152f000, rc 0) 00000100:00100000:0.0:1788574379.821867:0:18898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3da7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:408a814b-bde8-48f8-9467-4baee1a765d4+7:15056:x1875455669038848:12345-192.168.204.51@tcp:101:mkdir.0 Request processed in 493us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574379.821875:0:18898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 22 00000100:00100000:1.0:1788574380.179922:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8ab1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681707264:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788574380.179999:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574380.180349:0:17072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681707264 00000100:00100000:0.0:1788574380.180357:0:17072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681707264 00000100:00100000:0.0:1788574380.180450:0:17072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788574380.180461:0:17072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3c0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681707264:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788574380.180500:0:17072:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788574380.180562:0:17072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3c0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681707264:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574380.180585:0:17072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788574380.180779:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c8601837480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681707392:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788574380.180815:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574380.180891:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8ab1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681707264:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788574380.181006:0:17807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681707392 00000100:00100000:1.0:1788574380.181010:0:17807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681707392 00000100:00100000:1.0:1788574380.181047:0:17807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788574380.181054:0:17807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3da4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681707392:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788574380.181075:0:17807:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788574380.181123:0:17807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3da4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681707392:12345-0@lo:41:osp-pre-1-0.0 Request processed in 70us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574380.181129:0:17807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788574380.181782:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c8601837480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681707392:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788574380.499637:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574380.692424:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788574380.692451:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c8601834380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681707520:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788574380.692524:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574380.692617:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681707520 00000100:00100000:2.0:1788574380.692626:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681707520 00000100:00100000:2.0:1788574380.692696:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788574380.692706:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3da7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681707520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788574380.692748:0:18576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788574380.692796:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3da7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681707520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574380.692803:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1788574380.692897:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788574380.692937:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c8601834380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681707520:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788574381.203708:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3da6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681707648:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788574381.203799:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574381.203863:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3da5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681708160:0@lo:400:kworker.0 00000100:00100000:3.0:1788574381.203887:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574381.203904:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681708672:0@lo:400:kworker.0 00000100:00100000:3.0:1788574381.203923:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574381.203949:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85ffafd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3620:1875455681709184:0@lo:400:kworker.0 00000100:00100000:3.0:1788574381.203980:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574381.204005:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788574381.204011:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3da7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681708032:0@lo:400:kworker.0 00000100:00100000:3.0:1788574381.204031:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574381.204047:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3da5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681708544:0@lo:400:kworker.0 00000100:00100000:3.0:1788574381.204082:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574381.204104:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85ffafca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3620:1875455681709056:0@lo:400:kworker.0 00000100:00100000:3.0:1788574381.204134:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574381.204177:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3da4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f73678fb-d8c0-450f-a73b-e6565942045e:3617:1875455681707776:0@lo:400:kworker.0 00000100:00100000:3.0:1788574381.204226:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574381.204260:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3da6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875455681708288:0@lo:400:kworker.0 00000100:00100000:3.0:1788574381.204282:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574381.204299:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85ffafdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875455681708800:0@lo:400:kworker.0 00000100:00100000:3.0:1788574381.204318:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574381.204332:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85ffafe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1875455681709312:0@lo:400:kworker.0 00000100:00100000:3.0:1788574381.204353:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574381.204365:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1788574381.204371:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3da6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681707904:0@lo:400:kworker.0 00000100:00100000:3.0:1788574381.204392:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574381.204411:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3da5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681708416:0@lo:400:kworker.0 00000100:00100000:3.0:1788574381.204431:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574381.204446:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85ffaffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1875455681708928:0@lo:400:kworker.0 00000100:00100000:3.0:1788574381.204482:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574381.204499:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c335d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681709440:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788574381.204524:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574381.204558:0:18571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681708160 00000100:00100000:3.0:1788574381.204566:0:18571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681708160 00000100:00100000:3.0:1788574381.204628:0:18571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681708672 00000100:00100000:3.0:1788574381.204632:0:18571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681708672 00000100:00100000:3.0:1788574381.204646:0:18571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681708032 00000100:00100000:3.0:1788574381.204649:0:18571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681708032 00000100:00100000:3.0:1788574381.204659:0:18571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681708544 00000100:00100000:3.0:1788574381.204661:0:18571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681708544 00000100:00100000:3.0:1788574381.204678:0:18571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788574381.204685:0:18571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffaff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681708160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574381.204740:0:18571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffaff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681708160:12345-0@lo:400:kworker.0 Request processed in 55us (852us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574381.204747:0:18571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788574381.204763:0:18571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788574381.204769:0:18571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffafe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681708672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574381.204795:0:18571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffafe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681708672:12345-0@lo:400:kworker.0 Request processed in 27us (871us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574381.204800:0:18571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788574381.204810:0:18571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788574381.204815:0:18571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffafea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681708032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574381.204841:0:18571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffafea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681708032:12345-0@lo:400:kworker.0 Request processed in 25us (808us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574381.204848:0:18571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788574381.204861:0:18571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788574381.204867:0:18571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffafce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681708544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574381.204875:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681707776 00000100:00100000:1.0:1788574381.204883:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681707776 00000100:00100000:3.0:1788574381.204915:0:18571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffafce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681708544:12345-0@lo:400:kworker.0 Request processed in 48us (833us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574381.204922:0:18571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788574381.204935:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788574381.204945:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f7fc2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f73678fb-d8c0-450f-a73b-e6565942045e+24:3617:x1875455681707776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574381.204966:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681709184 00000100:00100000:3.0:1788574381.204972:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681709184 00000100:00100000:1.0:1788574381.204996:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f7fc2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f73678fb-d8c0-450f-a73b-e6565942045e+24:3617:x1875455681707776:12345-0@lo:400:kworker.0 Request processed in 52us (768us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574381.204999:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681709056 00000100:00100000:3.0:1788574381.205005:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681709056 00000100:00100000:1.0:1788574381.205008:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788574381.205027:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681708288 00000100:00100000:3.0:1788574381.205031:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681708288 00000100:00100000:1.0:1788574381.205060:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3da4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f73678fb-d8c0-450f-a73b-e6565942045e:3617:1875455681707776:0@lo:400:kworker.0 00000100:00100000:3.0:1788574381.205062:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681708800 00000100:00100000:3.0:1788574381.205068:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681708800 00000100:00100000:3.0:1788574381.205088:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681709312 00000100:00100000:3.0:1788574381.205092:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681709312 00000100:00100000:3.0:1788574381.205106:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681708928 00000100:00100000:3.0:1788574381.205109:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681708928 00000100:00100000:3.0:1788574381.205124:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788574381.205130:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffaff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875455681709184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574381.205161:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffaff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875455681709184:12345-0@lo:400:kworker.0 Request processed in 31us (1180us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574381.205167:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788574381.205179:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788574381.205185:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffafed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875455681709056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574381.205246:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffafed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875455681709056:12345-0@lo:400:kworker.0 Request processed in 61us (1118us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574381.205252:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788574381.205264:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788574381.205270:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffafdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875455681708288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574381.205296:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffafdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875455681708288:12345-0@lo:400:kworker.0 Request processed in 27us (1013us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574381.205309:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788574381.205323:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788574381.205329:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffaff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875455681708800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574381.205357:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffaff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875455681708800:12345-0@lo:400:kworker.0 Request processed in 29us (1038us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574381.205363:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788574381.205375:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788574381.205381:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffafc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875455681709312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574381.205423:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffafc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875455681709312:12345-0@lo:400:kworker.0 Request processed in 42us (1068us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574381.205429:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788574381.205443:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788574381.205448:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffafc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875455681708928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574381.205472:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffafc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875455681708928:12345-0@lo:400:kworker.0 Request processed in 24us (990us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574381.205478:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788574381.205501:0:17807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681707904 00000100:00100000:3.0:1788574381.205505:0:17807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681707904 00000100:00100000:3.0:1788574381.205530:0:17807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681708416 00000100:00100000:3.0:1788574381.205534:0:17807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681708416 00000100:00100000:3.0:1788574381.205546:0:17807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788574381.205553:0:17807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffafd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681707904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574381.205602:0:17807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffafd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681707904:12345-0@lo:400:kworker.0 Request processed in 48us (1207us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574381.205609:0:17807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788574381.205623:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3da6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681707904:0@lo:400:kworker.0 00000100:00100000:3.0:1788574381.205631:0:17807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788574381.205642:0:17807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffafc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681708416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574381.205656:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85ffaffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3617:1875455681708928:0@lo:400:kworker.0 00000100:00100000:1.0:1788574381.205675:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3da6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875455681708288:0@lo:400:kworker.0 00000100:00100000:3.0:1788574381.205680:0:17807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffafc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681708416:12345-0@lo:400:kworker.0 Request processed in 39us (1246us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574381.205688:0:17807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788574381.205694:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85ffafdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875455681708800:0@lo:400:kworker.0 00000100:00100000:3.0:1788574381.205708:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681707648 00000100:00100000:3.0:1788574381.205713:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681707648 00000100:00100000:3.0:1788574381.205728:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681709440 00000100:00100000:3.0:1788574381.205730:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681709440 00000100:00100000:3.0:1788574381.205740:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788574381.205745:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffafd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681707648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788574381.205768:0:18575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788574381.205803:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffafd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681707648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (2004us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574381.205811:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788574381.205824:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788574381.205830:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681709440:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788574381.205840:0:18575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788574381.205864:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681709440:12345-0@lo:13:osp-pre-1-1.0 Request processed in 33us (1338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574381.205869:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1788574381.205889:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788574381.205893:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788574381.205897:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788574381.205899:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788574381.205928:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3da7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681708032:0@lo:400:kworker.0 00000100:00100000:3.0:1788574381.205938:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3da5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681708544:0@lo:400:kworker.0 00010000:00080000:3.0:1788574381.205956:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85ffafca80 x1875455681709056/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574397 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788574381.205967:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85ffafca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3620:1875455681709056:0@lo:400:kworker.0 00000100:00100000:3.0:1788574381.205975:0:3620:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:3.0:1788574381.205994:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3da6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681707648:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788574381.206004:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3da5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681708160:0@lo:400:kworker.0 00000100:00100000:3.0:1788574381.206013:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681708672:0@lo:400:kworker.0 00000100:00100000:3.0:1788574381.206022:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85ffafd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3620:1875455681709184:0@lo:400:kworker.0 00010000:00080000:1.0:1788574381.207630:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85ffafe680 x1875455681709312/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574397 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574381.207647:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85ffafe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3617:1875455681709312:0@lo:400:kworker.0 00000100:00100000:1.0:1788574381.207685:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3da5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681708416:0@lo:400:kworker.0 00000100:00100000:1.0:1788574381.207825:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c335d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681709440:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788574381.526076:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788574381.734007:0:17799:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 408a814b-bde8-48f8-9467-4baee1a765d4 00000001:00100000:3.0:1788574381.734018:0:17799:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 74bce780-6a9f-42e0-9637-fe6b1665ce5b 00000001:00100000:0.0:1788574381.734096:0:17047:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 408a814b-bde8-48f8-9467-4baee1a765d4 00000001:00100000:0.0:1788574381.734104:0:17047:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 74bce780-6a9f-42e0-9637-fe6b1665ce5b 00000001:00100000:0.0:1788574382.230511:0:18568:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 408a814b-bde8-48f8-9467-4baee1a765d4 00000001:00100000:0.0:1788574382.230532:0:18568:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 74bce780-6a9f-42e0-9637-fe6b1665ce5b 00010000:00010000:3.0:1788574382.553080:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788574382.619745:0:19943:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000040:00080000:3.0:1788574382.998349:0:17104:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788574383.578577:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574383.764912:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c8601837100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681709568:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788574383.765017:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574383.765696:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681709568 00000100:00100000:0.0:1788574383.765708:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681709568 00000100:00100000:0.0:1788574383.765822:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788574383.765835:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681709568:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788574383.765878:0:18575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00080000:2.0:1788574383.765963:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788574383.766002:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681709568:12345-0@lo:13:osp-pre-0-1.0 Request processed in 169us (983us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574383.766021:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788574383.766341:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c8601837100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681709568:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788574384.598443:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574384.714294:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574384.715224:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669039104 00000100:00100000:3.0:1788574384.715236:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669039104 00000100:00100000:3.0:1788574384.715306:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 44 00000100:00100000:3.0:1788574384.715317:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c335d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74bce780-6a9f-42e0-9637-fe6b1665ce5b+6:2393:x1875455669039104:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1788574384.715398:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c335d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74bce780-6a9f-42e0-9637-fe6b1665ce5b+6:2393:x1875455669039104:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 84us (1127us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574384.715406:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 44 00000100:00080000:0.0:1788574384.718212:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788574384.722582:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574384.722625:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574384.722651:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574384.722678:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574384.722702:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574384.722719:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574384.722733:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574384.722756:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574384.722782:0:18898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669039232 00000100:00100000:0.0:1788574384.722793:0:18898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669039232 00000100:00100000:0.0:1788574384.722849:0:18898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669039744 00000100:00100000:1.0:1788574384.722850:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669038976 00000100:00100000:0.0:1788574384.722852:0:18898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669039744 00000100:00100000:1.0:1788574384.722854:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669038976 00000100:00100000:0.0:1788574384.722881:0:18898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669039616 00000100:00100000:0.0:1788574384.722884:0:18898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669039616 00000100:00100000:1.0:1788574384.722885:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 146 00000100:00100000:1.0:1788574384.722894:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f7fc1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1980da70-ec0a-4d33-8959-8ff61c9350d5+13:2394:x1875455669038976:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1788574384.722899:0:18898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 45 00000100:00100000:0.0:1788574384.722905:0:18898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8ab3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74bce780-6a9f-42e0-9637-fe6b1665ce5b+5:2394:x1875455669039232:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788574384.722959:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f7fc1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1980da70-ec0a-4d33-8959-8ff61c9350d5+13:2394:x1875455669038976:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 66us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574384.722968:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 146 00000100:00100000:3.0:1788574384.723002:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 46 00000100:00100000:3.0:1788574384.723011:0:17067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8ab1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:408a814b-bde8-48f8-9467-4baee1a765d4+5:2394:x1875455669039744:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788574384.723011:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 47 00000100:00100000:1.0:1788574384.723017:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:408a814b-bde8-48f8-9467-4baee1a765d4+6:2393:x1875455669039616:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1788574384.723589:0:18898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8ab3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74bce780-6a9f-42e0-9637-fe6b1665ce5b+5:2394:x1875455669039232:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 681us (960us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574384.723597:0:18898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 45 00000100:00080000:0.0:1788574384.723617:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788574384.723621:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788574384.725550:0:17067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8ab1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:408a814b-bde8-48f8-9467-4baee1a765d4+5:2394:x1875455669039744:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 2404us (2743us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574384.725567:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 46 00000100:00100000:3.0:1788574384.725612:0:18571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669039488 00000100:00100000:3.0:1788574384.725620:0:18571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669039488 00000100:00100000:3.0:1788574384.725743:0:18571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669040000 00000100:00100000:3.0:1788574384.725747:0:18571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669040000 00000100:00100000:3.0:1788574384.725766:0:18571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669039360 00000100:00100000:3.0:1788574384.725769:0:18571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669039360 00000100:00100000:3.0:1788574384.725782:0:18571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669039872 00000100:00100000:3.0:1788574384.725785:0:18571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669039872 00000100:00100000:3.0:1788574384.725802:0:18571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 11 00000100:00100000:3.0:1788574384.725811:0:18571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8ab2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:74bce780-6a9f-42e0-9637-fe6b1665ce5b+5:2394:x1875455669039488:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1788574384.725860:0:18571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8ab2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:74bce780-6a9f-42e0-9637-fe6b1665ce5b+5:2394:x1875455669039488:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 51us (3208us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574384.725866:0:18571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 11 00000100:00100000:3.0:1788574384.725878:0:18571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 12 00000100:00100000:3.0:1788574384.725884:0:18571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8ab2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:408a814b-bde8-48f8-9467-4baee1a765d4+6:2394:x1875455669040000:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1788574384.725905:0:18571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8ab2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:408a814b-bde8-48f8-9467-4baee1a765d4+6:2394:x1875455669040000:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 22us (3204us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574384.725911:0:18571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 12 00000100:00100000:3.0:1788574384.725921:0:18571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 13 00000100:00100000:3.0:1788574384.725927:0:18571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8ab1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:74bce780-6a9f-42e0-9637-fe6b1665ce5b+5:2393:x1875455669039360:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1788574384.725949:0:18571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8ab1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:74bce780-6a9f-42e0-9637-fe6b1665ce5b+5:2393:x1875455669039360:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 22us (3228us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574384.726047:0:18571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 13 00000100:00100000:3.0:1788574384.726125:0:18571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 14 00000100:00100000:3.0:1788574384.726135:0:18571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:408a814b-bde8-48f8-9467-4baee1a765d4+5:2393:x1875455669039872:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1788574384.726163:0:18571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8ab2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:408a814b-bde8-48f8-9467-4baee1a765d4+5:2393:x1875455669039872:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 30us (3406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574384.726168:0:18571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 14 00000100:00080000:3.0:1788574384.726915:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788574384.726922:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788574384.732416:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8ab3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:408a814b-bde8-48f8-9467-4baee1a765d4+6:2393:x1875455669039616:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 9380us (9663us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574384.732888:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 47 00000001:00100000:3.0:1788574384.794446:0:19386:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 408a814b-bde8-48f8-9467-4baee1a765d4 00000100:00100000:0.0:1788574385.300836:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788574385.300862:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8ab0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681709696:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788574385.300956:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574385.301030:0:17807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681709696 00000100:00100000:0.0:1788574385.301038:0:17807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681709696 00000100:00100000:0.0:1788574385.301089:0:17807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788574385.301098:0:17807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8ab1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681709696:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788574385.301131:0:17807:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788574385.301177:0:17807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8ab1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681709696:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574385.301184:0:17807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788574385.301261:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8ab0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681709696:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788574385.306545:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c8601834000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681709824:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788574385.306634:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574385.306765:0:17072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681709824 00000100:00100000:1.0:1788574385.306773:0:17072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681709824 00000100:00100000:1.0:1788574385.306978:0:17072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788574385.306988:0:17072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3da5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681709824:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788574385.307024:0:17072:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788574385.307079:0:17072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3da5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681709824:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574385.307086:0:17072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788574385.307131:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c8601834000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681709824:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788574385.620956:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574385.812846:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788574385.812871:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c8601834000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681709952:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788574385.812942:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574385.813036:0:18575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681709952 00000100:00100000:0.0:1788574385.813044:0:18575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681709952 00000100:00100000:0.0:1788574385.813123:0:18575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788574385.813133:0:18575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3da6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681709952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788574385.813180:0:18575:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788574385.813255:0:18575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3da6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681709952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574385.813276:0:18575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788574385.813327:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c8601834000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681709952:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788574385.813452:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1788574386.196941:0:17820:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788574386.326142:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8ab0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681710080:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788574386.326237:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574386.327034:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c8601837100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681710208:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788574386.327075:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574386.327128:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681710080 00000100:00100000:1.0:1788574386.327137:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681710080 00000100:00100000:1.0:1788574386.327228:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681710208 00000100:00100000:1.0:1788574386.327232:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681710208 00000100:00100000:1.0:1788574386.327253:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788574386.327260:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681710080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788574386.327293:0:18576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788574386.333555:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681710080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 6285us (7307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574386.333571:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788574386.333634:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788574386.333648:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3da6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681710208:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788574386.333675:0:18576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788574386.333762:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3da6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681710208:12345-0@lo:13:osp-pre-1-1.0 Request processed in 120us (6686us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574386.333768:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:1.0:1788574386.333795:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788574386.333841:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c8601837100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681710208:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788574386.334027:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3da5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f73678fb-d8c0-450f-a73b-e6565942045e:3617:1875455681710336:0@lo:400:kworker.0 00000100:00100000:1.0:1788574386.334070:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574386.334115:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3da4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681710848:0@lo:400:kworker.0 00000100:00100000:1.0:1788574386.334139:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574386.334159:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3ea6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1875455681711360:0@lo:400:kworker.0 00000100:00100000:1.0:1788574386.334184:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574386.334230:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788574386.334236:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3da6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681710464:0@lo:400:kworker.0 00000100:00100000:1.0:1788574386.334259:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574386.334276:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3ea7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681710976:0@lo:400:kworker.0 00000100:00100000:1.0:1788574386.334298:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574386.334316:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3ea4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3617:1875455681711488:0@lo:400:kworker.0 00000100:00100000:1.0:1788574386.334335:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574386.334364:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3da7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875455681710720:0@lo:400:kworker.0 00000100:00100000:1.0:1788574386.334386:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574386.334402:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3ea6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3620:1875455681711232:0@lo:400:kworker.0 00000100:00100000:1.0:1788574386.334436:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574386.334453:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788574386.334458:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3da5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681710592:0@lo:400:kworker.0 00000100:00100000:1.0:1788574386.334499:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574386.334518:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3ea5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875455681711104:0@lo:400:kworker.0 00000100:00100000:1.0:1788574386.334539:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574386.334548:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3ea7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3620:1875455681711616:0@lo:400:kworker.0 00000100:00100000:1.0:1788574386.334566:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574386.334589:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681710848 00000100:00100000:1.0:1788574386.334596:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681710848 00000100:00100000:1.0:1788574386.334631:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681710464 00000100:00100000:1.0:1788574386.334634:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681710464 00000100:00100000:1.0:1788574386.334649:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788574386.334655:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3ea4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681710848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574386.334698:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3ea4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681710848:12345-0@lo:400:kworker.0 Request processed in 43us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574386.334705:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788574386.334717:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788574386.334722:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3ea4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681710464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574386.334745:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3ea4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681710464:12345-0@lo:400:kworker.0 Request processed in 23us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574386.334750:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788574386.334766:0:18898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681711360 00000100:00100000:1.0:1788574386.334769:0:18898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681711360 00000100:00100000:1.0:1788574386.334793:0:18898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681711488 00000100:00100000:1.0:1788574386.334796:0:18898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681711488 00000100:00100000:1.0:1788574386.334805:0:18898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681710720 00000100:00100000:1.0:1788574386.334814:0:18898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681710720 00000100:00100000:1.0:1788574386.334828:0:18898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681711232 00000100:00100000:1.0:1788574386.334830:0:18898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681711232 00000100:00100000:1.0:1788574386.334841:0:18898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681711104 00000100:00100000:1.0:1788574386.334843:0:18898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681711104 00000100:00100000:1.0:1788574386.334852:0:18898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681711616 00000100:00100000:1.0:1788574386.334854:0:18898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681711616 00000100:00100000:1.0:1788574386.334867:0:18898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788574386.334872:0:18898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3ea5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875455681711360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574386.334903:0:18898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3ea5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875455681711360:12345-0@lo:400:kworker.0 Request processed in 31us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574386.334909:0:18898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788574386.334919:0:18898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788574386.334925:0:18898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3ea5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875455681711488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574386.334950:0:18898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3ea5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875455681711488:12345-0@lo:400:kworker.0 Request processed in 25us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574386.334955:0:18898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788574386.334966:0:18898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788574386.334971:0:18898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3ea5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875455681710720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574386.335001:0:18898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3ea5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875455681710720:12345-0@lo:400:kworker.0 Request processed in 30us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574386.335006:0:18898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788574386.335017:0:18898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788574386.335023:0:18898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3ea7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875455681711232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574386.335047:0:18898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3ea7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875455681711232:12345-0@lo:400:kworker.0 Request processed in 26us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574386.335053:0:18898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788574386.335072:0:18898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788574386.335078:0:18898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3ea7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875455681711104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574386.335105:0:18898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3ea7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875455681711104:12345-0@lo:400:kworker.0 Request processed in 27us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574386.335111:0:18898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788574386.335122:0:18898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788574386.335128:0:18898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3ea4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875455681711616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574386.335154:0:18898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3ea4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875455681711616:12345-0@lo:400:kworker.0 Request processed in 26us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574386.335160:0:18898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788574386.335181:0:18571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681710976 00000100:00100000:1.0:1788574386.335185:0:18571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681710976 00000100:00100000:1.0:1788574386.335234:0:18571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681710592 00000100:00100000:1.0:1788574386.335237:0:18571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681710592 00000100:00100000:1.0:1788574386.335254:0:18571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788574386.335260:0:18571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3ea5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681710976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574386.335303:0:18571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3ea5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681710976:12345-0@lo:400:kworker.0 Request processed in 42us (1003us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574386.335310:0:18571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788574386.335321:0:18571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788574386.335328:0:18571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3ea4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681710592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574386.335351:0:18571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3ea4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681710592:12345-0@lo:400:kworker.0 Request processed in 24us (853us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574386.335357:0:18571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788574386.335406:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3da6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681710464:0@lo:400:kworker.0 00000100:00100000:1.0:1788574386.335418:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3ea7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681710976:0@lo:400:kworker.0 00000100:00100000:1.0:1788574386.335435:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3ea4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3617:1875455681711488:0@lo:400:kworker.0 00000100:00100000:1.0:1788574386.335445:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3da4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681710848:0@lo:400:kworker.0 00010000:00080000:1.0:1788574386.335456:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3ea6d80 x1875455681711360/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574402 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574386.335466:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3ea6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3617:1875455681711360:0@lo:400:kworker.0 00000100:00080000:1.0:1788574386.335510:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788574386.335514:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788574386.335516:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788574386.335530:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3da5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681710592:0@lo:400:kworker.0 00000100:00100000:1.0:1788574386.335539:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3ea5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875455681711104:0@lo:400:kworker.0 00010000:00080000:1.0:1788574386.335548:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c3ea7800 x1875455681711616/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574402 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574386.335556:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3ea7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3620:1875455681711616:0@lo:400:kworker.0 00000100:00100000:1.0:1788574386.335565:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3da7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875455681710720:0@lo:400:kworker.0 00000100:00100000:1.0:1788574386.335573:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3ea6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3620:1875455681711232:0@lo:400:kworker.0 00000100:00100000:3.0:1788574386.336921:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8ab0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681710080:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788574386.336965:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681710336 00000100:00100000:3.0:1788574386.336970:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681710336 00000100:00100000:3.0:1788574386.337014:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788574386.337020:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f7fc3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f73678fb-d8c0-450f-a73b-e6565942045e+24:3617:x1875455681710336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574386.337080:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f7fc3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f73678fb-d8c0-450f-a73b-e6565942045e+24:3617:x1875455681710336:12345-0@lo:400:kworker.0 Request processed in 59us (3009us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574386.337087:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788574386.337812:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3da5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f73678fb-d8c0-450f-a73b-e6565942045e:3617:1875455681710336:0@lo:400:kworker.0 00010000:00010000:3.0:1788574386.649466:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788574386.691296:0:20090:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdf66831f0 20000000:00000080:0.0:1788574386.691313:0:20090:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c85f23dd000 uarg=0000000000000000 20000000:01000000:0.0:1788574386.691356:0:20090:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788574386.691362:0:20090:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788574386.691366:0:20090:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788574386.692267:0:20091:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:0.0:1788574386.693760:0:20090:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788574386.700832:0:20090:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788574386.703318:0:20090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c85d08a3000/0x5bf8706fdac8d5a3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574386.703347:0:20090:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c84c2616e00/0x5bf8706fdac8d238 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8d231 expref: 23 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574386.703356:0:20090:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c85d20d6000/0x5bf8706fdac8d246 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8d23f expref: 23 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574386.703376:0:20090:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c85d20d6400/0x5bf8706fdac8d285 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8d27e expref: 23 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574386.703383:0:20090:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c84c2617000/0x5bf8706fdac8d3e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8d3dc expref: 23 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574386.703393:0:20090:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c860217f200/0x5bf8706fdac8d533 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6b76 expref: 12 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574386.703401:0:20090:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c860217fa00/0x5bf8706fdac8d572 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6be6 expref: 12 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574386.703408:0:20090:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c85d08a3000/0x5bf8706fdac8d5a3 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574386.703669:0:20090:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c860217fa00/0x5bf8706fdac8d572 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6be6 expref: 12 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574386.703688:0:20090:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c860217fa00/0x5bf8706fdac8d572 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6be6 expref: 12 pid: 17061 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574386.703706:0:20090:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3ea6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20090:1875455681711744:192.168.204.51@tcp:104: 00010000:00010000:1.0:1788574386.703864:0:20090:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c860217f200/0x5bf8706fdac8d533 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6b76 expref: 12 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574386.703874:0:20090:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c860217f200/0x5bf8706fdac8d533 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6b76 expref: 12 pid: 17061 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574386.703882:0:20090:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3ea7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20090:1875455681711872:192.168.204.51@tcp:104: 00010000:00010000:1.0:1788574386.703926:0:20090:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c84c2617000/0x5bf8706fdac8d3e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5bf8706fdac8d3dc expref: 23 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574386.703935:0:20090:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c84c2617000/0x5bf8706fdac8d3e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5bf8706fdac8d3dc expref: 23 pid: 17060 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574386.703945:0:20090:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3ea5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20090:1875455681712000:0@lo:104: 00000100:00100000:1.0:1788574386.703997:0:20090:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788574386.704047:0:20090:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c85d20d6400/0x5bf8706fdac8d285 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5bf8706fdac8d27e expref: 23 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574386.704056:0:20090:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c85d20d6400/0x5bf8706fdac8d285 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5bf8706fdac8d27e expref: 23 pid: 17060 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574386.704065:0:20090:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3ea4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20090:1875455681712128:0@lo:104: 00000100:00100000:1.0:1788574386.704085:0:20090:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788574386.704116:0:20090:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c85d20d6000/0x5bf8706fdac8d246 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5bf8706fdac8d23f expref: 23 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574386.704124:0:20090:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c85d20d6000/0x5bf8706fdac8d246 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5bf8706fdac8d23f expref: 23 pid: 17061 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574386.704131:0:20090:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3ea6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20090:1875455681712256:0@lo:104: 00000100:00100000:1.0:1788574386.704150:0:20090:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788574386.704168:0:20090:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c84c2616e00/0x5bf8706fdac8d238 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5bf8706fdac8d231 expref: 23 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574386.704177:0:20090:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c84c2616e00/0x5bf8706fdac8d238 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5bf8706fdac8d231 expref: 23 pid: 17060 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574386.704225:0:20090:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3da5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20090:1875455681712384:0@lo:104: 00000100:00100000:1.0:1788574386.704246:0:20090:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574386.704256:0:20090:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85fa3da6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788574386.709134:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681712000 00000100:00100000:3.0:1788574386.709151:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681712000 00000100:00100000:3.0:1788574386.709216:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681712128 00000100:00100000:3.0:1788574386.709219:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681712128 00000100:00100000:3.0:1788574386.709246:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681712256 00000100:00100000:3.0:1788574386.709249:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681712256 00000100:00100000:3.0:1788574386.709258:0:17050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681712384 00000100:00100000:3.0:1788574386.709260:0:17050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681712384 00000100:00100000:3.0:1788574386.709274:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788574386.709284:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3ea6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f73678fb-d8c0-450f-a73b-e6565942045e+6:20090:x1875455681712000:12345-0@lo:104: 00010000:00010000:3.0:1788574386.709306:0:17050:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff9c85fa32ea00/0x5bf8706fdac8d3dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8d3e3 expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574386.709403:0:17050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788574386.709409:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3ea6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f73678fb-d8c0-450f-a73b-e6565942045e+6:20090:x1875455681712000:12345-0@lo:104: Request processed in 127us (5412us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574386.709417:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788574386.709433:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788574386.709438:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3ea7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f73678fb-d8c0-450f-a73b-e6565942045e+5:20090:x1875455681712128:12345-0@lo:104: 00010000:00010000:3.0:1788574386.709447:0:17050:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff9c84c2616800/0x5bf8706fdac8d27e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8d285 expref: -99 pid: 18567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574386.709491:0:17050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788574386.709497:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3ea7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f73678fb-d8c0-450f-a73b-e6565942045e+5:20090:x1875455681712128:12345-0@lo:104: Request processed in 59us (5411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574386.709502:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788574386.709512:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788574386.709518:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3ea6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f73678fb-d8c0-450f-a73b-e6565942045e+4:20090:x1875455681712256:12345-0@lo:104: 00010000:00010000:3.0:1788574386.709526:0:17050:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff9c85fa32ec00/0x5bf8706fdac8d23f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8d246 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574386.709550:0:17050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788574386.709561:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3ea6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f73678fb-d8c0-450f-a73b-e6565942045e+4:20090:x1875455681712256:12345-0@lo:104: Request processed in 42us (5409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574386.709566:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788574386.709576:0:17050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788574386.709582:0:17050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3da7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f73678fb-d8c0-450f-a73b-e6565942045e+3:20090:x1875455681712384:12345-0@lo:104: 00010000:00010000:3.0:1788574386.709590:0:17050:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7200/0x5bf8706fdac8d231 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8d238 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574386.709615:0:17050:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1788574386.709620:0:17050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3da7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f73678fb-d8c0-450f-a73b-e6565942045e+3:20090:x1875455681712384:12345-0@lo:104: Request processed in 39us (5374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574386.709625:0:17050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1788574386.709641:0:17055:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788574386.709647:0:17055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c85fa32ea00/0x5bf8706fdac8d3dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8d3e3 expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574386.709654:0:17055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32ea00 already unused, calling callback (ffffffffc1472c20) 10000000:00010000:3.0:1788574386.709658:0:17055:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c85fa32ea00/0x5bf8706fdac8d3dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5bf8706fdac8d3e3 expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574386.709667:0:17055:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c85fa32ea00/0x5bf8706fdac8d3dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5bf8706fdac8d3e3 expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788574386.709676:0:17055:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c85fa32ea00/0x5bf8706fdac8d3dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5bf8706fdac8d3e3 expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788574386.709682:0:17055:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788574386.709719:0:17055:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9c85fa32ea00/0x5bf8706fdac8d3dc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8d3e3 expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574386.709735:0:17055:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788574386.709760:0:17055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c85fa32ea00/0x5bf8706fdac8d3dc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8d3e3 expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574386.709767:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c85fa32ea00/0x5bf8706fdac8d3dc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8d3e3 expref: -99 pid: 19385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574386.709780:0:17055:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788574386.709783:0:17055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c84c2616800/0x5bf8706fdac8d27e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8d285 expref: -99 pid: 18567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574386.709788:0:17055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c84c2616800 already unused, calling callback (ffffffffc1472c20) 10000000:00010000:3.0:1788574386.709791:0:17055:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c84c2616800/0x5bf8706fdac8d27e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5bf8706fdac8d285 expref: -99 pid: 18567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574386.709797:0:17055:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c84c2616800/0x5bf8706fdac8d27e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5bf8706fdac8d285 expref: -99 pid: 18567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788574386.709803:0:17055:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c84c2616800/0x5bf8706fdac8d27e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5bf8706fdac8d285 expref: -99 pid: 18567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788574386.709808:0:17055:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788574386.709821:0:17055:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9c84c2616800/0x5bf8706fdac8d27e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8d285 expref: -99 pid: 18567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574386.709826:0:17055:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788574386.709842:0:17055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c84c2616800/0x5bf8706fdac8d27e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8d285 expref: -99 pid: 18567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574386.709848:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c84c2616800/0x5bf8706fdac8d27e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8d285 expref: -99 pid: 18567 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574386.709862:0:17055:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788574386.709865:0:17055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c85fa32ec00/0x5bf8706fdac8d23f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8d246 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574386.709870:0:17055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85fa32ec00 already unused, calling callback (ffffffffc1472c20) 10000000:00010000:3.0:1788574386.709873:0:17055:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c85fa32ec00/0x5bf8706fdac8d23f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5bf8706fdac8d246 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574386.709879:0:17055:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c85fa32ec00/0x5bf8706fdac8d23f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5bf8706fdac8d246 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788574386.709885:0:17055:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c85fa32ec00/0x5bf8706fdac8d23f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5bf8706fdac8d246 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788574386.709890:0:17055:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788574386.709903:0:17055:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9c85fa32ec00/0x5bf8706fdac8d23f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8d246 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574386.709909:0:17055:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788574386.709914:0:17055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c85fa32ec00/0x5bf8706fdac8d23f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8d246 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574386.709920:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c85fa32ec00/0x5bf8706fdac8d23f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8d246 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574386.709929:0:17055:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788574386.709932:0:17055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7200/0x5bf8706fdac8d231 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5bf8706fdac8d238 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574386.709947:0:17055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d7200 already unused, calling callback (ffffffffc1472c20) 10000000:00010000:3.0:1788574386.709950:0:17055:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7200/0x5bf8706fdac8d231 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5bf8706fdac8d238 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574386.709956:0:17055:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7200/0x5bf8706fdac8d231 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5bf8706fdac8d238 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788574386.709962:0:17055:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7200/0x5bf8706fdac8d231 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5bf8706fdac8d238 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788574386.709966:0:17055:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788574386.709977:0:17055:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7200/0x5bf8706fdac8d231 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8d238 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574386.709982:0:17055:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788574386.709986:0:17055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7200/0x5bf8706fdac8d231 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8d238 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574386.709992:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.151@tcp lock: ffff9c85d20d7200/0x5bf8706fdac8d231 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5bf8706fdac8d238 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574386.710004:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574386.710005:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574386.710006:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574386.710026:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f73678fb-d8c0-450f-a73b-e6565942045e:3620:1875455681712512:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788574386.710060:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574386.710096:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788574386.710101:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f73678fb-d8c0-450f-a73b-e6565942045e:3620:1875455681712896:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788574386.710124:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574386.710146:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f73678fb-d8c0-450f-a73b-e6565942045e:3617:1875455681712640:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788574386.710164:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574386.710181:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788574386.710185:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f73678fb-d8c0-450f-a73b-e6565942045e:3617:1875455681712768:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788574386.710232:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574386.710265:0:17052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681712512 00000100:00100000:3.0:1788574386.710269:0:17052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681712512 00010000:00010000:3.0:1788574386.710289:0:17052:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c84c2617000/0x5bf8706fdac8d3e3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8d3dc expref: 24 pid: 17060 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574386.710303:0:17052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681712896 00000100:00100000:3.0:1788574386.710306:0:17052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681712896 00010000:00010000:3.0:1788574386.710316:0:17052:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c84c2616e00/0x5bf8706fdac8d238 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8d231 expref: 25 pid: 17060 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574386.710325:0:17052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681712640 00000100:00100000:3.0:1788574386.710327:0:17052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681712640 00010000:00010000:3.0:1788574386.710334:0:17052:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c85d20d6400/0x5bf8706fdac8d285 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8d27e expref: 26 pid: 17060 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574386.710342:0:17052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681712768 00000100:00100000:3.0:1788574386.710344:0:17052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681712768 00010000:00010000:3.0:1788574386.710352:0:17052:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c85d20d6000/0x5bf8706fdac8d246 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8d23f expref: 27 pid: 17061 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574386.710361:0:17052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788574386.710366:0:17052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf5c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f73678fb-d8c0-450f-a73b-e6565942045e+27:3620:x1875455681712512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788574386.710376:0:17052:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574386.710387:0:17052:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c84c2617000/0x5bf8706fdac8d3e3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8d3dc expref: 27 pid: 17060 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574386.710397:0:17052:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c84c2617000/0x5bf8706fdac8d3e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5bf8706fdac8d3dc expref: 27 pid: 17060 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574386.710414:0:17052:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788574386.710443:0:17052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf5c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f73678fb-d8c0-450f-a73b-e6565942045e+27:3620:x1875455681712512:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574386.710450:0:17052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788574386.710463:0:17052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788574386.710481:0:17052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f73678fb-d8c0-450f-a73b-e6565942045e+26:3620:x1875455681712896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788574386.710490:0:17052:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574386.710494:0:17052:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c84c2616e00/0x5bf8706fdac8d238 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8d231 expref: 26 pid: 17060 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574386.710502:0:17052:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c84c2616e00/0x5bf8706fdac8d238 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5bf8706fdac8d231 expref: 26 pid: 17060 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574386.710511:0:17052:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788574386.710532:0:17052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f73678fb-d8c0-450f-a73b-e6565942045e+26:3620:x1875455681712896:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574386.710538:0:17052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788574386.710548:0:17052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788574386.710553:0:17052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf5f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f73678fb-d8c0-450f-a73b-e6565942045e+25:3617:x1875455681712640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788574386.710573:0:17052:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574386.710578:0:17052:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c85d20d6400/0x5bf8706fdac8d285 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8d27e expref: 25 pid: 17060 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574386.710594:0:17052:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c85d20d6400/0x5bf8706fdac8d285 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5bf8706fdac8d27e expref: 25 pid: 17060 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574386.710603:0:17052:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788574386.710628:0:17052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf5f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f73678fb-d8c0-450f-a73b-e6565942045e+25:3617:x1875455681712640:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574386.710634:0:17052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788574386.710645:0:17052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788574386.710650:0:17052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f73678fb-d8c0-450f-a73b-e6565942045e+24:3617:x1875455681712768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788574386.710658:0:17052:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574386.710662:0:17052:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c85d20d6000/0x5bf8706fdac8d246 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5bf8706fdac8d23f expref: 24 pid: 17061 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574386.710669:0:17052:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c85d20d6000/0x5bf8706fdac8d246 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5bf8706fdac8d23f expref: 24 pid: 17061 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574386.710678:0:17052:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788574386.710697:0:17052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f73678fb-d8c0-450f-a73b-e6565942045e+24:3617:x1875455681712768:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574386.710703:0:17052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788574386.710742:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f73678fb-d8c0-450f-a73b-e6565942045e:3617:1875455681712768:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788574386.710750:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f73678fb-d8c0-450f-a73b-e6565942045e:3617:1875455681712640:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788574386.710776:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f73678fb-d8c0-450f-a73b-e6565942045e:3620:1875455681712896:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788574386.710782:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f73678fb-d8c0-450f-a73b-e6565942045e:3620:1875455681712512:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788574386.710924:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788574386.711044:0:20090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c84c2617000/0x5bf8706fdac8d3e3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5bf8706fdac8d3dc expref: 23 pid: 17060 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574386.711055:0:20090:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3ea5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20090:1875455681712000:0@lo:104: 00010000:00010000:1.0:1788574386.711065:0:20090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85d20d6400/0x5bf8706fdac8d285 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5bf8706fdac8d27e expref: 22 pid: 17060 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574386.711073:0:20090:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3ea4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20090:1875455681712128:0@lo:104: 00010000:00010000:1.0:1788574386.711081:0:20090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85d20d6000/0x5bf8706fdac8d246 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5bf8706fdac8d23f expref: 21 pid: 17061 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574386.711088:0:20090:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3ea6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20090:1875455681712256:0@lo:104: 00010000:00010000:1.0:1788574386.711097:0:20090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c84c2616e00/0x5bf8706fdac8d238 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5bf8706fdac8d231 expref: 20 pid: 17060 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574386.711104:0:20090:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3da5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20090:1875455681712384:0@lo:104: 00000100:00100000:1.0:1788574386.724765:0:20090:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3ea6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20090:1875455681711744:192.168.204.51@tcp:104: 00000100:00100000:1.0:1788574386.724782:0:20090:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3ea7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20090:1875455681711872:192.168.204.51@tcp:104: 00010000:00010000:1.0:1788574386.724821:0:20090:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c85d08a3000/0x5bf8706fdac8d5a3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574386.728838:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574386.728931:0:17052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669040128 00000100:00100000:1.0:1788574386.728942:0:17052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669040128 00010000:00010000:1.0:1788574386.729000:0:17052:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c860217fa00/0x5bf8706fdac8d572 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6be6 expref: 13 pid: 17061 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574386.729050:0:17052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 13 00000100:00100000:1.0:1788574386.729059:0:17052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa36d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1980da70-ec0a-4d33-8959-8ff61c9350d5+13:2393:x1875455669040128:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788574386.729074:0:17052:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574386.729080:0:17052:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c860217fa00/0x5bf8706fdac8d572 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6be6 expref: 13 pid: 17061 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574386.729092:0:17052:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c860217fa00/0x5bf8706fdac8d572 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6be6 expref: 13 pid: 17061 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574386.729112:0:17052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c860217fa00/0x5bf8706fdac8d572 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6be6 expref: 13 pid: 17061 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574386.729130:0:17052:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788574386.729232:0:17052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa36d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1980da70-ec0a-4d33-8959-8ff61c9350d5+12:2393:x1875455669040128:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 128us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574386.729241:0:17052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 13 00000100:00100000:0.0:1788574386.740046:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574386.740179:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669040256 00000100:00100000:3.0:1788574386.740220:0:17053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669040256 00010000:00010000:3.0:1788574386.740266:0:17053:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c860217f200/0x5bf8706fdac8d533 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6b76 expref: 12 pid: 17061 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574386.740309:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 14 00000100:00100000:3.0:1788574386.740320:0:17053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8ab0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1980da70-ec0a-4d33-8959-8ff61c9350d5+12:2394:x1875455669040256:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788574386.740338:0:17053:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574386.740343:0:17053:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c860217f200/0x5bf8706fdac8d533 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6b76 expref: 12 pid: 17061 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574386.740357:0:17053:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c860217f200/0x5bf8706fdac8d533 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6b76 expref: 12 pid: 17061 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574386.740376:0:17053:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c860217f200/0x5bf8706fdac8d533 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6b76 expref: 12 pid: 17061 timeout: 626 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574386.740395:0:17053:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c85d08a3000/0x5bf8706fdac8d5a3 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574386.740403:0:17053:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85d08a3000/0x5bf8706fdac8d5a3 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574386.740422:0:17053:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c85d08a3000/0x5bf8706fdac8d5a3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574386.740429:0:17053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c85d08a3000/0x5bf8706fdac8d5a3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574386.740447:0:17053:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c85d08a3000/0x5bf8706fdac8d5a3 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574386.740482:0:17053:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c85d08a3000/0x5bf8706fdac8d5a3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574386.740489:0:17053:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d08a3000 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:3.0:1788574386.740493:0:17053:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c85d08a3000/0x5bf8706fdac8d5a3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574386.740502:0:17053:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c85d08a3000/0x5bf8706fdac8d5a3 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574386.740531:0:17053:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c85d08a3000/0x5bf8706fdac8d5a3 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574386.740543:0:17053:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788574386.740597:0:17053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8ab0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1980da70-ec0a-4d33-8959-8ff61c9350d5+11:2394:x1875455669040256:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 278us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574386.740605:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 14 00010000:00010000:2.0:1788574386.740683:0:20090:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c85d08a3000/0x5bf8706fdac8d5a3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574386.740692:0:20090:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c85d08a3000/0x5bf8706fdac8d5a3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574386.740699:0:20090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c85d08a3000/0x5bf8706fdac8d5a3 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574387.667913:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788574388.307302:0:17064:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788574388.307314:0:17064:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c84c2216000 from 13 10000000:01000000:3.0:1788574388.307321:0:17064:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788574388.307415:0:17064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85faea3800/0x5bf8706fdac8d5aa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574388.307431:0:17064:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c85faea3800/0x5bf8706fdac8d5aa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574388.307453:0:17064:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c85faea3800/0x5bf8706fdac8d5aa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574388.307491:0:17064:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf5e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f73678fb-d8c0-450f-a73b-e6565942045e:17064:1875455681713024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788574388.307594:0:17064:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574388.307658:0:17064:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c82c7480 going to sleep for 11 seconds 00000100:00100000:2.0:1788574388.307885:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681713024 00000100:00100000:2.0:1788574388.307896:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681713024 00000100:00100000:2.0:1788574388.307964:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788574388.307974:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f7fc0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f73678fb-d8c0-450f-a73b-e6565942045e+20:17064:x1875455681713024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788574388.307990:0:17062:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574388.308010:0:17062:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c860217e000/0x5bf8706fdac8d5b1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8d5aa expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574388.308037:0:17062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c860217e000/0x5bf8706fdac8d5b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8d5aa expref: 21 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574388.308050:0:17062:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c860217e000/0x5bf8706fdac8d5b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8d5aa expref: 21 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574388.308060:0:17062:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c860217e000, rc 0) 00000100:00100000:2.0:1788574388.308129:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f7fc0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f73678fb-d8c0-450f-a73b-e6565942045e+21:17064:x1875455681713024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 156us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574388.308146:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788574388.308280:0:17064:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf5e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f73678fb-d8c0-450f-a73b-e6565942045e:17064:1875455681713024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788574388.308301:0:17064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c85faea3800/0x5bf8706fdac8d5aa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d5b1 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574388.308313:0:17064:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c85faea3800/0x5bf8706fdac8d5aa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8d5b1 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574388.308410:0:17064:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85c8ab0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f73678fb-d8c0-450f-a73b-e6565942045e:17064:1875455681713152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788574388.308453:0:17064:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574388.308485:0:17064:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c357fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788574388.308578:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681713152 00000100:00100000:2.0:1788574388.308583:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681713152 00000100:00100000:2.0:1788574388.308616:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788574388.308624:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f7fc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f73678fb-d8c0-450f-a73b-e6565942045e+21:17064:x1875455681713152:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788574388.308767:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f7fc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f73678fb-d8c0-450f-a73b-e6565942045e+21:17064:x1875455681713152:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 144us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574388.308773:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788574388.308805:0:17064:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85c8ab0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f73678fb-d8c0-450f-a73b-e6565942045e:17064:1875455681713152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788574388.308838:0:17064:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c8601834380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f73678fb-d8c0-450f-a73b-e6565942045e:17064:1875455681713280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788574388.308879:0:17064:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574388.308895:0:17064:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c860198e180 going to sleep for 11 seconds 00000100:00100000:2.0:1788574388.308907:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681713280 00000100:00100000:2.0:1788574388.308910:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681713280 00000100:00100000:2.0:1788574388.308928:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788574388.308934:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f7fc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f73678fb-d8c0-450f-a73b-e6565942045e+21:17064:x1875455681713280:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788574388.309014:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f7fc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f73678fb-d8c0-450f-a73b-e6565942045e+21:17064:x1875455681713280:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 80us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574388.309020:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788574388.309058:0:17064:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c8601834380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f73678fb-d8c0-450f-a73b-e6565942045e:17064:1875455681713280:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788574388.311003:0:20164:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788574388.313590:0:17064:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788574388.313640:0:17064:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788574388.313656:0:17064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85faea3800/0x5bf8706fdac8d5aa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d5b1 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574388.313700:0:17064:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c85faea3800/0x5bf8706fdac8d5aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d5b1 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788574388.313713:0:17064:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788574388.313716:0:17064:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c85c8a34800 from 13 10000000:01000000:2.0:1788574388.313720:0:17064:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788574388.313770:0:17064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c860217fc00/0x5bf8706fdac8d5b8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574388.313780:0:17064:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c860217fc00/0x5bf8706fdac8d5b8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574388.313792:0:17064:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c860217fc00/0x5bf8706fdac8d5b8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574388.313826:0:17064:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c8601834380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f73678fb-d8c0-450f-a73b-e6565942045e:17064:1875455681713408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788574388.313925:0:17064:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574388.316719:0:17064:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c860198e780 going to sleep for 11 seconds 00000100:00100000:3.0:1788574388.318605:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681713408 00000100:00100000:3.0:1788574388.318626:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681713408 00000100:00100000:3.0:1788574388.318709:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788574388.318724:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f7fc1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f73678fb-d8c0-450f-a73b-e6565942045e+21:17064:x1875455681713408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788574388.318747:0:17061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574388.318767:0:17061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85faea3600/0x5bf8706fdac8d5bf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8d5b8 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574388.318802:0:17061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85faea3600/0x5bf8706fdac8d5bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8d5b8 expref: 22 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574388.318817:0:17061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85faea3600/0x5bf8706fdac8d5bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8d5b8 expref: 22 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574388.318829:0:17061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85faea3600, rc 0) 00000100:00100000:3.0:1788574388.318939:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f7fc1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f73678fb-d8c0-450f-a73b-e6565942045e+22:17064:x1875455681713408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 218us (5012us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574388.318946:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788574388.320653:0:17064:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c8601834380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f73678fb-d8c0-450f-a73b-e6565942045e:17064:1875455681713408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788574388.320690:0:17064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c860217fc00/0x5bf8706fdac8d5b8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d5bf expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574388.320705:0:17064:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c860217fc00/0x5bf8706fdac8d5b8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8d5bf expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574388.320823:0:17064:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3da5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f73678fb-d8c0-450f-a73b-e6565942045e:17064:1875455681713536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788574388.320923:0:17064:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574388.320987:0:17064:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85fa3da180 going to sleep for 11 seconds 00000100:00100000:3.0:1788574388.321002:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681713536 00000100:00100000:3.0:1788574388.321011:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681713536 00000100:00100000:3.0:1788574388.321080:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788574388.321091:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f7fc2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f73678fb-d8c0-450f-a73b-e6565942045e+22:17064:x1875455681713536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788574388.321290:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f7fc2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f73678fb-d8c0-450f-a73b-e6565942045e+22:17064:x1875455681713536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 200us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574388.321299:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788574388.323769:0:17064:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3da5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f73678fb-d8c0-450f-a73b-e6565942045e:17064:1875455681713536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788574388.323853:0:17064:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3da5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f73678fb-d8c0-450f-a73b-e6565942045e:17064:1875455681713664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788574388.323942:0:17064:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574388.324005:0:17064:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85fa3da180 going to sleep for 11 seconds 00000100:00100000:2.0:1788574388.324928:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681713664 00000100:00100000:2.0:1788574388.324941:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681713664 00000100:00100000:2.0:1788574388.325006:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788574388.325017:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f7fc3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f73678fb-d8c0-450f-a73b-e6565942045e+22:17064:x1875455681713664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788574388.325240:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f7fc3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f73678fb-d8c0-450f-a73b-e6565942045e+22:17064:x1875455681713664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 223us (1297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574388.325249:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788574388.326749:0:17064:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3da5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f73678fb-d8c0-450f-a73b-e6565942045e:17064:1875455681713664:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788574388.329856:0:20167:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788574388.330046:0:17064:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788574388.330068:0:17064:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788574388.330080:0:17064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c860217fc00/0x5bf8706fdac8d5b8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d5bf expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574388.330092:0:17064:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c860217fc00/0x5bf8706fdac8d5b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d5bf expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788574388.330104:0:17064:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788574388.330107:0:17064:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c85c3688000 from 13 10000000:01000000:3.0:1788574388.330110:0:17064:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788574388.330149:0:17064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85faea2c00/0x5bf8706fdac8d5c6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574388.330157:0:17064:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c85faea2c00/0x5bf8706fdac8d5c6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574388.330168:0:17064:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c85faea2c00/0x5bf8706fdac8d5c6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574388.330226:0:17064:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf5dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f73678fb-d8c0-450f-a73b-e6565942045e:17064:1875455681713792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788574388.330303:0:17064:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574388.330352:0:17064:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c82c7480 going to sleep for 11 seconds 00000100:00100000:2.0:1788574388.331088:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681713792 00000100:00100000:2.0:1788574388.331101:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681713792 00000100:00100000:2.0:1788574388.331176:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788574388.331905:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1b9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f73678fb-d8c0-450f-a73b-e6565942045e+22:17064:x1875455681713792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788574388.331926:0:17060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574388.331947:0:17060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c860217fe00/0x5bf8706fdac8d5cd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8d5c6 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574388.332028:0:17060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c860217fe00/0x5bf8706fdac8d5cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8d5c6 expref: 23 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574388.332041:0:17060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c860217fe00/0x5bf8706fdac8d5cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8d5c6 expref: 23 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574388.332050:0:17060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c860217fe00, rc 0) 00000100:00100000:2.0:1788574388.333805:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1b9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f73678fb-d8c0-450f-a73b-e6565942045e+23:17064:x1875455681713792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1899us (3495us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574388.333818:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788574388.334424:0:17064:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf5dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f73678fb-d8c0-450f-a73b-e6565942045e:17064:1875455681713792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788574388.334461:0:17064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c85faea2c00/0x5bf8706fdac8d5c6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d5cd expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574388.334476:0:17064:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c85faea2c00/0x5bf8706fdac8d5c6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8d5cd expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574388.334575:0:17064:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf5dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f73678fb-d8c0-450f-a73b-e6565942045e:17064:1875455681713920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788574388.334616:0:17064:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574388.334663:0:17064:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c82c7480 going to sleep for 11 seconds 00000100:00100000:2.0:1788574388.334727:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681713920 00000100:00100000:2.0:1788574388.334734:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681713920 00000100:00100000:2.0:1788574388.334779:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788574388.334787:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1b9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f73678fb-d8c0-450f-a73b-e6565942045e+23:17064:x1875455681713920:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788574388.334942:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1b9c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f73678fb-d8c0-450f-a73b-e6565942045e+23:17064:x1875455681713920:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 155us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574388.334951:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788574388.336857:0:17064:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf5dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f73678fb-d8c0-450f-a73b-e6565942045e:17064:1875455681713920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788574388.336953:0:17064:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3da5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f73678fb-d8c0-450f-a73b-e6565942045e:17064:1875455681714048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788574388.337045:0:17064:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574388.337097:0:17064:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85fa3da180 going to sleep for 11 seconds 00000100:00100000:3.0:1788574388.337117:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681714048 00000100:00100000:3.0:1788574388.337125:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681714048 00000100:00100000:3.0:1788574388.337208:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788574388.337219:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1b9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f73678fb-d8c0-450f-a73b-e6565942045e+23:17064:x1875455681714048:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788574388.337358:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1b9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f73678fb-d8c0-450f-a73b-e6565942045e+23:17064:x1875455681714048:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 140us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574388.337367:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788574388.337419:0:17064:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3da5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f73678fb-d8c0-450f-a73b-e6565942045e:17064:1875455681714048:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788574388.338643:0:20169:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788574388.338865:0:17064:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788574388.338891:0:17064:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788574388.338901:0:17064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85faea2c00/0x5bf8706fdac8d5c6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d5cd expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574388.338914:0:17064:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c85faea2c00/0x5bf8706fdac8d5c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d5cd expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788574388.338932:0:17064:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788574388.338934:0:17064:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c84c3fd7800 from 13 10000000:01000000:1.0:1788574388.338938:0:17064:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788574388.338982:0:17064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2800/0x5bf8706fdac8d5d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574388.338990:0:17064:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2800/0x5bf8706fdac8d5d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574388.339000:0:17064:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2800/0x5bf8706fdac8d5d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574388.339036:0:17064:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3da4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f73678fb-d8c0-450f-a73b-e6565942045e:17064:1875455681714176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788574388.339100:0:17064:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574388.339145:0:17064:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85fa3da180 going to sleep for 11 seconds 00000100:00100000:2.0:1788574388.339280:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681714176 00000100:00100000:2.0:1788574388.339289:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681714176 00000100:00100000:2.0:1788574388.339332:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788574388.339341:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1b9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f73678fb-d8c0-450f-a73b-e6565942045e+23:17064:x1875455681714176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788574388.339355:0:17061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574388.339375:0:17061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c860217ec00/0x5bf8706fdac8d5db lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5bf8706fdac8d5d4 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574388.339404:0:17061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c860217ec00/0x5bf8706fdac8d5db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5bf8706fdac8d5d4 expref: 24 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574388.339416:0:17061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c860217ec00/0x5bf8706fdac8d5db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5bf8706fdac8d5d4 expref: 24 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574388.339425:0:17061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c860217ec00, rc 0) 00000100:00100000:2.0:1788574388.339652:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1b9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f73678fb-d8c0-450f-a73b-e6565942045e+24:17064:x1875455681714176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 311us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574388.339660:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788574388.339996:0:17064:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3da4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f73678fb-d8c0-450f-a73b-e6565942045e:17064:1875455681714176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788574388.340013:0:17064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2800/0x5bf8706fdac8d5d4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d5db expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574388.340025:0:17064:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2800/0x5bf8706fdac8d5d4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5bf8706fdac8d5db expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574388.340086:0:17064:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3da4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f73678fb-d8c0-450f-a73b-e6565942045e:17064:1875455681714304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788574388.340119:0:17064:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574388.340250:0:17064:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85fa3da180 going to sleep for 11 seconds 00000100:00100000:3.0:1788574388.340298:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681714304 00000100:00100000:3.0:1788574388.340304:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681714304 00000100:00100000:3.0:1788574388.340366:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788574388.340376:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1b9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f73678fb-d8c0-450f-a73b-e6565942045e+24:17064:x1875455681714304:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788574388.340502:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1b9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f73678fb-d8c0-450f-a73b-e6565942045e+24:17064:x1875455681714304:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 127us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574388.340509:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788574388.340692:0:17064:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3da4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f73678fb-d8c0-450f-a73b-e6565942045e:17064:1875455681714304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788574388.340723:0:17064:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf5c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f73678fb-d8c0-450f-a73b-e6565942045e:17064:1875455681714432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788574388.340769:0:17064:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574388.340829:0:17064:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85d10829c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788574388.340908:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681714432 00000100:00100000:2.0:1788574388.340912:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681714432 00000100:00100000:2.0:1788574388.341284:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788574388.341295:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1b9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f73678fb-d8c0-450f-a73b-e6565942045e+24:17064:x1875455681714432:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788574388.341407:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1b9dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f73678fb-d8c0-450f-a73b-e6565942045e+24:17064:x1875455681714432:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 114us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574388.341415:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788574388.341511:0:17064:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf5c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f73678fb-d8c0-450f-a73b-e6565942045e:17064:1875455681714432:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788574388.342229:0:20170:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788574388.342289:0:17064:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788574388.342313:0:17064:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788574388.342326:0:17064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2800/0x5bf8706fdac8d5d4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d5db expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574388.342337:0:17064:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.151@tcp lock: ffff9c85d08a2800/0x5bf8706fdac8d5d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5bf8706fdac8d5db expref: -99 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574388.686552:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574388.686884:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669040384 00000100:00100000:3.0:1788574388.686896:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669040384 00000100:00100000:3.0:1788574388.686957:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 160 00000100:00100000:3.0:1788574388.686968:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1b9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1980da70-ec0a-4d33-8959-8ff61c9350d5+11:14904:x1875455669040384:12345-192.168.204.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788574388.686986:0:17062:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574388.687004:0:17062:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85faea2000/0x5bf8706fdac8d5e2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6c1e expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574388.687034:0:17062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85faea2000/0x5bf8706fdac8d5e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6c1e expref: 12 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574388.687045:0:17062:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85faea2000/0x5bf8706fdac8d5e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6c1e expref: 12 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574388.687054:0:17062:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85faea2000, rc 0) 00000100:00100000:3.0:1788574388.687149:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1b9e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1980da70-ec0a-4d33-8959-8ff61c9350d5+12:14904:x1875455669040384:12345-192.168.204.51@tcp:101:ll_cfg_requeue.0 Request processed in 182us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574388.687157:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 160 00010000:00010000:2.0:1788574388.691583:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574388.698808:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574388.699346:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669040512 00000100:00100000:2.0:1788574388.699356:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669040512 00000100:00100000:2.0:1788574388.699423:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 161 00000100:00100000:2.0:1788574388.699444:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1b9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1980da70-ec0a-4d33-8959-8ff61c9350d5+12:14904:x1875455669040512:12345-192.168.204.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788574388.699591:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1b9f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1980da70-ec0a-4d33-8959-8ff61c9350d5+12:14904:x1875455669040512:12345-192.168.204.51@tcp:501:ll_cfg_requeue.0 Request processed in 158us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574388.699600:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 161 00000100:00100000:0.0:1788574388.704481:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574388.706856:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669040640 00000100:00100000:1.0:1788574388.706875:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669040640 00000100:00100000:0.0:1788574388.707131:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 162 00000100:00100000:0.0:1788574388.707142:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1b9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1980da70-ec0a-4d33-8959-8ff61c9350d5+12:14904:x1875455669040640:12345-192.168.204.51@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788574388.707336:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1b9ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1980da70-ec0a-4d33-8959-8ff61c9350d5+12:14904:x1875455669040640:12345-192.168.204.51@tcp:503:ll_cfg_requeue.0 Request processed in 195us (2864us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574388.707456:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 162 00000100:00100000:0.0:1788574388.723564:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574388.723784:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669040768 00000100:00100000:3.0:1788574388.723794:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669040768 00000100:00100000:3.0:1788574388.723854:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 163 00000100:00100000:3.0:1788574388.723865:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1b9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1980da70-ec0a-4d33-8959-8ff61c9350d5+12:14904:x1875455669040768:12345-192.168.204.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788574388.723884:0:17062:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574388.723905:0:17062:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c85faea3e00/0x5bf8706fdac8d5e9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6c25 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574388.724153:0:17062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c85faea3e00/0x5bf8706fdac8d5e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6c25 expref: 13 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574388.724167:0:17062:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c85faea3e00/0x5bf8706fdac8d5e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6c25 expref: 13 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574388.724177:0:17062:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85faea3e00, rc 0) 00000100:00100000:3.0:1788574388.724259:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1b9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1980da70-ec0a-4d33-8959-8ff61c9350d5+13:14904:x1875455669040768:12345-192.168.204.51@tcp:101:ll_cfg_requeue.0 Request processed in 395us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574388.724266:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 163 00000100:00100000:3.0:1788574388.727795:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574388.727913:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669040896 00000100:00100000:0.0:1788574388.728039:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669040896 00000100:00100000:0.0:1788574388.728102:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 164 00000100:00100000:0.0:1788574388.728113:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1b9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1980da70-ec0a-4d33-8959-8ff61c9350d5+13:14904:x1875455669040896:12345-192.168.204.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788574388.728519:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1b9d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1980da70-ec0a-4d33-8959-8ff61c9350d5+13:14904:x1875455669040896:12345-192.168.204.51@tcp:501:ll_cfg_requeue.0 Request processed in 406us (731us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574388.728528:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 164 00000100:00100000:0.0:1788574388.733863:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574388.733967:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669041024 00000100:00100000:2.0:1788574388.733977:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669041024 00000100:00100000:3.0:1788574388.734182:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 165 00000100:00100000:3.0:1788574388.734233:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1b9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1980da70-ec0a-4d33-8959-8ff61c9350d5+13:14904:x1875455669041024:12345-192.168.204.51@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788574388.734381:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1b9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1980da70-ec0a-4d33-8959-8ff61c9350d5+13:14904:x1875455669041024:12345-192.168.204.51@tcp:503:ll_cfg_requeue.0 Request processed in 154us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574388.734390:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 165 00000100:00100000:0.0:1788574388.884989:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788574388.885019:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c8601837480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681714560:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788574388.885102:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574388.885598:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681714560 00000100:00100000:2.0:1788574388.885609:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681714560 00000100:00100000:2.0:1788574388.885683:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788574388.885693:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8ab2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681714560:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788574388.885729:0:18576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788574388.885790:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8ab2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681714560:12345-0@lo:13:osp-pre-0-1.0 Request processed in 98us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574388.885798:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788574388.885846:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c8601837480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681714560:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788574388.886600:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788574389.716246:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574389.833276:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574389.833321:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574389.833349:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574389.833370:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574389.833381:0:18571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669041664 00000100:00100000:0.0:1788574389.833389:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574389.833391:0:18571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669041664 00000100:00100000:0.0:1788574389.833406:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574389.833436:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574389.833452:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574389.833461:0:18571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669042176 00000100:00100000:1.0:1788574389.833464:0:18571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669042176 00000100:00100000:1.0:1788574389.833476:0:18571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669041536 00000100:00100000:1.0:1788574389.833478:0:18571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669041536 00000100:00100000:1.0:1788574389.833494:0:18571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 17 00000100:00100000:1.0:1788574389.833505:0:18571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8ab3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:74bce780-6a9f-42e0-9637-fe6b1665ce5b+5:2395:x1875455669041664:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1788574389.833505:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00080000:0.0:1788574389.833519:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788574389.833527:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788574389.833577:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669041408 00000100:00100000:0.0:1788574389.833581:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669041408 00000100:00100000:1.0:1788574389.833585:0:18571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8ab3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:74bce780-6a9f-42e0-9637-fe6b1665ce5b+5:2395:x1875455669041664:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 84us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574389.833602:0:18571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 17 00000100:00100000:0.0:1788574389.833607:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669041920 00000100:00100000:0.0:1788574389.833609:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669041920 00000100:00100000:1.0:1788574389.833618:0:18571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669042048 00000100:00100000:1.0:1788574389.833620:0:18571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669042048 00000100:00100000:0.0:1788574389.833623:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669041280 00000100:00100000:0.0:1788574389.833625:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669041280 00000100:00100000:1.0:1788574389.833634:0:18571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 18 00000100:00100000:0.0:1788574389.833637:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669041792 00000100:00100000:0.0:1788574389.833639:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669041792 00000100:00100000:1.0:1788574389.833640:0:18571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8ab1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:408a814b-bde8-48f8-9467-4baee1a765d4+5:2395:x1875455669042176:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1788574389.833654:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 54 00000100:00100000:0.0:1788574389.833660:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8ab0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74bce780-6a9f-42e0-9637-fe6b1665ce5b+5:2395:x1875455669041408:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788574389.833662:0:18571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8ab1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:408a814b-bde8-48f8-9467-4baee1a765d4+5:2395:x1875455669042176:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 24us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574389.833685:0:18571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 18 00000100:00100000:0.0:1788574389.833686:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8ab0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74bce780-6a9f-42e0-9637-fe6b1665ce5b+5:2395:x1875455669041408:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 27us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574389.833692:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 54 00000100:00100000:1.0:1788574389.833697:0:18571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 19 00000100:00100000:1.0:1788574389.833703:0:18571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8ab0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:74bce780-6a9f-42e0-9637-fe6b1665ce5b+5:2395:x1875455669041536:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1788574389.833704:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 55 00000100:00100000:0.0:1788574389.833709:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8ab0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:408a814b-bde8-48f8-9467-4baee1a765d4+5:2395:x1875455669041920:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788574389.833723:0:18571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8ab0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:74bce780-6a9f-42e0-9637-fe6b1665ce5b+5:2395:x1875455669041536:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 21us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574389.833726:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8ab0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:408a814b-bde8-48f8-9467-4baee1a765d4+5:2395:x1875455669041920:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 17us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574389.833729:0:18571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 19 00000100:00100000:0.0:1788574389.833731:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 55 00000100:00100000:1.0:1788574389.833738:0:18571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 20 00000100:00100000:0.0:1788574389.833741:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 56 00000100:00100000:1.0:1788574389.833744:0:18571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f6670700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:408a814b-bde8-48f8-9467-4baee1a765d4+5:2395:x1875455669042048:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1788574389.833746:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8ab0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74bce780-6a9f-42e0-9637-fe6b1665ce5b+6:2395:x1875455669041280:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788574389.833762:0:18571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f6670700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:408a814b-bde8-48f8-9467-4baee1a765d4+5:2395:x1875455669042048:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 18us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574389.833763:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8ab0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74bce780-6a9f-42e0-9637-fe6b1665ce5b+6:2395:x1875455669041280:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 17us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574389.833768:0:18571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 20 00000100:00100000:0.0:1788574389.833768:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 56 00000100:00100000:0.0:1788574389.833778:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 57 00000100:00100000:0.0:1788574389.833798:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c8ab1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:408a814b-bde8-48f8-9467-4baee1a765d4+6:2395:x1875455669041792:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:0.0:1788574389.833830:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c8ab1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:408a814b-bde8-48f8-9467-4baee1a765d4+6:2395:x1875455669041792:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 46us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574389.833836:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 57 00000100:00080000:0.0:1788574389.833850:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788574389.833853:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788574389.833855:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788574389.834647:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669041152 00000100:00100000:2.0:1788574389.834656:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669041152 00000100:00100000:2.0:1788574389.834715:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 166 00000100:00100000:2.0:1788574389.834722:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1b9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1980da70-ec0a-4d33-8959-8ff61c9350d5+13:2395:x1875455669041152:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:2.0:1788574389.834771:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1b9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1980da70-ec0a-4d33-8959-8ff61c9350d5+13:2395:x1875455669041152:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 49us (1505us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574389.834778:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 166 00000100:00100000:0.0:1788574389.960080:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574389.960219:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669042304 00000100:00100000:1.0:1788574389.960232:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669042304 00000100:00100000:1.0:1788574389.960309:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 23 00000100:00100000:1.0:1788574389.960320:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f6670e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74bce780-6a9f-42e0-9637-fe6b1665ce5b+6:15572:x1875455669042304:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788574389.960344:0:17069:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574389.960382:0:17069:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2000/0x5bf8706fdac8d5f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6c2c expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574389.960463:0:17069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2e00/0x5bf8706fdac8d5f7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574389.960478:0:17069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2e00/0x5bf8706fdac8d5f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574389.960491:0:17069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2e00/0x5bf8706fdac8d5f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574389.960504:0:17069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2200/0x5bf8706fdac8d5fe lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574389.960511:0:17069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2200/0x5bf8706fdac8d5fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574389.960518:0:17069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2200/0x5bf8706fdac8d5fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574389.960615:0:17069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a3800/0x5bf8706fdac8d605 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574389.960624:0:17069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a3800/0x5bf8706fdac8d605 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574389.960630:0:17069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a3800/0x5bf8706fdac8d605 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788574389.960657:0:17069:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788574389.960660:0:17069:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788574389.960696:0:17069:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a3800/0x5bf8706fdac8d605 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574389.960713:0:17069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2e00/0x5bf8706fdac8d5f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574389.960720:0:17069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2e00/0x5bf8706fdac8d5f7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574389.960727:0:17069:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2e00/0x5bf8706fdac8d5f7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574389.960732:0:17069:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d08a2e00 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:1.0:1788574389.960736:0:17069:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2e00/0x5bf8706fdac8d5f7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574389.960743:0:17069:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2e00/0x5bf8706fdac8d5f7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574389.960755:0:17069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c85c6b82a00) 00010000:00010000:1.0:1788574389.960758:0:17069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788574389.960762:0:17069:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2e00/0x5bf8706fdac8d5f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574389.960769:0:17069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2e00/0x5bf8706fdac8d5f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574389.960781:0:17069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2200/0x5bf8706fdac8d5fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574389.960786:0:17069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2200/0x5bf8706fdac8d5fe lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574389.960792:0:17069:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2200/0x5bf8706fdac8d5fe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574389.960801:0:17069:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d08a2200 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:1.0:1788574389.960804:0:17069:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2200/0x5bf8706fdac8d5fe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574389.960810:0:17069:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2200/0x5bf8706fdac8d5fe lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574389.960816:0:17069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9c84c34f0d00) 00010000:00010000:1.0:1788574389.960819:0:17069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788574389.960821:0:17069:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2200/0x5bf8706fdac8d5fe lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574389.960826:0:17069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2200/0x5bf8706fdac8d5fe lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574389.960859:0:17069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2000/0x5bf8706fdac8d5f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6c2c expref: 8 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574389.960872:0:17069:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a3800/0x5bf8706fdac8d605 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6c2c expref: 7 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574389.960879:0:17069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9c84c34f0800) 00010000:00010000:1.0:1788574389.960882:0:17069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788574389.960884:0:17069:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d08a3800, rc 0) 00000100:00100000:1.0:1788574389.960948:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f6670e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74bce780-6a9f-42e0-9637-fe6b1665ce5b+7:15572:x1875455669042304:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 631us (879us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574389.960956:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 23 00000100:00100000:0.0:1788574389.973150:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574389.973780:0:17079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669042432 00000100:00100000:3.0:1788574389.973792:0:17079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669042432 00000100:00100000:3.0:1788574389.973899:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 5 00000100:00100000:3.0:1788574389.974094:0:17079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f6672680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:74bce780-6a9f-42e0-9637-fe6b1665ce5b+7:15572:x1875455669042432:12345-192.168.204.51@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1788574389.974876:0:17079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f6672680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:74bce780-6a9f-42e0-9637-fe6b1665ce5b+7:15572:x1875455669042432:12345-192.168.204.51@tcp:900:lhsmtool_posix.0 Request processed in 782us (1732us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574389.974886:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 5 00000100:00100000:0.0:1788574389.987839:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574389.988573:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669042688 00000100:00100000:1.0:1788574389.988598:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669042688 00000100:00100000:1.0:1788574389.988665:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 24 00000100:00100000:1.0:1788574389.988676:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f6672300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74bce780-6a9f-42e0-9637-fe6b1665ce5b+7:15572:x1875455669042688:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788574389.988698:0:17068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574389.988720:0:17068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2000/0x5bf8706fdac8d60c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6c33 expref: -99 pid: 17068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574389.988801:0:17068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2200/0x5bf8706fdac8d613 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574389.988817:0:17068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2200/0x5bf8706fdac8d613 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574389.988829:0:17068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2200/0x5bf8706fdac8d613 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574389.988895:0:17068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2e00/0x5bf8706fdac8d61a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574389.988903:0:17068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2e00/0x5bf8706fdac8d61a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574389.988910:0:17068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2e00/0x5bf8706fdac8d61a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574389.990275:0:17068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a3200/0x5bf8706fdac8d621 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574389.990297:0:17068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a3200/0x5bf8706fdac8d621 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574389.990309:0:17068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a3200/0x5bf8706fdac8d621 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788574389.990335:0:17068:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1788574389.991710:0:17068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2200/0x5bf8706fdac8d613 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574389.991725:0:17068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2200/0x5bf8706fdac8d613 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574389.991732:0:17068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2200/0x5bf8706fdac8d613 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574389.991738:0:17068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d08a2200 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:1.0:1788574389.991743:0:17068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2200/0x5bf8706fdac8d613 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574389.991751:0:17068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2200/0x5bf8706fdac8d613 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574389.991766:0:17068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9c84c34f0800) 00010000:00010000:1.0:1788574389.991769:0:17068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788574389.991774:0:17068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2200/0x5bf8706fdac8d613 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574389.991779:0:17068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2200/0x5bf8706fdac8d613 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574389.991794:0:17068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2e00/0x5bf8706fdac8d61a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574389.991799:0:17068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2e00/0x5bf8706fdac8d61a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574389.991820:0:17068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2e00/0x5bf8706fdac8d61a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574389.991825:0:17068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d08a2e00 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:1.0:1788574389.991828:0:17068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2e00/0x5bf8706fdac8d61a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574389.991834:0:17068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2e00/0x5bf8706fdac8d61a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574389.991842:0:17068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9c84c34f0d00) 00010000:00010000:1.0:1788574389.991845:0:17068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788574389.991848:0:17068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2e00/0x5bf8706fdac8d61a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574389.991854:0:17068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2e00/0x5bf8706fdac8d61a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574389.993703:0:17068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2000/0x5bf8706fdac8d60c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6c33 expref: 10 pid: 17068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574389.993729:0:17068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a3200/0x5bf8706fdac8d621 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6c33 expref: 9 pid: 17068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574389.993738:0:17068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c84c34f0e00) 00010000:00010000:1.0:1788574389.993740:0:17068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788574389.993744:0:17068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d08a3200, rc 0) 00000100:00100000:1.0:1788574389.993816:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f6672300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74bce780-6a9f-42e0-9637-fe6b1665ce5b+9:15572:x1875455669042688:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 5141us (5987us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788574389.993839:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 24 00000100:00100000:0.0:1788574389.999771:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574389.999820:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669042816 00000100:00100000:1.0:1788574389.999830:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669042816 00000100:00100000:1.0:1788574389.999932:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 25 00000100:00100000:1.0:1788574389.999944:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f6672d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74bce780-6a9f-42e0-9637-fe6b1665ce5b+9:15572:x1875455669042816:12345-192.168.204.51@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788574390.000059:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f6672d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74bce780-6a9f-42e0-9637-fe6b1665ce5b+9:15572:x1875455669042816:12345-192.168.204.51@tcp:59:lhsmtool_posix.0 Request processed in 118us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574390.000067:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 25 00000100:00100000:0.0:1788574390.014381:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574390.014671:0:18898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669042944 00000100:00100000:3.0:1788574390.014682:0:18898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669042944 00000100:00100000:3.0:1788574390.014747:0:18898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 26 00000100:00100000:3.0:1788574390.014757:0:18898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f6671f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74bce780-6a9f-42e0-9637-fe6b1665ce5b+5:15572:x1875455669042944:12345-192.168.204.51@tcp:59:lhsmtool_posix.0 00000004:00080000:0.0:1788574390.021182:0:18898:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 6376us 00000100:00100000:0.0:1788574390.031254:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574390.031388:0:17067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669043072 00000100:00100000:2.0:1788574390.031399:0:17067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669043072 00000100:00100000:2.0:1788574390.031479:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 27 00000100:00100000:2.0:1788574390.031490:0:17067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f6671880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74bce780-6a9f-42e0-9637-fe6b1665ce5b+9:15578:x1875455669043072:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:2.0:1788574390.031513:0:17067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574390.031539:0:17067:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217fa00/0x5bf8706fdac8d62f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6c3a expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574390.031607:0:17067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217f200/0x5bf8706fdac8d636 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574390.031638:0:17067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217f200/0x5bf8706fdac8d636 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574390.031653:0:17067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217f200/0x5bf8706fdac8d636 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574390.031668:0:17067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e200/0x5bf8706fdac8d63d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574390.031676:0:17067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e200/0x5bf8706fdac8d63d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574390.031683:0:17067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e200/0x5bf8706fdac8d63d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574390.031729:0:17067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217f200/0x5bf8706fdac8d636 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574390.031736:0:17067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217f200/0x5bf8706fdac8d636 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574390.031743:0:17067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217f200/0x5bf8706fdac8d636 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574390.031749:0:17067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c860217f200 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:2.0:1788574390.031753:0:17067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217f200/0x5bf8706fdac8d636 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574390.031761:0:17067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217f200/0x5bf8706fdac8d636 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574390.031786:0:17067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c85c6b82a00) 00010000:00010000:2.0:1788574390.031795:0:17067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788574390.031801:0:17067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217f200/0x5bf8706fdac8d636 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574390.031806:0:17067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217f200/0x5bf8706fdac8d636 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574390.031822:0:17067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e200/0x5bf8706fdac8d63d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574390.031828:0:17067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e200/0x5bf8706fdac8d63d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574390.031834:0:17067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e200/0x5bf8706fdac8d63d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574390.031839:0:17067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c860217e200 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:2.0:1788574390.031842:0:17067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e200/0x5bf8706fdac8d63d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574390.031847:0:17067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e200/0x5bf8706fdac8d63d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574390.031854:0:17067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9c85c4fa6200) 00010000:00010000:2.0:1788574390.031857:0:17067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788574390.031860:0:17067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e200/0x5bf8706fdac8d63d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574390.031866:0:17067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e200/0x5bf8706fdac8d63d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574390.031899:0:17067:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217fa00/0x5bf8706fdac8d62f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6c3a expref: 10 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574390.031914:0:17067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c85c6b82a00) 00010000:00010000:2.0:1788574390.031916:0:17067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788574390.031920:0:17067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217fa00/0x5bf8706fdac8d62f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6c3a expref: 10 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574390.031929:0:17067:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c860217fa00, rc 0) 00000100:00100000:2.0:1788574390.031992:0:17067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f6671880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74bce780-6a9f-42e0-9637-fe6b1665ce5b+9:15578:x1875455669043072:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 505us (748us total) trans 0 rc 301/301 00000100:00100000:2.0:1788574390.032000:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 27 00000100:00100000:0.0:1788574390.039877:0:18898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f6671f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74bce780-6a9f-42e0-9637-fe6b1665ce5b+5:15572:x1875455669042944:12345-192.168.204.51@tcp:59:lhsmtool_posix.0 Request processed in 25109us (25492us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574390.039893:0:18898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 26 00000100:00100000:0.0:1788574390.045584:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574390.045896:0:17076:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669043200 00000100:00100000:2.0:1788574390.045909:0:17076:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669043200 00000100:00100000:2.0:1788574390.045965:0:17076:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 0 00000100:00100000:2.0:1788574390.045975:0:17076:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f6673100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:74bce780-6a9f-42e0-9637-fe6b1665ce5b+9:15578:x1875455669043200:12345-192.168.204.51@tcp:700:lfs.0 00000100:00100000:2.0:1788574390.046213:0:17076:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f6673100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:74bce780-6a9f-42e0-9637-fe6b1665ce5b+9:15578:x1875455669043200:12345-192.168.204.51@tcp:700:lfs.0 Request processed in 213us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574390.046222:0:17076:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 0 00000100:00100000:0.0:1788574390.050699:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574390.055128:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669043456 00000100:00100000:1.0:1788574390.055150:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669043456 00000100:00100000:0.0:1788574390.055789:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 28 00000100:00100000:0.0:1788574390.055808:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f6671500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74bce780-6a9f-42e0-9637-fe6b1665ce5b+9:15578:x1875455669043456:12345-192.168.204.51@tcp:36:lfs.0 00010000:00010000:0.0:1788574390.055885:0:17068:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574390.055916:0:17068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8d55d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ba7 expref: 9 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.055936:0:17068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c85c6b82a00) 00010000:00010000:0.0:1788574390.055942:0:17068:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788574390.056141:0:17068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152fc00/0x5bf8706fdac8d644 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.056157:0:17068:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f000/0x5bf8706fdac8d59c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6c17 expref: 5 pid: 18898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.056166:0:17068:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152fc00/0x5bf8706fdac8d644 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.056236:0:17068:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f000/0x5bf8706fdac8d59c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6c17 expref: 5 pid: 18898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.056251:0:17068:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f000/0x5bf8706fdac8d59c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6c17 expref: 5 pid: 18898 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574390.056266:0:17068:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6671180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17068:1875455681714688:192.168.204.51@tcp:104: 00000100:00100000:0.0:1788574390.056454:0:17068:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c357fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788574390.063090:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574390.063241:0:17054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669043584 00000100:00100000:3.0:1788574390.063252:0:17054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669043584 00010000:00010000:3.0:1788574390.063293:0:17054:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f000/0x5bf8706fdac8d59c lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6c17 expref: 6 pid: 18898 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574390.063333:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 15 00000100:00100000:3.0:1788574390.063343:0:17054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3da6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:408a814b-bde8-48f8-9467-4baee1a765d4+6:2394:x1875455669043584:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788574390.063368:0:17054:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574390.063376:0:17054:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f000/0x5bf8706fdac8d59c lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6c17 expref: 6 pid: 18898 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574390.063390:0:17054:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f000/0x5bf8706fdac8d59c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6c17 expref: 6 pid: 18898 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574390.063426:0:17054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c85c6b82a00) 00010000:00010000:3.0:1788574390.063432:0:17054:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152fc00/0x5bf8706fdac8d644 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574390.063442:0:17054:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152fc00/0x5bf8706fdac8d644 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574390.063464:0:17054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152fc00/0x5bf8706fdac8d644 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574390.063497:0:17054:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788574390.063554:0:17054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3da6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:408a814b-bde8-48f8-9467-4baee1a765d4+6:2394:x1875455669043584:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 212us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574390.063562:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 15 00010000:00010000:0.0:1788574390.064017:0:17068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f000/0x5bf8706fdac8d59c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6c17 expref: 5 pid: 18898 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574390.064037:0:17068:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6671180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17068:1875455681714688:192.168.204.51@tcp:104: 00010000:00010000:0.0:1788574390.064059:0:17068:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152fc00/0x5bf8706fdac8d644 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.064079:0:17068:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152fc00/0x5bf8706fdac8d644 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.064085:0:17068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152fc00/0x5bf8706fdac8d644 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.064526:0:17068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152fe00/0x5bf8706fdac8d64b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.064539:0:17068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152fe00/0x5bf8706fdac8d64b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.064548:0:17068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152fe00/0x5bf8706fdac8d64b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574390.070924:0:17068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217fa00/0x5bf8706fdac8d652 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574390.070952:0:17068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217fa00/0x5bf8706fdac8d652 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574390.070964:0:17068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217fa00/0x5bf8706fdac8d652 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788574390.070984:0:17068:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dda274d1 reply state 000000002460a400 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217fa00/0x5bf8706fdac8d652 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574390.071009:0:17068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217fa00/0x5bf8706fdac8d652 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574390.071018:0:17068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c85c4fa6200) 00010000:00010000:2.0:1788574390.071021:0:17068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788574390.071037:0:17068:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788574390.071044:0:17068:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788574390.071055:0:17068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152fc00/0x5bf8706fdac8d644 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574390.071063:0:17068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152fc00/0x5bf8706fdac8d644 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574390.071070:0:17068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152fc00/0x5bf8706fdac8d644 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574390.071076:0:17068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85c152fc00 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:2.0:1788574390.071081:0:17068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152fc00/0x5bf8706fdac8d644 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574390.071089:0:17068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152fc00/0x5bf8706fdac8d644 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574390.071100:0:17068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c85c6b82a00) 00010000:00010000:2.0:1788574390.071103:0:17068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788574390.071107:0:17068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152fc00/0x5bf8706fdac8d644 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574390.071114:0:17068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152fc00/0x5bf8706fdac8d644 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788574390.071146:0:17068:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dda274d1 reply state 000000002460a400 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152fe00/0x5bf8706fdac8d64b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574390.071156:0:17068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152fe00/0x5bf8706fdac8d64b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574390.071163:0:17068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9c85d10a6800) 00010000:00010000:2.0:1788574390.071165:0:17068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788574390.071167:0:17068:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1788574390.071317:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f6671500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74bce780-6a9f-42e0-9637-fe6b1665ce5b+10:15578:x1875455669043456:12345-192.168.204.51@tcp:36:lfs.0 Request processed in 15512us (20627us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788574390.071329:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 28 00000040:00080000:2.0:1788574390.165792:0:17104:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788574390.238735:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574390.238830:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669043712 00000100:00100000:3.0:1788574390.238849:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669043712 00000100:00100000:3.0:1788574390.238913:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 29 00000100:00100000:3.0:1788574390.238924:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3da4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74bce780-6a9f-42e0-9637-fe6b1665ce5b+10:15586:x1875455669043712:12345-192.168.204.51@tcp:101:lctl.0 00010000:00010000:3.0:1788574390.238950:0:17069:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574390.238976:0:17069:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8d659 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6c41 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574390.239265:0:17069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8d660 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574390.239280:0:17069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8d660 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574390.239293:0:17069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8d660 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788574390.239473:0:17069:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788574390.239477:0:17069:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788574390.239515:0:17069:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8d660 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574390.239562:0:17069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8d659 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6c41 expref: 12 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574390.239581:0:17069:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2e00/0x5bf8706fdac8d660 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6c41 expref: 11 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574390.239590:0:17069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c85cbaaf300) 00010000:00010000:3.0:1788574390.239594:0:17069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788574390.239599:0:17069:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85faea2e00, rc 0) 00000100:00100000:3.0:1788574390.239714:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3da4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74bce780-6a9f-42e0-9637-fe6b1665ce5b+11:15586:x1875455669043712:12345-192.168.204.51@tcp:101:lctl.0 Request processed in 791us (989us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574390.239723:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 29 00000100:00100000:3.0:1788574390.292754:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574390.292869:0:17067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669043840 00000100:00100000:1.0:1788574390.292879:0:17067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669043840 00000100:00100000:1.0:1788574390.292965:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 30 00000100:00100000:1.0:1788574390.292979:0:17067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:408a814b-bde8-48f8-9467-4baee1a765d4+5:15587:x1875455669043840:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:1.0:1788574390.293000:0:17067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574390.293032:0:17067:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2200/0x5bf8706fdac8d667 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6c48 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574390.293111:0:17067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2e00/0x5bf8706fdac8d66e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574390.293128:0:17067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2e00/0x5bf8706fdac8d66e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574390.293141:0:17067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2e00/0x5bf8706fdac8d66e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788574390.293243:0:17067:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788574390.293247:0:17067:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788574390.293272:0:17067:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2e00/0x5bf8706fdac8d66e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574390.293300:0:17067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2200/0x5bf8706fdac8d667 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6c48 expref: 7 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574390.293318:0:17067:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2e00/0x5bf8706fdac8d66e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6c48 expref: 6 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574390.293328:0:17067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c85cbaaf300) 00010000:00010000:1.0:1788574390.293331:0:17067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788574390.293334:0:17067:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d08a2e00, rc 0) 00000100:00100000:1.0:1788574390.293394:0:17067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:408a814b-bde8-48f8-9467-4baee1a765d4+6:15587:x1875455669043840:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 420us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574390.293412:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 30 00000040:00080000:2.0:1788574390.295907:0:17820:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788574390.301453:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574390.301925:0:18898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669043968 00000100:00100000:0.0:1788574390.301936:0:18898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669043968 00000100:00100000:0.0:1788574390.302008:0:18898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 31 00000100:00100000:0.0:1788574390.302289:0:18898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3da5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:408a814b-bde8-48f8-9467-4baee1a765d4+6:15587:x1875455669043968:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:0.0:1788574390.302310:0:18898:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574390.302332:0:18898:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f000/0x5bf8706fdac8d675 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6c4f expref: -99 pid: 18898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.302395:0:18898:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8d67c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.302422:0:18898:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8d67c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.302434:0:18898:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8d67c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.302446:0:18898:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f200/0x5bf8706fdac8d683 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.302454:0:18898:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f200/0x5bf8706fdac8d683 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.302475:0:18898:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f200/0x5bf8706fdac8d683 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.302550:0:18898:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152fc00/0x5bf8706fdac8d68a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.302559:0:18898:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152fc00/0x5bf8706fdac8d68a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.302566:0:18898:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152fc00/0x5bf8706fdac8d68a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788574390.302602:0:18898:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788574390.302605:0:18898:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788574390.302627:0:18898:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152fc00/0x5bf8706fdac8d68a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.302639:0:18898:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8d67c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.302653:0:18898:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8d67c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.302659:0:18898:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8d67c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.302663:0:18898:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85c152f400 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:0.0:1788574390.302668:0:18898:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8d67c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.302676:0:18898:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8d67c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.302694:0:18898:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c85cbaaf300) 00010000:00010000:0.0:1788574390.302696:0:18898:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574390.302701:0:18898:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8d67c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.302707:0:18898:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8d67c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.302720:0:18898:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f200/0x5bf8706fdac8d683 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.302725:0:18898:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f200/0x5bf8706fdac8d683 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.302729:0:18898:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f200/0x5bf8706fdac8d683 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.302734:0:18898:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85c152f200 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:0.0:1788574390.302736:0:18898:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f200/0x5bf8706fdac8d683 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.302742:0:18898:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f200/0x5bf8706fdac8d683 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.302748:0:18898:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9c85d10a6800) 00010000:00010000:0.0:1788574390.302750:0:18898:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574390.302753:0:18898:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f200/0x5bf8706fdac8d683 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.302757:0:18898:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f200/0x5bf8706fdac8d683 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.302793:0:18898:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f000/0x5bf8706fdac8d675 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6c4f expref: 8 pid: 18898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.302806:0:18898:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152fc00/0x5bf8706fdac8d68a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6c4f expref: 7 pid: 18898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.302812:0:18898:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c85c4fa6200) 00010000:00010000:0.0:1788574390.302815:0:18898:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788574390.302817:0:18898:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85c152fc00, rc 0) 00000100:00100000:0.0:1788574390.302931:0:18898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3da5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:408a814b-bde8-48f8-9467-4baee1a765d4+7:15587:x1875455669043968:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 914us (1488us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574390.302939:0:18898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 31 00000100:00100000:3.0:1788574390.310552:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574390.310651:0:17078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669044096 00000100:00100000:1.0:1788574390.310660:0:17078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669044096 00000100:00100000:1.0:1788574390.310717:0:17078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 6 00000100:00100000:1.0:1788574390.310726:0:17078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:408a814b-bde8-48f8-9467-4baee1a765d4+5:15587:x1875455669044096:12345-192.168.204.51@tcp:900:lfs.0 00000100:00100000:1.0:1788574390.310810:0:17078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:408a814b-bde8-48f8-9467-4baee1a765d4+5:15587:x1875455669044096:12345-192.168.204.51@tcp:900:lfs.0 Request processed in 86us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574390.310817:0:17078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 6 00000100:00100000:3.0:1788574390.314157:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574390.314367:0:17067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669044352 00000100:00100000:1.0:1788574390.314391:0:17067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669044352 00000100:00100000:1.0:1788574390.314467:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 32 00000100:00100000:1.0:1788574390.314479:0:17067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:408a814b-bde8-48f8-9467-4baee1a765d4+7:15587:x1875455669044352:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:1.0:1788574390.314498:0:17067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574390.314519:0:17067:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2200/0x5bf8706fdac8d691 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6c56 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788574390.314625:0:17067:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788574390.314727:0:17067:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2200/0x5bf8706fdac8d691 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6c56 expref: 9 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574390.314741:0:17067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c85cbaaf300) 00010000:00010000:1.0:1788574390.314744:0:17067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788574390.314749:0:17067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2200/0x5bf8706fdac8d691 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6c56 expref: 9 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574390.314763:0:17067:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d08a2200, rc 0) 00000100:00100000:1.0:1788574390.314824:0:17067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:408a814b-bde8-48f8-9467-4baee1a765d4+8:15587:x1875455669044352:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 349us (678us total) trans 8589934595 rc 301/301 00000100:00100000:1.0:1788574390.314830:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 32 00000100:00100000:2.0:1788574390.318856:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574390.318994:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669044608 00000100:00100000:3.0:1788574390.319004:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669044608 00000100:00100000:3.0:1788574390.319081:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 33 00000100:00100000:3.0:1788574390.319091:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601837480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:408a814b-bde8-48f8-9467-4baee1a765d4+8:15587:x1875455669044608:12345-192.168.204.51@tcp:36:lfs.0 00010000:00010000:3.0:1788574390.319144:0:17069:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574390.319171:0:17069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152fc00/0x5bf8706fdac8d68a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6c4f expref: 8 pid: 18898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574390.319230:0:17069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c85c4fa6200) 00010000:00010000:3.0:1788574390.319235:0:17069:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788574390.319257:0:17069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8d69f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574390.319282:0:17069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8d69f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574390.319291:0:17069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8d69f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788574390.319517:0:17069:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000094e36533 reply state 00000000db5520fe transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8d69f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574390.319531:0:17069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8d69f lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574390.319537:0:17069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c85c4fa6200) 00010000:00010000:3.0:1788574390.319539:0:17069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:3.0:1788574390.319542:0:17069:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788574390.319550:0:17069:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788574390.319622:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601837480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:408a814b-bde8-48f8-9467-4baee1a765d4+9:15587:x1875455669044608:12345-192.168.204.51@tcp:36:lfs.0 Request processed in 533us (786us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1788574390.319629:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 33 00000100:00100000:3.0:1788574390.324996:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574390.326255:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669044864 00000100:00100000:0.0:1788574390.326269:0:17070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669044864 00000100:00100000:0.0:1788574390.326349:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 2 00000100:00100000:0.0:1788574390.326360:0:17070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:408a814b-bde8-48f8-9467-4baee1a765d4+9:15587:x1875455669044864:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:0.0:1788574390.326618:0:17070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:408a814b-bde8-48f8-9467-4baee1a765d4+10:15587:x1875455669044864:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 258us (1632us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1788574390.326628:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 2 00000100:00100000:1.0:1788574390.332257:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574390.334913:0:17067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669045120 00000100:00100000:2.0:1788574390.334931:0:17067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669045120 00000100:00100000:2.0:1788574390.335160:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 34 00000100:00100000:2.0:1788574390.335173:0:17067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3da5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:408a814b-bde8-48f8-9467-4baee1a765d4+10:15587:x1875455669045120:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:2.0:1788574390.335243:0:17067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574390.335266:0:17067:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e800/0x5bf8706fdac8d6a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6c5d expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574390.335348:0:17067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217f200/0x5bf8706fdac8d6ad lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574390.335365:0:17067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217f200/0x5bf8706fdac8d6ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574390.335418:0:17067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217f200/0x5bf8706fdac8d6ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574390.335432:0:17067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e200/0x5bf8706fdac8d6b4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574390.335440:0:17067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e200/0x5bf8706fdac8d6b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574390.335446:0:17067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e200/0x5bf8706fdac8d6b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788574390.335558:0:17067:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788574390.335639:0:17067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217f200/0x5bf8706fdac8d6ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574390.335647:0:17067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217f200/0x5bf8706fdac8d6ad lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574390.335653:0:17067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217f200/0x5bf8706fdac8d6ad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574390.335660:0:17067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c860217f200 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:2.0:1788574390.335664:0:17067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217f200/0x5bf8706fdac8d6ad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574390.335671:0:17067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217f200/0x5bf8706fdac8d6ad lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574390.335685:0:17067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c85cbaaf300) 00010000:00010000:2.0:1788574390.335689:0:17067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788574390.335700:0:17067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217f200/0x5bf8706fdac8d6ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574390.335707:0:17067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217f200/0x5bf8706fdac8d6ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574390.335721:0:17067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e200/0x5bf8706fdac8d6b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574390.335727:0:17067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e200/0x5bf8706fdac8d6b4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574390.335733:0:17067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e200/0x5bf8706fdac8d6b4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574390.335738:0:17067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c860217e200 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:2.0:1788574390.335741:0:17067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e200/0x5bf8706fdac8d6b4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574390.335746:0:17067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e200/0x5bf8706fdac8d6b4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574390.335754:0:17067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9c85d10a6800) 00010000:00010000:2.0:1788574390.335757:0:17067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788574390.335760:0:17067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e200/0x5bf8706fdac8d6b4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574390.335765:0:17067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e200/0x5bf8706fdac8d6b4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574390.335799:0:17067:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e800/0x5bf8706fdac8d6a6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6c5d expref: 12 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574390.335822:0:17067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c85cbaaf300) 00010000:00010000:2.0:1788574390.335825:0:17067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788574390.335828:0:17067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e800/0x5bf8706fdac8d6a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6c5d expref: 12 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574390.335839:0:17067:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c860217e800, rc 0) 00000100:00100000:2.0:1788574390.336034:0:17067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3da5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:408a814b-bde8-48f8-9467-4baee1a765d4+11:15587:x1875455669045120:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 861us (3785us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1788574390.336043:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 34 00000100:00100000:2.0:1788574390.344844:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574390.348921:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669045248 00000100:00100000:3.0:1788574390.348940:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669045248 00000100:00100000:3.0:1788574390.349029:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 35 00000100:00100000:3.0:1788574390.349042:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601835c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:408a814b-bde8-48f8-9467-4baee1a765d4+11:15587:x1875455669045248:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:3.0:1788574390.349073:0:17069:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574390.349097:0:17069:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8d6c2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6c64 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574390.349242:0:17069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3200/0x5bf8706fdac8d6c9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574390.349270:0:17069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3200/0x5bf8706fdac8d6c9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574390.349283:0:17069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3200/0x5bf8706fdac8d6c9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788574390.349312:0:17069:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788574390.349316:0:17069:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788574390.350155:0:17069:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3200/0x5bf8706fdac8d6c9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574390.350209:0:17069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8d6c2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6c64 expref: 13 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574390.350228:0:17069:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3200/0x5bf8706fdac8d6c9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6c64 expref: 12 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574390.350236:0:17069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c85c4fa6200) 00010000:00010000:3.0:1788574390.350239:0:17069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788574390.350242:0:17069:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85faea3200, rc 0) 00000100:00100000:3.0:1788574390.350320:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601835c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:408a814b-bde8-48f8-9467-4baee1a765d4+12:15587:x1875455669045248:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 1280us (5484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574390.350340:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 35 00000100:00100000:3.0:1788574390.364380:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574390.364917:0:17071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669045376 00000100:00100000:2.0:1788574390.364929:0:17071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669045376 00000100:00100000:2.0:1788574390.365050:0:17071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 3 00000100:00100000:2.0:1788574390.365062:0:17071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:408a814b-bde8-48f8-9467-4baee1a765d4+12:15587:x1875455669045376:12345-192.168.204.51@tcp:37:lfs.0 00000100:00100000:0.0:1788574390.376294:0:17071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:408a814b-bde8-48f8-9467-4baee1a765d4+12:15587:x1875455669045376:12345-192.168.204.51@tcp:37:lfs.0 Request processed in 11223us (11912us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574390.376310:0:17071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 3 00000100:00100000:2.0:1788574390.388366:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574390.388488:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669045632 00000100:00100000:0.0:1788574390.388499:0:17070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669045632 00000100:00100000:0.0:1788574390.388563:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 4 00000100:00100000:0.0:1788574390.388575:0:17070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fafe7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:408a814b-bde8-48f8-9467-4baee1a765d4+12:15587:x1875455669045632:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:0.0:1788574390.388853:0:17070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fafe7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:408a814b-bde8-48f8-9467-4baee1a765d4+13:15587:x1875455669045632:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 280us (496us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1788574390.388871:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 4 00000100:00100000:1.0:1788574390.420149:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788574390.420177:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c8601834380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681714816:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788574390.420273:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574390.420523:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681714816 00000100:00100000:0.0:1788574390.420532:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681714816 00000100:00100000:0.0:1788574390.420586:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788574390.420595:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c335df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681714816:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788574390.420635:0:17073:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788574390.420824:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c335df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681714816:12345-0@lo:41:osp-pre-1-0.0 Request processed in 228us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574390.420833:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788574390.420934:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c8601834380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681714816:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788574390.421262:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788574390.421274:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c8601837100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681714944:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788574390.421309:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574390.421388:0:17807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681714944 00000100:00100000:2.0:1788574390.421394:0:17807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681714944 00000100:00100000:2.0:1788574390.421429:0:17807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788574390.421436:0:17807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681714944:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788574390.421455:0:17807:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788574390.423634:0:17807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681714944:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2187us (2312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574390.423648:0:17807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788574390.430370:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c8601837100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681714944:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788574390.464263:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574390.464410:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669045760 00000100:00100000:0.0:1788574390.464420:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669045760 00000100:00100000:0.0:1788574390.464486:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 36 00000100:00100000:0.0:1788574390.464503:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74bce780-6a9f-42e0-9637-fe6b1665ce5b+11:15593:x1875455669045760:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:0.0:1788574390.464526:0:17068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574390.464548:0:17068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f000/0x5bf8706fdac8d6d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6c6b expref: -99 pid: 17068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.464616:0:17068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f200/0x5bf8706fdac8d6d7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.464632:0:17068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f200/0x5bf8706fdac8d6d7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.464647:0:17068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f200/0x5bf8706fdac8d6d7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.464685:0:17068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8d6de lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.464693:0:17068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8d6de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.464700:0:17068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8d6de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.464771:0:17068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152fc00/0x5bf8706fdac8d6e5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.464780:0:17068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152fc00/0x5bf8706fdac8d6e5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.464787:0:17068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152fc00/0x5bf8706fdac8d6e5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788574390.464820:0:17068:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788574390.464824:0:17068:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788574390.464860:0:17068:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152fc00/0x5bf8706fdac8d6e5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.464871:0:17068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f200/0x5bf8706fdac8d6d7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.464877:0:17068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f200/0x5bf8706fdac8d6d7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.464895:0:17068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f200/0x5bf8706fdac8d6d7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.464909:0:17068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85c152f200 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:0.0:1788574390.464914:0:17068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f200/0x5bf8706fdac8d6d7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.464922:0:17068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f200/0x5bf8706fdac8d6d7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.464935:0:17068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c85cbaaf300) 00010000:00010000:0.0:1788574390.464938:0:17068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574390.464943:0:17068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f200/0x5bf8706fdac8d6d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.465050:0:17068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f200/0x5bf8706fdac8d6d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.465075:0:17068:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8d6de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.465081:0:17068:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8d6de lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.465087:0:17068:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8d6de lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.465092:0:17068:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85c152f400 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:0.0:1788574390.465095:0:17068:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8d6de lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.465101:0:17068:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8d6de lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.465118:0:17068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9c85d10a6800) 00010000:00010000:0.0:1788574390.465120:0:17068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574390.465124:0:17068:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8d6de lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.465130:0:17068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8d6de lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.465158:0:17068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f000/0x5bf8706fdac8d6d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6c6b expref: 13 pid: 17068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.465172:0:17068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152fc00/0x5bf8706fdac8d6e5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6c6b expref: 12 pid: 17068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.465180:0:17068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c85c4fa6200) 00010000:00010000:0.0:1788574390.465182:0:17068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788574390.465185:0:17068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85c152fc00, rc 0) 00000100:00100000:0.0:1788574390.465316:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74bce780-6a9f-42e0-9637-fe6b1665ce5b+12:15593:x1875455669045760:12345-192.168.204.51@tcp:101:bash.0 Request processed in 821us (1065us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574390.465324:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 36 00000100:00100000:3.0:1788574390.468977:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574390.469938:0:17078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669045888 00000100:00100000:1.0:1788574390.469951:0:17078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669045888 00000100:00100000:1.0:1788574390.470030:0:17078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 7 00000100:00100000:1.0:1788574390.470041:0:17078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:74bce780-6a9f-42e0-9637-fe6b1665ce5b+5:15593:x1875455669045888:12345-192.168.204.51@tcp:900:bash.0 00000100:00100000:1.0:1788574390.470133:0:17078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:74bce780-6a9f-42e0-9637-fe6b1665ce5b+5:15593:x1875455669045888:12345-192.168.204.51@tcp:900:bash.0 Request processed in 93us (1179us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574390.470142:0:17078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 7 00000100:00100000:3.0:1788574390.476348:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574390.476454:0:18898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669046144 00000100:00100000:0.0:1788574390.476465:0:18898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669046144 00000100:00100000:0.0:1788574390.476544:0:18898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 37 00000100:00100000:0.0:1788574390.476554:0:18898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74bce780-6a9f-42e0-9637-fe6b1665ce5b+12:15593:x1875455669046144:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:0.0:1788574390.476574:0:18898:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574390.476594:0:18898:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f000/0x5bf8706fdac8d6ec lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6c72 expref: -99 pid: 18898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.476724:0:18898:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8d6f3 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.476739:0:18898:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3200/0x5bf8706fdac8d6c9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6c64 expref: 12 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.476749:0:18898:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8d6f3 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.476781:0:18898:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3200/0x5bf8706fdac8d6c9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6c64 expref: 12 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.476795:0:18898:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3200/0x5bf8706fdac8d6c9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6c64 expref: 12 pid: 17069 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574390.476809:0:18898:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6671180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18898:1875455681715072:192.168.204.51@tcp:104: 00000100:00100000:0.0:1788574390.476913:0:18898:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c84c357f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788574390.485077:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574390.486232:0:17052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669046272 00000100:00100000:1.0:1788574390.486247:0:17052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669046272 00010000:00010000:1.0:1788574390.486294:0:17052:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3200/0x5bf8706fdac8d6c9 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6c64 expref: 13 pid: 17069 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574390.486339:0:17052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 16 00000100:00100000:1.0:1788574390.486349:0:17052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601834000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:408a814b-bde8-48f8-9467-4baee1a765d4+13:2394:x1875455669046272:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788574390.486364:0:17052:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574390.486371:0:17052:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3200/0x5bf8706fdac8d6c9 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6c64 expref: 13 pid: 17069 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574390.486385:0:17052:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3200/0x5bf8706fdac8d6c9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6c64 expref: 13 pid: 17069 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574390.486418:0:17052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c85c4fa6200) 00010000:00010000:1.0:1788574390.486424:0:17052:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8d6f3 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574390.486433:0:17052:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8d6f3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574390.486440:0:17052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8d6f3 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574390.486477:0:17052:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788574390.486542:0:17052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601834000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:408a814b-bde8-48f8-9467-4baee1a765d4+13:2394:x1875455669046272:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 194us (1474us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574390.486549:0:17052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 16 00010000:00010000:0.0:1788574390.486808:0:18898:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3200/0x5bf8706fdac8d6c9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6c64 expref: 12 pid: 17069 timeout: 630 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574390.486831:0:18898:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6671180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18898:1875455681715072:192.168.204.51@tcp:104: 00010000:00010000:0.0:1788574390.486852:0:18898:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8d6f3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.486861:0:18898:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8d6f3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.486877:0:18898:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8d6f3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.486900:0:18898:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f200/0x5bf8706fdac8d6fa lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.486911:0:18898:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f200/0x5bf8706fdac8d6fa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.486921:0:18898:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f200/0x5bf8706fdac8d6fa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.488009:0:18898:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8d701 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.488028:0:18898:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8d701 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.488036:0:18898:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8d701 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788574390.488048:0:18898:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788574390.488095:0:18898:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8d6f3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.488103:0:18898:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8d6f3 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.488110:0:18898:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8d6f3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.488116:0:18898:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85c152f400 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:0.0:1788574390.488130:0:18898:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8d6f3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.488139:0:18898:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8d6f3 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.488152:0:18898:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c85c4fa6200) 00010000:00010000:0.0:1788574390.488155:0:18898:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574390.488160:0:18898:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8d6f3 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.488166:0:18898:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f400/0x5bf8706fdac8d6f3 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788574390.488179:0:18898:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001956565b reply state 00000000a7f96b56 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f200/0x5bf8706fdac8d6fa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.488214:0:18898:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f200/0x5bf8706fdac8d6fa lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.488222:0:18898:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9c85d10a6200) 00010000:00010000:0.0:1788574390.488224:0:18898:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788574390.488228:0:18898:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788574390.488265:0:18898:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f000/0x5bf8706fdac8d6ec lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6c72 expref: 15 pid: 18898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.488279:0:18898:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8d701 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6c72 expref: 14 pid: 18898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.488287:0:18898:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c85d10a6300) 00010000:00010000:0.0:1788574390.488290:0:18898:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1788574390.488298:0:18898:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d20d7200, rc 0) 00000100:00100000:0.0:1788574390.488366:0:18898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74bce780-6a9f-42e0-9637-fe6b1665ce5b+15:15593:x1875455669046144:12345-192.168.204.51@tcp:101:bash.0 Request processed in 11813us (12027us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1788574390.488374:0:18898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 37 00000100:00100000:2.0:1788574390.520645:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574390.520999:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669046400 00000100:00100000:0.0:1788574390.521011:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669046400 00000100:00100000:0.0:1788574390.521085:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 38 00000100:00100000:0.0:1788574390.521097:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601837100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74bce780-6a9f-42e0-9637-fe6b1665ce5b+15:15593:x1875455669046400:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:0.0:1788574390.521123:0:17068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574390.521157:0:17068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6000/0x5bf8706fdac8d70f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6c79 expref: -99 pid: 17068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.521254:0:17068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8d716 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.521271:0:17068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8d716 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.521283:0:17068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8d716 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788574390.521623:0:17068:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788574390.521628:0:17068:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788574390.521650:0:17068:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8d716 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.521662:0:17068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8d716 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.521690:0:17068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6000/0x5bf8706fdac8d70f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6c79 expref: 17 pid: 17068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.521726:0:17068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8d716 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6c79 expref: 16 pid: 17068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.521734:0:17068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c85d10a6300) 00010000:00010000:0.0:1788574390.521737:0:17068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788574390.521741:0:17068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d20d6400, rc 0) 00000100:00100000:0.0:1788574390.521824:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601837100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74bce780-6a9f-42e0-9637-fe6b1665ce5b+16:15593:x1875455669046400:12345-192.168.204.51@tcp:101:bash.0 Request processed in 730us (1189us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574390.521832:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 38 00000100:00100000:2.0:1788574390.525709:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574390.525919:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669046656 00000100:00100000:0.0:1788574390.525929:0:17070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669046656 00000100:00100000:0.0:1788574390.526049:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 5 00000100:00100000:0.0:1788574390.526071:0:17070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601834380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:74bce780-6a9f-42e0-9637-fe6b1665ce5b+16:15593:x1875455669046656:12345-192.168.204.51@tcp:35:bash.0 00000100:00100000:0.0:1788574390.528923:0:17070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601834380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:74bce780-6a9f-42e0-9637-fe6b1665ce5b+17:15593:x1875455669046656:12345-192.168.204.51@tcp:35:bash.0 Request processed in 2843us (3213us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1788574390.528938:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 5 00000100:00100000:2.0:1788574390.664473:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574390.664622:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669046912 00000100:00100000:3.0:1788574390.664633:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669046912 00000100:00100000:3.0:1788574390.664703:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 39 00000100:00100000:3.0:1788574390.664714:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2f45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74bce780-6a9f-42e0-9637-fe6b1665ce5b+17:15603:x1875455669046912:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:3.0:1788574390.664739:0:17069:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574390.664762:0:17069:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8d71d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6c80 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788574390.664899:0:17069:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788574390.665004:0:17069:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8d71d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6c80 expref: 19 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574390.665161:0:17069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c85cbaaf300) 00010000:00010000:3.0:1788574390.665165:0:17069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788574390.665171:0:17069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8d71d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6c80 expref: 19 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574390.665187:0:17069:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85faea2200, rc 0) 00000100:00100000:3.0:1788574390.665347:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2f45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74bce780-6a9f-42e0-9637-fe6b1665ce5b+18:15603:x1875455669046912:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 635us (883us total) trans 8589934602 rc 301/301 00000100:00100000:3.0:1788574390.665355:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 39 00000100:00100000:3.0:1788574390.674474:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574390.674637:0:17071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669047168 00000100:00100000:1.0:1788574390.674654:0:17071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669047168 00000100:00100000:1.0:1788574390.674726:0:17071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 6 00000100:00100000:1.0:1788574390.674738:0:17071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85faf5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74bce780-6a9f-42e0-9637-fe6b1665ce5b+18:15603:x1875455669047168:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:1.0:1788574390.675026:0:17071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85faf5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74bce780-6a9f-42e0-9637-fe6b1665ce5b+19:15603:x1875455669047168:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 290us (570us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1788574390.675035:0:17071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 6 00010000:00010000:2.0:1788574390.739791:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574390.775500:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574390.778467:0:17067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669047424 00000100:00100000:1.0:1788574390.778484:0:17067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669047424 00000100:00100000:1.0:1788574390.778569:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 40 00000100:00100000:1.0:1788574390.778581:0:17067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74bce780-6a9f-42e0-9637-fe6b1665ce5b+19:15606:x1875455669047424:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:1.0:1788574390.778609:0:17067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574390.778633:0:17067:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2400/0x5bf8706fdac8d72b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6c87 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574390.778756:0:17067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a3000/0x5bf8706fdac8d732 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574390.778772:0:17067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a3000/0x5bf8706fdac8d732 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574390.778786:0:17067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a3000/0x5bf8706fdac8d732 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788574390.778818:0:17067:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788574390.778933:0:17067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2400/0x5bf8706fdac8d72b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6c87 expref: 22 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574390.778952:0:17067:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a3000/0x5bf8706fdac8d732 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6c87 expref: 21 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574390.778960:0:17067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c85d10a6300) 00010000:00010000:1.0:1788574390.778963:0:17067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788574390.778967:0:17067:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d08a3000, rc 0) 00000100:00100000:1.0:1788574390.779043:0:17067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74bce780-6a9f-42e0-9637-fe6b1665ce5b+21:15606:x1875455669047424:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 464us (3558us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1788574390.779050:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 40 00000100:00100000:2.0:1788574390.789918:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574390.790036:0:18898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669047552 00000100:00100000:0.0:1788574390.790048:0:18898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669047552 00000100:00100000:0.0:1788574390.790117:0:18898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 41 00000100:00100000:0.0:1788574390.790128:0:18898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74bce780-6a9f-42e0-9637-fe6b1665ce5b+21:15606:x1875455669047552:12345-192.168.204.51@tcp:54:lfs.0 00010000:00010000:0.0:1788574390.790242:0:18898:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6000/0x5bf8706fdac8d740 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.790261:0:18898:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6000/0x5bf8706fdac8d740 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.790303:0:18898:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6000/0x5bf8706fdac8d740 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.790341:0:18898:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6000/0x5bf8706fdac8d740 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.790348:0:18898:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6000/0x5bf8706fdac8d740 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.790355:0:18898:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6000/0x5bf8706fdac8d740 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.790361:0:18898:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d6000 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:0.0:1788574390.790366:0:18898:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6000/0x5bf8706fdac8d740 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.790373:0:18898:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6000/0x5bf8706fdac8d740 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.790386:0:18898:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c85d10a6300) 00010000:00010000:0.0:1788574390.790390:0:18898:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788574390.790407:0:18898:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6000/0x5bf8706fdac8d740 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574390.790414:0:18898:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6000/0x5bf8706fdac8d740 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574390.790495:0:18898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74bce780-6a9f-42e0-9637-fe6b1665ce5b+21:15606:x1875455669047552:12345-192.168.204.51@tcp:54:lfs.0 Request processed in 368us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574390.790503:0:18898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 41 00000100:00100000:0.0:1788574390.793498:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574390.793585:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669047680 00000100:00100000:1.0:1788574390.793594:0:17053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669047680 00000100:00100000:1.0:1788574390.793662:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 0 00000100:00100000:1.0:1788574390.793673:0:17053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f6671180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:74bce780-6a9f-42e0-9637-fe6b1665ce5b+21:2394:x1875455669047680:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788574390.793689:0:17053:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574390.793715:0:17053:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a3000/0x5bf8706fdac8d732 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6c87 expref: 21 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574390.793736:0:17053:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c85d10a6300) 00010000:00010000:1.0:1788574390.793741:0:17053:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788574390.793804:0:17053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f6671180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:74bce780-6a9f-42e0-9637-fe6b1665ce5b+20:2394:x1875455669047680:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 133us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574390.793811:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 0 00000100:00100000:2.0:1788574390.794652:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574390.794782:0:17071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669047936 00000100:00100000:1.0:1788574390.794789:0:17071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669047936 00000100:00100000:1.0:1788574390.794828:0:17071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 7 00000100:00100000:1.0:1788574390.794836:0:17071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74bce780-6a9f-42e0-9637-fe6b1665ce5b+20:15606:x1875455669047936:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:1.0:1788574390.795067:0:17071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74bce780-6a9f-42e0-9637-fe6b1665ce5b+21:15606:x1875455669047936:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 231us (416us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1788574390.795075:0:17071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 7 00000100:00100000:0.0:1788574390.931504:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681715200:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788574390.931783:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574390.934169:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681715200 00000100:00100000:1.0:1788574390.934185:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681715200 00000100:00100000:1.0:1788574390.934281:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788574390.934293:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f6673b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681715200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788574390.934329:0:18576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00080000:2.0:1788574390.934450:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788574390.938692:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f6673b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681715200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4392us (6898us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574390.938708:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788574390.938777:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681715200:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788574391.443467:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681715584:0@lo:400:kworker.0 00000100:00100000:2.0:1788574391.443487:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f73678fb-d8c0-450f-a73b-e6565942045e:3617:1875455681715456:0@lo:400:kworker.0 00000100:00100000:0.0:1788574391.443488:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681715712:0@lo:400:kworker.0 00000100:00100000:0.0:1788574391.443555:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574391.443556:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574391.443558:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574391.443619:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c36dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681715328:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788574391.443632:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681716224:0@lo:400:kworker.0 00000100:00100000:1.0:1788574391.443634:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875455681716096:0@lo:400:kworker.0 00000100:00100000:2.0:1788574391.443635:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681715968:0@lo:400:kworker.0 00000100:00100000:3.0:1788574391.443655:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574391.443678:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574391.443685:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574391.443693:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574391.443697:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6672a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681715840:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788574391.443707:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85ffafdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3619:1875455681716736:0@lo:400:kworker.0 00000100:00100000:2.0:1788574391.443715:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681716480:0@lo:400:kworker.0 00000100:00100000:1.0:1788574391.443722:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85ffafe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875455681716608:0@lo:400:kworker.0 00000100:00100000:3.0:1788574391.443735:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574391.443742:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574391.443758:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574391.443759:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85faf5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681716352:0@lo:400:kworker.0 00000100:00100000:1.0:1788574391.443763:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574391.443791:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85ffafd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3617:1875455681716992:0@lo:400:kworker.0 00000100:00100000:0.0:1788574391.443791:0:17072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681715584 00000100:00100000:3.0:1788574391.443792:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574391.443792:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85ffafca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3618:1875455681717120:0@lo:400:kworker.0 00000100:00100000:0.0:1788574391.443801:0:17072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681715584 00000100:00100000:3.0:1788574391.443813:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85ffaffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3620:1875455681716864:0@lo:400:kworker.0 00000100:00100000:1.0:1788574391.443821:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574391.443837:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574391.443851:0:17072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681716224 00000100:00100000:1.0:1788574391.443855:0:18573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681715712 00000100:00100000:0.0:1788574391.443855:0:17072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681716224 00000100:00100000:3.0:1788574391.443861:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681715968 00000100:00100000:1.0:1788574391.443861:0:18573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681715712 00000100:00100000:3.0:1788574391.443865:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681715968 00000100:00100000:0.0:1788574391.443880:0:17072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788574391.443889:0:18573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681716480 00000100:00100000:3.0:1788574391.443891:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681716352 00000100:00100000:0.0:1788574391.443893:0:17072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c335ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681715584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574391.443895:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681716352 00000100:00100000:1.0:1788574391.443898:0:18573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681716480 00000100:00100000:1.0:1788574391.443915:0:18573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788574391.443923:0:18573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f6673480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681715712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574391.443957:0:17072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c335ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681715584:12345-0@lo:400:kworker.0 Request processed in 67us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574391.443966:0:17072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788574391.443976:0:18573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f6673480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681715712:12345-0@lo:400:kworker.0 Request processed in 53us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574391.443986:0:17072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788574391.443994:0:17072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f6670380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681716224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574391.444022:0:17072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f6670380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681716224:12345-0@lo:400:kworker.0 Request processed in 30us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574391.444028:0:17072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788574391.444070:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681716224:0@lo:400:kworker.0 00000100:00100000:0.0:1788574391.444094:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681715712:0@lo:400:kworker.0 00000100:00100000:0.0:1788574391.444119:0:18898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681716096 00000100:00100000:0.0:1788574391.444123:0:18898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681716096 00000100:00100000:0.0:1788574391.444141:0:18898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681716736 00000100:00100000:0.0:1788574391.444144:0:18898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681716736 00000100:00100000:0.0:1788574391.444156:0:18898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681716608 00000100:00100000:0.0:1788574391.444158:0:18898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681716608 00000100:00100000:0.0:1788574391.444169:0:18898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681717120 00000100:00100000:0.0:1788574391.444171:0:18898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681717120 00000100:00100000:0.0:1788574391.444183:0:18898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681716864 00000100:00100000:0.0:1788574391.444185:0:18898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681716864 00000100:00100000:0.0:1788574391.444230:0:18898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788574391.444237:0:18898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3ea7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875455681716096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574391.444267:0:18898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3ea7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3618:x1875455681716096:12345-0@lo:400:kworker.0 Request processed in 31us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574391.444273:0:18898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788574391.444286:0:18898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788574391.444292:0:18898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f6673800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875455681716736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574391.444322:0:18898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f6673800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875455681716736:12345-0@lo:400:kworker.0 Request processed in 32us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574391.444328:0:18898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788574391.444339:0:18898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788574391.444344:0:18898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3ea6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875455681716608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574391.444371:0:18898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3ea6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3618:x1875455681716608:12345-0@lo:400:kworker.0 Request processed in 27us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574391.444377:0:18898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788574391.444398:0:18898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788574391.444412:0:18898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3ea6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875455681717120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574391.444439:0:18898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3ea6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1875455681717120:12345-0@lo:400:kworker.0 Request processed in 29us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574391.444445:0:18898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788574391.444457:0:18898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788574391.444465:0:18898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f6665880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875455681716864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574391.444501:0:18898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f6665880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875455681716864:12345-0@lo:400:kworker.0 Request processed in 38us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574391.444504:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574391.444513:0:18898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788574391.444526:0:18898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681716992 00000100:00100000:0.0:1788574391.444530:0:18898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681716992 00000100:00100000:0.0:1788574391.444553:0:18898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788574391.444559:0:18898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875455681716992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574391.444836:0:18898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875455681716992:12345-0@lo:400:kworker.0 Request processed in 276us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574391.444843:0:18898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788574391.444884:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85ffafdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3619:1875455681716736:0@lo:400:kworker.0 00000100:00100000:0.0:1788574391.444912:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85ffafd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3617:1875455681716992:0@lo:400:kworker.0 00000100:00100000:0.0:1788574391.444946:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681715328 00000100:00100000:0.0:1788574391.444950:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681715328 00000100:00100000:0.0:1788574391.444969:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681715840 00000100:00100000:0.0:1788574391.444972:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681715840 00000100:00100000:0.0:1788574391.444984:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788574391.444990:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c2bdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3620:x1875455681715328:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788574391.445013:0:18576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788574391.445045:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c2bdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3620:x1875455681715328:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (1389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574391.445056:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788574391.445067:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788574391.445072:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f6666d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3620:x1875455681715840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788574391.445081:0:18576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788574391.445103:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f6666d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3620:x1875455681715840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 31us (1367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574391.445108:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788574391.445478:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788574391.445489:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85c66b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681715968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574391.445532:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85c66b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875455681715968:12345-0@lo:400:kworker.0 Request processed in 45us (1849us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574391.445541:0:18573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788574391.445558:0:18573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788574391.445565:0:18573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f6665f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681716352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574391.445595:0:18573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f6665f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1875455681716352:12345-0@lo:400:kworker.0 Request processed in 32us (1805us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574391.445599:0:18573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788574391.445609:0:18573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788574391.445613:0:18573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681716480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574391.445638:0:18573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681716480:12345-0@lo:400:kworker.0 Request processed in 24us (1883us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574391.445643:0:18573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788574391.445758:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3618:1875455681716096:0@lo:400:kworker.0 00000100:00100000:1.0:1788574391.445768:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85ffafe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3618:1875455681716608:0@lo:400:kworker.0 00010000:00080000:1.0:1788574391.445779:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85ffafca80 x1875455681717120/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574407 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574391.445788:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85ffafca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3618:1875455681717120:0@lo:400:kworker.0 00000100:00100000:1.0:1788574391.445797:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681715584:0@lo:400:kworker.0 00000100:00080000:1.0:1788574391.445838:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788574391.445842:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788574391.445851:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788574391.445853:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788574391.445884:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c36dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681715328:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788574391.445896:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6672a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681715840:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788574391.445904:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3620:1875455681716352:0@lo:400:kworker.0 00010000:00080000:1.0:1788574391.445913:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c85ffaffb80 x1875455681716864/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574407 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574391.445920:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85ffaffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3620:1875455681716864:0@lo:400:kworker.0 00000100:00100000:1.0:1788574391.445942:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3617:1875455681715968:0@lo:400:kworker.0 00000100:00100000:1.0:1788574391.445948:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681716480:0@lo:400:kworker.0 00000100:00100000:1.0:1788574391.445971:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681715456 00000100:00100000:1.0:1788574391.445975:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681715456 00000100:00100000:1.0:1788574391.445998:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788574391.446003:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1b9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f73678fb-d8c0-450f-a73b-e6565942045e+24:3617:x1875455681715456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788574391.446013:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788574391.446128:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1b9fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f73678fb-d8c0-450f-a73b-e6565942045e+24:3617:x1875455681715456:12345-0@lo:400:kworker.0 Request processed in 124us (2575us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574391.446136:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788574391.446166:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85faf5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f73678fb-d8c0-450f-a73b-e6565942045e:3617:1875455681715456:0@lo:400:kworker.0 00000100:00100000:2.0:1788574391.456339:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574391.456450:0:18898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669048192 00000100:00100000:0.0:1788574391.456462:0:18898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669048192 00000100:00100000:0.0:1788574391.456548:0:18898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 42 00000100:00100000:0.0:1788574391.456559:0:18898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74bce780-6a9f-42e0-9637-fe6b1665ce5b+21:15638:x1875455669048192:12345-192.168.204.51@tcp:101:cat.0 00010000:00010000:0.0:1788574391.456583:0:18898:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574391.456604:0:18898:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6000/0x5bf8706fdac8d747 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6c8e expref: -99 pid: 18898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574391.456715:0:18898:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6a00/0x5bf8706fdac8d74e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574391.456731:0:18898:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6a00/0x5bf8706fdac8d74e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574391.456745:0:18898:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6a00/0x5bf8706fdac8d74e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788574391.456758:0:18898:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788574391.456897:0:18898:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6000/0x5bf8706fdac8d747 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6c8e expref: 24 pid: 18898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574391.456930:0:18898:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6a00/0x5bf8706fdac8d74e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6c8e expref: 23 pid: 18898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574391.456939:0:18898:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c85d10a6300) 00010000:00010000:0.0:1788574391.456941:0:18898:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788574391.456945:0:18898:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d20d6a00, rc 0) 00000100:00100000:0.0:1788574391.457007:0:18898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74bce780-6a9f-42e0-9637-fe6b1665ce5b+23:15638:x1875455669048192:12345-192.168.204.51@tcp:101:cat.0 Request processed in 449us (677us total) trans 8589934606 rc 0/0 00000100:00100000:0.0:1788574391.457014:0:18898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 42 00000100:00080000:1.0:1788574391.457233:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788574391.463768:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574391.463819:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574391.464029:0:17071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669048576 00000100:00100000:0.0:1788574391.464040:0:17071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669048576 00000100:00100000:0.0:1788574391.464105:0:17071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 8 00000100:00100000:0.0:1788574391.464115:0:17071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f6665500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74bce780-6a9f-42e0-9637-fe6b1665ce5b+23:15638:x1875455669048576:12345-192.168.204.51@tcp:35:cat.0 00000100:00100000:1.0:1788574391.464562:0:17054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669048320 00000100:00100000:1.0:1788574391.464569:0:17054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669048320 00000100:00100000:1.0:1788574391.464616:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 1 00000100:00100000:1.0:1788574391.464624:0:17054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f6667100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:74bce780-6a9f-42e0-9637-fe6b1665ce5b+25:2394:x1875455669048320:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788574391.464636:0:17054:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574391.464659:0:17054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6a00/0x5bf8706fdac8d74e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6c8e expref: 25 pid: 18898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574391.464690:0:17054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c85d10a6300) 00010000:00010000:1.0:1788574391.464695:0:17054:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788574391.466249:0:17071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f6665500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74bce780-6a9f-42e0-9637-fe6b1665ce5b+24:15638:x1875455669048576:12345-192.168.204.51@tcp:35:cat.0 Request processed in 2128us (2422us total) trans 8589934607 rc 0/0 00000100:00100000:0.0:1788574391.466262:0:17071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 8 00000100:00100000:1.0:1788574391.466358:0:17054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f6667100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:74bce780-6a9f-42e0-9637-fe6b1665ce5b+23:2394:x1875455669048320:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 1734us (2601us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574391.466367:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 1 00000100:00100000:2.0:1788574391.576155:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574391.576293:0:17067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669048832 00000100:00100000:0.0:1788574391.576303:0:17067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669048832 00000100:00100000:0.0:1788574391.576391:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 43 00000100:00100000:0.0:1788574391.576402:0:17067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3008380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74bce780-6a9f-42e0-9637-fe6b1665ce5b+23:15644:x1875455669048832:12345-192.168.204.51@tcp:101:dd.0 00010000:00010000:0.0:1788574391.576424:0:17067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574391.576444:0:17067:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6000/0x5bf8706fdac8d75c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6c95 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574391.576844:0:17067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8d763 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574391.576873:0:17067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8d763 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574391.576885:0:17067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8d763 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788574391.576898:0:17067:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788574391.577106:0:17067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6000/0x5bf8706fdac8d75c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6c95 expref: 26 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574391.577126:0:17067:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8d763 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6c95 expref: 25 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574391.577135:0:17067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c85d10a6300) 00010000:00010000:0.0:1788574391.577138:0:17067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788574391.577142:0:17067:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d20d6600, rc 0) 00000100:00100000:0.0:1788574391.577921:0:17067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3008380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74bce780-6a9f-42e0-9637-fe6b1665ce5b+25:15644:x1875455669048832:12345-192.168.204.51@tcp:101:dd.0 Request processed in 1515us (1771us total) trans 8589934608 rc 0/0 00000100:00100000:0.0:1788574391.577942:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 43 00000100:00100000:2.0:1788574391.593519:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574391.593564:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574391.593632:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669048960 00000100:00100000:0.0:1788574391.593643:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669048960 00000100:00100000:0.0:1788574391.593714:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 44 00000100:00100000:0.0:1788574391.593734:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3009500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74bce780-6a9f-42e0-9637-fe6b1665ce5b+25:15644:x1875455669048960:12345-192.168.204.51@tcp:101:dd.0 00010000:00010000:0.0:1788574391.593758:0:17068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574391.593779:0:17068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7a00/0x5bf8706fdac8d771 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6c9c expref: -99 pid: 17068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574391.593835:0:17068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6c00/0x5bf8706fdac8d778 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574391.593849:0:17068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6c00/0x5bf8706fdac8d778 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574391.593862:0:17068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6c00/0x5bf8706fdac8d778 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574391.593894:0:17052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669049088 00000100:00100000:1.0:1788574391.593900:0:17052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669049088 00010000:00010000:0.0:1788574391.593986:0:17068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7a00/0x5bf8706fdac8d771 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6c9c expref: 28 pid: 17068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574391.594004:0:17068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6c00/0x5bf8706fdac8d778 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6c9c expref: 27 pid: 17068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574391.594013:0:17068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c85d10a6300) 00010000:00010000:0.0:1788574391.594016:0:17068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788574391.594020:0:17068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d20d6c00, rc 0) 00000100:00100000:0.0:1788574391.594084:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3009500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74bce780-6a9f-42e0-9637-fe6b1665ce5b+27:15644:x1875455669048960:12345-192.168.204.51@tcp:101:dd.0 Request processed in 362us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574391.594092:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 44 00000100:00100000:1.0:1788574391.601185:0:17052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 2 00000100:00100000:1.0:1788574391.601586:0:17052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3008000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74bce780-6a9f-42e0-9637-fe6b1665ce5b+26:2396:x1875455669049088:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788574391.601612:0:17052:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574391.601644:0:17052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8d763 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6c95 expref: 26 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574391.601668:0:17052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c85d10a6300) 00010000:00010000:1.0:1788574391.601673:0:17052:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788574391.601744:0:17052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3008000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74bce780-6a9f-42e0-9637-fe6b1665ce5b+25:2396:x1875455669049088:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 176us (8178us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574391.601752:0:17052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 2 00000100:00100000:2.0:1788574391.605635:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574391.605820:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669049344 00000100:00100000:1.0:1788574391.605830:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669049344 00000100:00100000:1.0:1788574391.608141:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 45 00000100:00100000:1.0:1788574391.608155:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c300bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74bce780-6a9f-42e0-9637-fe6b1665ce5b+25:15644:x1875455669049344:12345-192.168.204.51@tcp:36:dd.0 00010000:00010000:1.0:1788574391.608230:0:17069:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574391.608259:0:17069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8d716 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6c79 expref: 25 pid: 17068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574391.608311:0:17069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c85d10a6300) 00010000:00010000:1.0:1788574391.608317:0:17069:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788574391.608563:0:17069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6000/0x5bf8706fdac8d77f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574391.608577:0:17069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6000/0x5bf8706fdac8d77f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574391.608587:0:17069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6000/0x5bf8706fdac8d77f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788574391.608638:0:17069:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:0.0:1788574391.608663:0:17069:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d9554bee reply state 0000000093d352b1 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6000/0x5bf8706fdac8d77f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574391.608674:0:17069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6000/0x5bf8706fdac8d77f lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574391.608680:0:17069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c85d10a6300) 00010000:00010000:0.0:1788574391.608682:0:17069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788574391.608685:0:17069:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788574391.608779:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c300bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74bce780-6a9f-42e0-9637-fe6b1665ce5b+27:15644:x1875455669049344:12345-192.168.204.51@tcp:36:dd.0 Request processed in 626us (3154us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1788574391.608786:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 45 00000020:00080000:0.0:1788574391.608790:0:17069:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788574391.756759:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574391.758129:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669049600 00000100:00100000:2.0:1788574391.758145:0:17070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669049600 00000100:00100000:2.0:1788574391.758259:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 9 00000100:00100000:2.0:1788574391.758271:0:17070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f6670a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:74bce780-6a9f-42e0-9637-fe6b1665ce5b+27:15644:x1875455669049600:12345-192.168.204.51@tcp:35:dd.0 00000100:00100000:2.0:1788574391.758594:0:17070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f6670a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:74bce780-6a9f-42e0-9637-fe6b1665ce5b+28:15644:x1875455669049600:12345-192.168.204.51@tcp:35:dd.0 Request processed in 324us (1844us total) trans 8589934611 rc 0/0 00000100:00100000:2.0:1788574391.758624:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 9 00010000:00010000:1.0:1788574391.763459:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574392.060051:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574392.060165:0:18898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669049728 00000100:00100000:0.0:1788574392.060176:0:18898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669049728 00000100:00100000:0.0:1788574392.060286:0:18898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 46 00000100:00100000:0.0:1788574392.060299:0:18898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c300ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74bce780-6a9f-42e0-9637-fe6b1665ce5b+28:15659:x1875455669049728:12345-192.168.204.51@tcp:101:stat.0 00010000:00010000:0.0:1788574392.060324:0:18898:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574392.060345:0:18898:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7a00/0x5bf8706fdac8d786 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6ca3 expref: -99 pid: 18898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574392.060423:0:18898:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7600/0x5bf8706fdac8d78d lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574392.060452:0:18898:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7600/0x5bf8706fdac8d78d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574392.060486:0:18898:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7600/0x5bf8706fdac8d78d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574392.060498:0:18898:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6200/0x5bf8706fdac8d794 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574392.060505:0:18898:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6200/0x5bf8706fdac8d794 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574392.060512:0:18898:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6200/0x5bf8706fdac8d794 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574392.060760:0:18898:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7000/0x5bf8706fdac8d79b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574392.060781:0:18898:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7000/0x5bf8706fdac8d79b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574392.060789:0:18898:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7000/0x5bf8706fdac8d79b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788574392.060836:0:18898:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788574392.060849:0:18898:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788574392.060889:0:18898:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7000/0x5bf8706fdac8d79b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574392.060901:0:18898:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7000/0x5bf8706fdac8d79b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574392.060910:0:18898:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7600/0x5bf8706fdac8d78d lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574392.060926:0:18898:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7600/0x5bf8706fdac8d78d lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574392.060933:0:18898:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7600/0x5bf8706fdac8d78d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574392.060939:0:18898:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d7600 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:0.0:1788574392.060943:0:18898:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7600/0x5bf8706fdac8d78d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574392.060951:0:18898:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7600/0x5bf8706fdac8d78d lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574392.060964:0:18898:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c85c4fa6200) 00010000:00010000:0.0:1788574392.060966:0:18898:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574392.060972:0:18898:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7600/0x5bf8706fdac8d78d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574392.060978:0:18898:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7600/0x5bf8706fdac8d78d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574392.060993:0:18898:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6200/0x5bf8706fdac8d794 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574392.060999:0:18898:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6200/0x5bf8706fdac8d794 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574392.061006:0:18898:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6200/0x5bf8706fdac8d794 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574392.061011:0:18898:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d6200 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:0.0:1788574392.061020:0:18898:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6200/0x5bf8706fdac8d794 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574392.061027:0:18898:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6200/0x5bf8706fdac8d794 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574392.061035:0:18898:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9c85d10a6200) 00010000:00010000:0.0:1788574392.061038:0:18898:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574392.061041:0:18898:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6200/0x5bf8706fdac8d794 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574392.061046:0:18898:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6200/0x5bf8706fdac8d794 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574392.061073:0:18898:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7a00/0x5bf8706fdac8d786 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ca3 expref: 30 pid: 18898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574392.061087:0:18898:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7000/0x5bf8706fdac8d79b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ca3 expref: 29 pid: 18898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574392.061096:0:18898:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c85d10a6300) 00010000:00010000:0.0:1788574392.061098:0:18898:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788574392.061101:0:18898:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d20d7000, rc 0) 00000100:00100000:0.0:1788574392.061168:0:18898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c300ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74bce780-6a9f-42e0-9637-fe6b1665ce5b+29:15659:x1875455669049728:12345-192.168.204.51@tcp:101:stat.0 Request processed in 872us (1129us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574392.061176:0:18898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 46 00000100:00100000:3.0:1788574392.189342:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574392.189523:0:17067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669049984 00000100:00100000:0.0:1788574392.189534:0:17067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669049984 00000100:00100000:0.0:1788574392.189607:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 47 00000100:00100000:0.0:1788574392.189618:0:17067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f6665180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74bce780-6a9f-42e0-9637-fe6b1665ce5b+29:15665:x1875455669049984:12345-192.168.204.51@tcp:36:truncate.0 00010000:00010000:0.0:1788574392.189713:0:17067:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574392.189743:0:17067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7000/0x5bf8706fdac8d79b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ca3 expref: 29 pid: 18898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574392.189765:0:17067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c85d10a6300) 00010000:00010000:0.0:1788574392.189771:0:17067:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788574392.190098:0:17067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7a00/0x5bf8706fdac8d7a2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574392.190114:0:17067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7a00/0x5bf8706fdac8d7a2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574392.190125:0:17067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7a00/0x5bf8706fdac8d7a2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788574392.190175:0:17067:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934612 00000004:00010000:0.0:1788574392.190383:0:17067:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000099b25f6d reply state 00000000137be5f4 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7a00/0x5bf8706fdac8d7a2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574392.190397:0:17067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7a00/0x5bf8706fdac8d7a2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574392.190404:0:17067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c85d10a6300) 00010000:00010000:0.0:1788574392.190407:0:17067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788574392.190410:0:17067:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788574392.190551:0:17067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f6665180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74bce780-6a9f-42e0-9637-fe6b1665ce5b+31:15665:x1875455669049984:12345-192.168.204.51@tcp:36:truncate.0 Request processed in 934us (1223us total) trans 8589934613 rc 0/0 00000100:00100000:0.0:1788574392.190559:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 47 00000020:00080000:0.0:1788574392.190564:0:17067:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:2.0:1788574392.215071:0:17104:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788574392.434011:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574392.436581:0:18898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669050112 00000100:00100000:0.0:1788574392.436618:0:18898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669050112 00000100:00100000:0.0:1788574392.436699:0:18898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 48 00000100:00100000:0.0:1788574392.436712:0:18898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f6667b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74bce780-6a9f-42e0-9637-fe6b1665ce5b+31:15679:x1875455669050112:12345-192.168.204.51@tcp:101:stat.0 00010000:00010000:0.0:1788574392.436753:0:18898:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574392.436780:0:18898:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7000/0x5bf8706fdac8d7a9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6caa expref: -99 pid: 18898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574392.436854:0:18898:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6200/0x5bf8706fdac8d7b0 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574392.436870:0:18898:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6200/0x5bf8706fdac8d7b0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574392.436882:0:18898:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6200/0x5bf8706fdac8d7b0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574392.436893:0:18898:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7600/0x5bf8706fdac8d7b7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574392.436901:0:18898:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7600/0x5bf8706fdac8d7b7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574392.436908:0:18898:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7600/0x5bf8706fdac8d7b7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574392.436983:0:18898:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8d7be lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574392.436991:0:18898:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8d7be lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574392.437006:0:18898:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8d7be lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788574392.437066:0:18898:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:0.0:1788574392.437071:0:18898:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788574392.437093:0:18898:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8d7be lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574392.437106:0:18898:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8d7be lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574392.437116:0:18898:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6200/0x5bf8706fdac8d7b0 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574392.437122:0:18898:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6200/0x5bf8706fdac8d7b0 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574392.437129:0:18898:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6200/0x5bf8706fdac8d7b0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574392.437135:0:18898:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d6200 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:0.0:1788574392.437140:0:18898:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6200/0x5bf8706fdac8d7b0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574392.437148:0:18898:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6200/0x5bf8706fdac8d7b0 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574392.437160:0:18898:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c85c4fa6200) 00010000:00010000:0.0:1788574392.437164:0:18898:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574392.437169:0:18898:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6200/0x5bf8706fdac8d7b0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574392.437176:0:18898:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6200/0x5bf8706fdac8d7b0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574392.437221:0:18898:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7600/0x5bf8706fdac8d7b7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574392.437229:0:18898:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7600/0x5bf8706fdac8d7b7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574392.437235:0:18898:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7600/0x5bf8706fdac8d7b7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574392.437240:0:18898:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d7600 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:0.0:1788574392.437242:0:18898:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7600/0x5bf8706fdac8d7b7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574392.437248:0:18898:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7600/0x5bf8706fdac8d7b7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574392.437255:0:18898:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9c85d10a6200) 00010000:00010000:0.0:1788574392.437257:0:18898:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574392.437259:0:18898:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7600/0x5bf8706fdac8d7b7 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574392.437265:0:18898:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7600/0x5bf8706fdac8d7b7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574392.437291:0:18898:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7000/0x5bf8706fdac8d7a9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6caa expref: 33 pid: 18898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574392.437302:0:18898:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8d7be lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6caa expref: 32 pid: 18898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574392.437319:0:18898:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c85d10a6300) 00010000:00010000:0.0:1788574392.437321:0:18898:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788574392.437323:0:18898:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d20d6400, rc 0) 00000100:00100000:0.0:1788574392.437643:0:18898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f6667b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74bce780-6a9f-42e0-9637-fe6b1665ce5b+32:15679:x1875455669050112:12345-192.168.204.51@tcp:101:stat.0 Request processed in 932us (3640us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574392.437650:0:18898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 48 00000100:00100000:2.0:1788574392.572007:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574392.572107:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669050368 00000100:00100000:3.0:1788574392.572118:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669050368 00000100:00100000:3.0:1788574392.572182:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 49 00000100:00100000:3.0:1788574392.572226:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3008a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74bce780-6a9f-42e0-9637-fe6b1665ce5b+32:15689:x1875455669050368:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:3.0:1788574392.572261:0:17069:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574392.572285:0:17069:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8d7c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6cb1 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788574392.572444:0:17069:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788574392.572568:0:17069:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8d7c5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6cb1 expref: 34 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574392.572656:0:17069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c85cbaaf300) 00010000:00010000:3.0:1788574392.572660:0:17069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788574392.572665:0:17069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8d7c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6cb1 expref: 34 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574392.572682:0:17069:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85faea2200, rc 0) 00000100:00100000:3.0:1788574392.572755:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3008a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74bce780-6a9f-42e0-9637-fe6b1665ce5b+33:15689:x1875455669050368:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 564us (760us total) trans 8589934614 rc 301/301 00000100:00100000:3.0:1788574392.572763:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 49 00000100:00100000:2.0:1788574392.585865:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574392.586381:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669050624 00000100:00100000:0.0:1788574392.586392:0:17070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669050624 00000100:00100000:0.0:1788574392.586806:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 10 00000100:00100000:0.0:1788574392.586819:0:17070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fafe5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:74bce780-6a9f-42e0-9637-fe6b1665ce5b+33:15689:x1875455669050624:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:0.0:1788574392.587180:0:17070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fafe5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:74bce780-6a9f-42e0-9637-fe6b1665ce5b+34:15689:x1875455669050624:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 359us (1319us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1788574392.587205:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 10 00000100:00100000:0.0:1788574392.694849:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574392.696375:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669050880 00000100:00100000:2.0:1788574392.696477:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669050880 00000100:00100000:2.0:1788574392.696566:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 50 00000100:00100000:2.0:1788574392.696578:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f6670a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74bce780-6a9f-42e0-9637-fe6b1665ce5b+34:15695:x1875455669050880:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:2.0:1788574392.696608:0:17068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574392.696632:0:17068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e400/0x5bf8706fdac8d7d3 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6cb8 expref: -99 pid: 17068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574392.696752:0:17068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217ea00/0x5bf8706fdac8d7da lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574392.696770:0:17068:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8d701 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6c72 expref: 35 pid: 18898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574392.696779:0:17068:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8d7be lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6caa expref: 35 pid: 18898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574392.696788:0:17068:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217ea00/0x5bf8706fdac8d7da lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574392.696826:0:17068:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8d7be lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6caa expref: 35 pid: 18898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574392.696864:0:17068:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8d7be lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6caa expref: 35 pid: 18898 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574392.696880:0:17068:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c300aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17068:1875455681717248:192.168.204.51@tcp:104: 00010000:00010000:2.0:1788574392.697059:0:17068:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8d701 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6c72 expref: 35 pid: 18898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574392.697070:0:17068:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8d701 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6c72 expref: 35 pid: 18898 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574392.697080:0:17068:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3008700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17068:1875455681717376:192.168.204.51@tcp:104: 00000100:00100000:2.0:1788574392.697111:0:17068:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8600274b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788574392.714729:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574392.714837:0:17068:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c300aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17068:1875455681717248:192.168.204.51@tcp:104: 00000100:00100000:0.0:1788574392.714847:0:17068:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3008700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17068:1875455681717376:192.168.204.51@tcp:104: 00010000:00010000:0.0:1788574392.714873:0:17068:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217ea00/0x5bf8706fdac8d7da lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574392.714955:0:17054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669051008 00000100:00100000:1.0:1788574392.714962:0:17054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669051008 00010000:00010000:1.0:1788574392.714996:0:17054:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8d701 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6c72 expref: 36 pid: 18898 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574392.715043:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 17 00000100:00100000:1.0:1788574392.715051:0:17054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa36e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:74bce780-6a9f-42e0-9637-fe6b1665ce5b+36:2393:x1875455669051008:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788574392.715066:0:17054:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574392.715072:0:17054:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8d701 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6c72 expref: 36 pid: 18898 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574392.715082:0:17054:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8d701 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6c72 expref: 36 pid: 18898 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574392.715102:0:17054:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8d701 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6c72 expref: 36 pid: 18898 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574392.715118:0:17054:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c85d10a6300) 00010000:00010000:1.0:1788574392.715123:0:17054:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217ea00/0x5bf8706fdac8d7da lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574392.715132:0:17054:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217ea00/0x5bf8706fdac8d7da lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574392.715157:0:17054:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788574392.715540:0:17054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa36e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:74bce780-6a9f-42e0-9637-fe6b1665ce5b+35:2393:x1875455669051008:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 487us (818us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574392.715549:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 17 00000100:00100000:3.0:1788574392.720184:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574392.720900:0:17052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669051136 00000100:00100000:1.0:1788574392.720922:0:17052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669051136 00010000:00010000:1.0:1788574392.720963:0:17052:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8d7be lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6caa expref: 35 pid: 18898 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574392.721007:0:17052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 18 00000100:00100000:1.0:1788574392.721028:0:17052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f6666a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74bce780-6a9f-42e0-9637-fe6b1665ce5b+35:2393:x1875455669051136:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788574392.721044:0:17052:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574392.721050:0:17052:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8d7be lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6caa expref: 35 pid: 18898 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574392.721064:0:17052:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8d7be lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6caa expref: 35 pid: 18898 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574392.721085:0:17052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8d7be lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6caa expref: 35 pid: 18898 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574392.721102:0:17052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c85d10a6300) 00010000:00010000:1.0:1788574392.721107:0:17052:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217ea00/0x5bf8706fdac8d7da lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574392.721118:0:17052:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217ea00/0x5bf8706fdac8d7da lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574392.721143:0:17052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217ea00/0x5bf8706fdac8d7da lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574392.721375:0:17052:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788574392.721438:0:17052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f6666a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74bce780-6a9f-42e0-9637-fe6b1665ce5b+34:2393:x1875455669051136:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 421us (1264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574392.721447:0:17052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 18 00010000:00010000:0.0:1788574392.723620:0:17068:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217ea00/0x5bf8706fdac8d7da lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574392.723638:0:17068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217ea00/0x5bf8706fdac8d7da lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788574392.723686:0:17068:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:0.0:1788574392.723850:0:17068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e400/0x5bf8706fdac8d7d3 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6cb8 expref: 35 pid: 17068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574392.723872:0:17068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217ea00/0x5bf8706fdac8d7da lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6cb8 expref: 34 pid: 17068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574392.723881:0:17068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c85d10a6300) 00010000:00010000:0.0:1788574392.723884:0:17068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788574392.723887:0:17068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c860217ea00, rc 0) 00000100:00100000:0.0:1788574392.724085:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f6670a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74bce780-6a9f-42e0-9637-fe6b1665ce5b+34:15695:x1875455669050880:12345-192.168.204.51@tcp:101:bash.0 Request processed in 27507us (29244us total) trans 8589934616 rc 0/0 00000100:00100000:0.0:1788574392.724095:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 50 00000100:00100000:3.0:1788574392.734000:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574392.734484:0:17067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669051392 00000100:00100000:0.0:1788574392.734495:0:17067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669051392 00000100:00100000:0.0:1788574392.734654:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 51 00000100:00100000:0.0:1788574392.734666:0:17067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f6667480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74bce780-6a9f-42e0-9637-fe6b1665ce5b+34:15695:x1875455669051392:12345-192.168.204.51@tcp:36:bash.0 00010000:00010000:0.0:1788574392.734903:0:17067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6200/0x5bf8706fdac8d7e8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574392.734920:0:17067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6200/0x5bf8706fdac8d7e8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574392.734932:0:17067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6200/0x5bf8706fdac8d7e8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788574392.734987:0:17067:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000004:00010000:0.0:1788574392.735018:0:17067:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dbfce03a reply state 00000000c3226162 transno 8589934618 ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6200/0x5bf8706fdac8d7e8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574392.735030:0:17067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6200/0x5bf8706fdac8d7e8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574392.735038:0:17067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c85d10a6300) 00010000:00010000:0.0:1788574392.735040:0:17067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788574392.735044:0:17067:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788574392.735146:0:17067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f6667480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74bce780-6a9f-42e0-9637-fe6b1665ce5b+37:15695:x1875455669051392:12345-192.168.204.51@tcp:36:bash.0 Request processed in 482us (1156us total) trans 8589934618 rc 0/0 00000100:00100000:0.0:1788574392.735155:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 51 00000020:00080000:0.0:1788574392.735160:0:17067:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788574392.739798:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574392.739969:0:18898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669051520 00000100:00100000:0.0:1788574392.739980:0:18898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669051520 00000100:00100000:0.0:1788574392.740105:0:18898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 52 00000100:00100000:0.0:1788574392.740118:0:18898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f6664380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74bce780-6a9f-42e0-9637-fe6b1665ce5b+37:15695:x1875455669051520:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:0.0:1788574392.740144:0:18898:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574392.740165:0:18898:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8d7ef lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6cbf expref: -99 pid: 18898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574392.740273:0:18898:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8d7ef lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6cbf expref: 38 pid: 18898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574392.740290:0:18898:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8d7ef lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6cbf expref: 38 pid: 18898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574392.740309:0:18898:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c85d10a6300) 00010000:00010000:0.0:1788574392.740313:0:18898:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788574392.740330:0:18898:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d20d6600, rc 0) 00000100:00100000:0.0:1788574392.740403:0:18898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f6664380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74bce780-6a9f-42e0-9637-fe6b1665ce5b+38:15695:x1875455669051520:12345-192.168.204.51@tcp:101:bash.0 Request processed in 287us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574392.740411:0:18898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 52 00000100:00100000:2.0:1788574392.769799:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574392.769901:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669051648 00000100:00100000:3.0:1788574392.769912:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669051648 00000100:00100000:3.0:1788574392.769977:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 53 00000100:00100000:3.0:1788574392.769989:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c300a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74bce780-6a9f-42e0-9637-fe6b1665ce5b+38:15695:x1875455669051648:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:3.0:1788574392.770010:0:17069:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574392.770030:0:17069:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3000/0x5bf8706fdac8d7f6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6cc6 expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574392.770135:0:17069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8d7fd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574392.770164:0:17069:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217ea00/0x5bf8706fdac8d7da lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6cb8 expref: 39 pid: 17068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574392.770172:0:17069:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8d7fd lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574392.770256:0:17069:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217ea00/0x5bf8706fdac8d7da lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6cb8 expref: 39 pid: 17068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574392.770269:0:17069:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217ea00/0x5bf8706fdac8d7da lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6cb8 expref: 39 pid: 17068 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574392.770281:0:17069:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6667800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17069:1875455681717504:192.168.204.51@tcp:104: 00000100:00100000:3.0:1788574392.770373:0:17069:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85d10820c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788574392.778157:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574392.778234:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669051776 00000100:00100000:1.0:1788574392.778245:0:17053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669051776 00010000:00010000:1.0:1788574392.778286:0:17053:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217ea00/0x5bf8706fdac8d7da lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6cb8 expref: 40 pid: 17068 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574392.778334:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 19 00000100:00100000:1.0:1788574392.778345:0:17053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f6664a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:74bce780-6a9f-42e0-9637-fe6b1665ce5b+40:2393:x1875455669051776:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788574392.778374:0:17053:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574392.778381:0:17053:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217ea00/0x5bf8706fdac8d7da lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6cb8 expref: 40 pid: 17068 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574392.778477:0:17053:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217ea00/0x5bf8706fdac8d7da lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6cb8 expref: 40 pid: 17068 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574392.778621:0:17053:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c85d10a6300) 00010000:00010000:1.0:1788574392.778630:0:17053:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8d7fd lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574392.778641:0:17053:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8d7fd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574392.778669:0:17053:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8d7fd lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574392.778773:0:17053:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788574392.778861:0:17053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f6664a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:74bce780-6a9f-42e0-9637-fe6b1665ce5b+40:2393:x1875455669051776:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 511us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574392.778869:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 19 00010000:00010000:0.0:1788574392.788434:0:17069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217ea00/0x5bf8706fdac8d7da lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6cb8 expref: 39 pid: 17068 timeout: 632 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574392.788463:0:17069:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6667800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17069:1875455681717504:192.168.204.51@tcp:104: 00010000:00010000:0.0:1788574392.788497:0:17069:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8d7fd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574392.788604:0:17069:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8d7fd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574392.788612:0:17069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8d7fd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788574392.788669:0:17069:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788574392.788674:0:17069:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788574392.788695:0:17069:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8d7fd lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574392.788729:0:17069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3000/0x5bf8706fdac8d7f6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6cc6 expref: 39 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574392.788744:0:17069:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8d7fd lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6cc6 expref: 38 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574392.788754:0:17069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c85d10a6300) 00010000:00010000:0.0:1788574392.788775:0:17069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788574392.788780:0:17069:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85faea2200, rc 0) 00000100:00100000:0.0:1788574392.788857:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c300a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74bce780-6a9f-42e0-9637-fe6b1665ce5b+38:15695:x1875455669051648:12345-192.168.204.51@tcp:101:bash.0 Request processed in 18869us (19067us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574392.788866:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 53 00010000:00010000:2.0:1788574392.790526:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574392.798681:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574392.798788:0:17052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669052032 00000100:00100000:1.0:1788574392.798798:0:17052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669052032 00000100:00100000:1.0:1788574392.799034:0:17052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 3 00000100:00100000:1.0:1788574392.799046:0:17052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3009880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74bce780-6a9f-42e0-9637-fe6b1665ce5b+38:15695:x1875455669052032:12345-192.168.204.51@tcp:103:bash.0 00010000:00010000:1.0:1788574392.799062:0:17052:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788574392.799091:0:17052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8d7ef lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6cbf expref: 38 pid: 18898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574392.799115:0:17052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2200/0x5bf8706fdac8d7fd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6cc6 expref: 37 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574392.799127:0:17052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c85d10a6300) 00010000:00010000:1.0:1788574392.799132:0:17052:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788574392.799284:0:17052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3009880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74bce780-6a9f-42e0-9637-fe6b1665ce5b+36:15695:x1875455669052032:12345-192.168.204.51@tcp:103:bash.0 Request processed in 234us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574392.799292:0:17052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 3 00000100:00100000:3.0:1788574392.805631:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574392.806741:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669052160 00000100:00100000:2.0:1788574392.806756:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669052160 00000100:00100000:2.0:1788574392.806834:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 54 00000100:00100000:2.0:1788574392.806845:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f6664000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74bce780-6a9f-42e0-9637-fe6b1665ce5b+36:15695:x1875455669052160:12345-192.168.204.51@tcp:58:bash.0 00010000:00010000:2.0:1788574392.806955:0:17068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e800/0x5bf8706fdac8d804 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574392.806973:0:17068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e800/0x5bf8706fdac8d804 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574392.807005:0:17068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e800/0x5bf8706fdac8d804 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788574392.811820:0:17068:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788574392.820477:0:17068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1788574392.820709:0:17068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1788574392.820835:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f6664000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74bce780-6a9f-42e0-9637-fe6b1665ce5b+36:15695:x1875455669052160:12345-192.168.204.51@tcp:58:bash.0 Request processed in 13986us (15209us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574392.820858:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 54 00000100:00100000:2.0:1788574392.825682:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574392.825782:0:17067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669052288 00000100:00100000:0.0:1788574392.825792:0:17067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669052288 00000100:00100000:0.0:1788574392.825864:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 55 00000100:00100000:0.0:1788574392.825874:0:17067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c300a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74bce780-6a9f-42e0-9637-fe6b1665ce5b+36:15695:x1875455669052288:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:0.0:1788574392.825894:0:17067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574392.825926:0:17067:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6a00/0x5bf8706fdac8d80b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6ccd expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574392.825980:0:17067:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e800/0x5bf8706fdac8d804 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574392.825990:0:17067:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6a00/0x5bf8706fdac8d80b lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ccd expref: 37 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574392.826132:0:17067:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e800/0x5bf8706fdac8d804 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574392.826148:0:17067:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6a00/0x5bf8706fdac8d80b lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ccd expref: 37 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574392.826162:0:17067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c85d10a6300) 00010000:00010000:0.0:1788574392.826165:0:17067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788574392.826169:0:17067:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6a00/0x5bf8706fdac8d80b lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ccd expref: 37 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574392.826243:0:17067:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d20d6a00, rc 0) 00000100:00100000:0.0:1788574392.826304:0:17067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c300a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74bce780-6a9f-42e0-9637-fe6b1665ce5b+37:15695:x1875455669052288:12345-192.168.204.51@tcp:101:bash.0 Request processed in 431us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574392.826312:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 55 00000040:00080000:2.0:1788574393.235703:0:17104:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788574393.235716:0:17104:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788574393.235742:0:17104:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788574393.235751:0:17104:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788574393.235906:0:17104:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c3008000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17104:1875455681717632:192.168.204.51@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788574393.236014:0:17104:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8600274b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788574393.240719:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574393.240825:0:18898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669052416 00000100:00100000:0.0:1788574393.240835:0:18898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669052416 00000100:00100000:0.0:1788574393.240922:0:18898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 56 00000100:00100000:0.0:1788574393.240935:0:18898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3008700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74bce780-6a9f-42e0-9637-fe6b1665ce5b+38:15696:x1875455669052416:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788574393.240970:0:18898:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788574393.241091:0:18898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3008700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74bce780-6a9f-42e0-9637-fe6b1665ce5b+38:15696:x1875455669052416:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 Request processed in 159us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574393.241100:0:18898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 56 00000100:00080000:1.0:1788574393.241186:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788574393.242429:0:17104:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c3008000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17104:1875455681717632:192.168.204.51@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788574393.246818:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574393.247536:0:17067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669052544 00000100:00100000:0.0:1788574393.247548:0:17067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669052544 00000100:00100000:0.0:1788574393.247621:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 57 00000100:00100000:0.0:1788574393.247632:0:17067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f6665c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74bce780-6a9f-42e0-9637-fe6b1665ce5b+37:15696:x1875455669052544:12345-192.168.204.51@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788574393.247722:0:17067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8d812 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.247740:0:17067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8d812 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.247753:0:17067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8d812 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.247770:0:17067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8d819 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.247792:0:17067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8d819 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.247798:0:17067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8d819 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.247823:0:17067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8d820 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.247843:0:17067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8d820 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.247850:0:17067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8d820 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788574393.248364:0:17067:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788574393.248371:0:17067:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788574393.248398:0:17067:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8d820 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.248410:0:17067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8d812 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.248417:0:17067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8d812 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.248424:0:17067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8d812 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.248429:0:17067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d6600 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:0.0:1788574393.248433:0:17067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8d812 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.248447:0:17067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8d812 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.248459:0:17067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c84c34f0e00) 00010000:00010000:0.0:1788574393.248462:0:17067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574393.248468:0:17067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8d812 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.248474:0:17067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8d812 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.248489:0:17067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8d819 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.248494:0:17067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8d819 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.248511:0:17067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8d819 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.248516:0:17067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d6400 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:0.0:1788574393.248519:0:17067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8d819 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.248525:0:17067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8d819 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.248531:0:17067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9c85d10a6700) 00010000:00010000:0.0:1788574393.248533:0:17067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574393.248536:0:17067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8d819 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.248550:0:17067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8d819 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.248565:0:17067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8d820 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.248571:0:17067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8d820 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.248576:0:17067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8d820 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.248581:0:17067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d7200 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:0.0:1788574393.248584:0:17067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8d820 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.248589:0:17067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8d820 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.248596:0:17067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c85d10a6300) 00010000:00010000:0.0:1788574393.248598:0:17067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574393.248601:0:17067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8d820 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.248606:0:17067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8d820 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574393.248698:0:17067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f6665c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74bce780-6a9f-42e0-9637-fe6b1665ce5b+37:15696:x1875455669052544:12345-192.168.204.51@tcp:34:lhsmtool_posix.0 Request processed in 1065us (1889us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574393.248708:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 57 00000100:00100000:1.0:1788574393.251939:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574393.252052:0:18898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669052800 00000100:00100000:0.0:1788574393.252061:0:18898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669052800 00000100:00100000:0.0:1788574393.252119:0:18898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 58 00000100:00100000:0.0:1788574393.252129:0:18898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3ea4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74bce780-6a9f-42e0-9637-fe6b1665ce5b+37:15696:x1875455669052800:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788574393.252155:0:18898:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574393.252326:0:18898:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7600/0x5bf8706fdac8d827 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6cd4 expref: -99 pid: 18898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.252454:0:18898:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7000/0x5bf8706fdac8d82e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.252469:0:18898:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7000/0x5bf8706fdac8d82e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.252610:0:18898:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7000/0x5bf8706fdac8d82e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788574393.252625:0:18898:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788574393.252710:0:18898:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7000/0x5bf8706fdac8d82e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.252718:0:18898:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7000/0x5bf8706fdac8d82e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.252725:0:18898:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7000/0x5bf8706fdac8d82e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.252730:0:18898:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d7000 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:0.0:1788574393.252735:0:18898:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7000/0x5bf8706fdac8d82e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.252742:0:18898:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7000/0x5bf8706fdac8d82e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.252770:0:18898:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c85d10a6300) 00010000:00010000:0.0:1788574393.252773:0:18898:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788574393.252778:0:18898:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7000/0x5bf8706fdac8d82e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.252786:0:18898:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7000/0x5bf8706fdac8d82e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.253000:0:18898:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7600/0x5bf8706fdac8d827 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6cd4 expref: 39 pid: 18898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.253012:0:18898:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c84c34f0e00) 00010000:00010000:0.0:1788574393.253015:0:18898:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788574393.253019:0:18898:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7600/0x5bf8706fdac8d827 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6cd4 expref: 39 pid: 18898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.253030:0:18898:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d20d7600, rc 0) 00000100:00100000:0.0:1788574393.255763:0:18898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3ea4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74bce780-6a9f-42e0-9637-fe6b1665ce5b+38:15696:x1875455669052800:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 3618us (3872us total) trans 8589934619 rc 301/301 00000100:00100000:0.0:1788574393.255776:0:18898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 58 00000100:00100000:2.0:1788574393.266459:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574393.266565:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669052928 00000100:00100000:3.0:1788574393.266577:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669052928 00000100:00100000:3.0:1788574393.266674:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 59 00000100:00100000:3.0:1788574393.266685:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c300aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74bce780-6a9f-42e0-9637-fe6b1665ce5b+38:15696:x1875455669052928:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788574393.266727:0:17069:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788574393.266856:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c300aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74bce780-6a9f-42e0-9637-fe6b1665ce5b+38:15696:x1875455669052928:12345-192.168.204.51@tcp:53:lhsmtool_posix.0 Request processed in 172us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574393.266934:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 59 00000100:00100000:3.0:1788574393.272817:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574393.274259:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669053184 00000100:00100000:2.0:1788574393.274274:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669053184 00000100:00100000:2.0:1788574393.274396:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 60 00000100:00100000:2.0:1788574393.274407:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f6664700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74bce780-6a9f-42e0-9637-fe6b1665ce5b+38:15696:x1875455669053184:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788574393.274428:0:17068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788574393.274449:0:17068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e200/0x5bf8706fdac8d83c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6cdb expref: -99 pid: 17068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788574393.274804:0:17068:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x6:0x0], count =28 00000004:00080000:2.0:1788574393.274821:0:17068:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x6:0x0]+28 in llog 00000004:00080000:2.0:1788574393.274852:0:17068:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x22:0x0], index 1: 0 00010000:00010000:2.0:1788574393.275028:0:17068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217f200/0x5bf8706fdac8d843 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574393.275044:0:17068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217f200/0x5bf8706fdac8d843 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574393.275055:0:17068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217f200/0x5bf8706fdac8d843 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574393.275112:0:17068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e200/0x5bf8706fdac8d83c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6cdb expref: 41 pid: 17068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574393.275130:0:17068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217f200/0x5bf8706fdac8d843 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6cdb expref: 40 pid: 17068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574393.275139:0:17068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c85c4fa6900) 00010000:00010000:2.0:1788574393.275142:0:17068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788574393.275146:0:17068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c860217f200, rc 0) 00000100:00100000:2.0:1788574393.275268:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f6664700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74bce780-6a9f-42e0-9637-fe6b1665ce5b+40:15696:x1875455669053184:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 862us (2460us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1788574393.275277:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 60 00000100:00100000:1.0:1788574393.279670:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574393.279775:0:17067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669053440 00000100:00100000:0.0:1788574393.279787:0:17067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669053440 00000100:00100000:0.0:1788574393.279852:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 61 00000100:00100000:0.0:1788574393.279862:0:17067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3ea5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74bce780-6a9f-42e0-9637-fe6b1665ce5b+40:15696:x1875455669053440:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788574393.279922:0:17067:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788574393.279947:0:17067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217f200/0x5bf8706fdac8d843 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6cdb expref: 40 pid: 17068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.279987:0:17067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c85c4fa6900) 00010000:00010000:0.0:1788574393.279998:0:17067:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788574393.280021:0:17067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7600/0x5bf8706fdac8d851 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.280034:0:17067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7600/0x5bf8706fdac8d851 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.280044:0:17067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7600/0x5bf8706fdac8d851 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.280098:0:17067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7000/0x5bf8706fdac8d858 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xf204c91b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.280106:0:17067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7000/0x5bf8706fdac8d858 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf204c91b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.280113:0:17067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7000/0x5bf8706fdac8d858 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf204c91b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.280157:0:17067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7600/0x5bf8706fdac8d851 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.280164:0:17067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7600/0x5bf8706fdac8d851 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.280171:0:17067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7600/0x5bf8706fdac8d851 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.280177:0:17067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d7600 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:0.0:1788574393.280181:0:17067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7600/0x5bf8706fdac8d851 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.280625:0:17067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7600/0x5bf8706fdac8d851 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.280635:0:17067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c85c4fa6200) 00010000:00010000:0.0:1788574393.280638:0:17067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574393.280642:0:17067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7600/0x5bf8706fdac8d851 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.280647:0:17067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7600/0x5bf8706fdac8d851 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.280658:0:17067:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7000/0x5bf8706fdac8d858 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf204c91b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.280663:0:17067:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7000/0x5bf8706fdac8d858 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf204c91b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.280669:0:17067:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7000/0x5bf8706fdac8d858 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf204c91b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.280674:0:17067:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d7000 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:0.0:1788574393.280676:0:17067:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7000/0x5bf8706fdac8d858 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf204c91b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.280681:0:17067:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7000/0x5bf8706fdac8d858 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf204c91b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.280687:0:17067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xf204c91b (ffff9c85d10a6700) 00010000:00010000:0.0:1788574393.280688:0:17067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574393.280691:0:17067:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7000/0x5bf8706fdac8d858 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xf204c91b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.280704:0:17067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7000/0x5bf8706fdac8d858 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xf204c91b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574393.280792:0:17067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3ea5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74bce780-6a9f-42e0-9637-fe6b1665ce5b+39:15696:x1875455669053440:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 Request processed in 931us (1130us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788574393.280799:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 61 00000100:00100000:1.0:1788574393.283867:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574393.284224:0:18898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669053568 00000100:00100000:0.0:1788574393.284236:0:18898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669053568 00000100:00100000:0.0:1788574393.284337:0:18898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 62 00000100:00100000:0.0:1788574393.284361:0:18898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3ea5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74bce780-6a9f-42e0-9637-fe6b1665ce5b+39:15696:x1875455669053568:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788574393.284380:0:18898:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574393.284404:0:18898:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8d85f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6ce2 expref: -99 pid: 18898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.284439:0:18898:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8d866 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.284453:0:18898:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8d866 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.284464:0:18898:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8d866 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.284571:0:18898:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7200/0x5bf8706fdac8d85f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ce2 expref: 41 pid: 18898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.284591:0:18898:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6400/0x5bf8706fdac8d866 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ce2 expref: 40 pid: 18898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.284614:0:18898:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c85d10a6100) 00010000:00010000:0.0:1788574393.284617:0:18898:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788574393.284621:0:18898:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d20d6400, rc 0) 00000100:00100000:0.0:1788574393.284674:0:18898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3ea5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74bce780-6a9f-42e0-9637-fe6b1665ce5b+40:15696:x1875455669053568:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 328us (1085us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574393.284682:0:18898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 62 00000100:00100000:1.0:1788574393.287032:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574393.287594:0:17067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669053824 00000100:00100000:0.0:1788574393.287602:0:17067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669053824 00000100:00100000:0.0:1788574393.288016:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 63 00000100:00100000:0.0:1788574393.288027:0:17067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3ea4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74bce780-6a9f-42e0-9637-fe6b1665ce5b+40:15696:x1875455669053824:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788574393.288113:0:17067:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8d86d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.288131:0:17067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8d86d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.288144:0:17067:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8d86d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788574393.288773:0:17067:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:0.0:1788574393.288782:0:17067:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 533268591676ns, next at 534268589455ns, rc = 0 00000004:00010000:0.0:1788574393.288826:0:17067:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000607abd6f reply state 0000000051f12685 transno 8589934621 ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8d86d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.288838:0:17067:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8d86d lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.288847:0:17067:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c85d10a6100) 00010000:00010000:0.0:1788574393.288861:0:17067:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788574393.288865:0:17067:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788574393.291387:0:17067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3ea4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:74bce780-6a9f-42e0-9637-fe6b1665ce5b+42:15696:x1875455669053824:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 Request processed in 3348us (4350us total) trans 8589934621 rc 0/0 00000100:00100000:1.0:1788574393.291402:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 63 00000100:00100000:1.0:1788574393.296550:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574393.296636:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669053952 00000100:00100000:3.0:1788574393.296646:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669053952 00000100:00100000:3.0:1788574393.296701:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 64 00000100:00100000:3.0:1788574393.296710:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74bce780-6a9f-42e0-9637-fe6b1665ce5b+42:15696:x1875455669053952:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788574393.296730:0:17068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574393.296749:0:17068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3400/0x5bf8706fdac8d874 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6ce9 expref: -99 pid: 17068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574393.296809:0:17068:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3400/0x5bf8706fdac8d874 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ce9 expref: 43 pid: 17068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574393.296824:0:17068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3400/0x5bf8706fdac8d874 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ce9 expref: 43 pid: 17068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574393.296850:0:17068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c85d10a6100) 00010000:00010000:3.0:1788574393.296853:0:17068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788574393.296857:0:17068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85faea3400, rc 0) 00000100:00100000:3.0:1788574393.297112:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74bce780-6a9f-42e0-9637-fe6b1665ce5b+43:15696:x1875455669053952:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 401us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574393.297120:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 64 00000100:00100000:2.0:1788574393.299694:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574393.299753:0:18573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669054080 00000100:00100000:1.0:1788574393.299763:0:18573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669054080 00000100:00100000:1.0:1788574393.299841:0:18573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 22 00000100:00100000:1.0:1788574393.299852:0:18573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c3008000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:74bce780-6a9f-42e0-9637-fe6b1665ce5b+5:2393:x1875455669054080:12345-192.168.204.51@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1788574393.300003:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788574393.300100:0:18573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c3008000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:74bce780-6a9f-42e0-9637-fe6b1665ce5b+6:2393:x1875455669054080:12345-192.168.204.51@tcp:2:lhsmtool_posix.0 Request processed in 250us (413us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1788574393.300108:0:18573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 22 00000100:00100000:1.0:1788574393.303568:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574393.303707:0:17071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669054336 00000100:00100000:0.0:1788574393.303721:0:17071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669054336 00000100:00100000:0.0:1788574393.303786:0:17071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 11 00000100:00100000:0.0:1788574393.303796:0:17071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74bce780-6a9f-42e0-9637-fe6b1665ce5b+43:15696:x1875455669054336:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788574393.304015:0:17071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74bce780-6a9f-42e0-9637-fe6b1665ce5b+44:15696:x1875455669054336:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 Request processed in 220us (456us total) trans 8589934622 rc 0/0 00000100:00100000:0.0:1788574393.304023:0:17071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 11 00000100:00100000:2.0:1788574393.308847:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574393.308938:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669054592 00000100:00100000:3.0:1788574393.308948:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669054592 00000100:00100000:3.0:1788574393.309009:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 65 00000100:00100000:3.0:1788574393.309019:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c26b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74bce780-6a9f-42e0-9637-fe6b1665ce5b+44:15696:x1875455669054592:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788574393.309157:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c26b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74bce780-6a9f-42e0-9637-fe6b1665ce5b+44:15696:x1875455669054592:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 Request processed in 140us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574393.309165:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 65 00000100:00100000:1.0:1788574393.311814:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574393.313644:0:18898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669054720 00000100:00100000:0.0:1788574393.313659:0:18898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669054720 00000100:00100000:1.0:1788574393.313826:0:18898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 66 00000100:00100000:1.0:1788574393.313838:0:18898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74bce780-6a9f-42e0-9637-fe6b1665ce5b+44:15696:x1875455669054720:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788574393.313858:0:18898:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574393.313879:0:18898:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2200/0x5bf8706fdac8d87b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6cf0 expref: -99 pid: 18898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574393.313948:0:18898:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2000/0x5bf8706fdac8d882 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574393.313963:0:18898:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2000/0x5bf8706fdac8d882 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574393.313975:0:18898:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2000/0x5bf8706fdac8d882 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788574393.314035:0:18898:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788574393.314055:0:18898:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2000/0x5bf8706fdac8d882 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574393.314083:0:18898:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2200/0x5bf8706fdac8d87b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6cf0 expref: 46 pid: 18898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574393.314102:0:18898:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2000/0x5bf8706fdac8d882 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6cf0 expref: 45 pid: 18898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574393.314110:0:18898:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c85d10a6100) 00010000:00010000:1.0:1788574393.314112:0:18898:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788574393.314116:0:18898:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d08a2000, rc 0) 00000100:00100000:1.0:1788574393.314228:0:18898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74bce780-6a9f-42e0-9637-fe6b1665ce5b+45:15696:x1875455669054720:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 393us (2424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574393.314237:0:18898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 66 00000100:00100000:0.0:1788574393.317765:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574393.317852:0:19093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669054848 00000100:00100000:1.0:1788574393.317862:0:19093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669054848 00000100:00100000:1.0:1788574393.317995:0:19093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 23 00000100:00100000:1.0:1788574393.318006:0:19093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f6670000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:74bce780-6a9f-42e0-9637-fe6b1665ce5b+6:2393:x1875455669054848:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788574393.318023:0:19093:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574393.318046:0:19093:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000042acfec9/0x5bf8706fdac8d889 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6cf7 expref: -99 pid: 19093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788574393.318075:0:19093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9b7ab8, blocks: 0x0 00010000:00010000:1.0:1788574393.318097:0:19093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=533s v=(0 0) 00010000:00010000:1.0:1788574393.318116:0:19093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574393.318126:0:19093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000042acfec9/0x5bf8706fdac8d889 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6cf7 expref: 7 pid: 19093 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574393.318148:0:19093:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000042acfec9/0x5bf8706fdac8d889 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6cf7 expref: 7 pid: 19093 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574393.318162:0:19093:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d08a2400, rc 0) 00000100:00100000:1.0:1788574393.318358:0:19093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f6670000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:74bce780-6a9f-42e0-9637-fe6b1665ce5b+7:2393:x1875455669054848:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 353us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574393.318365:0:19093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 23 00000100:00100000:2.0:1788574393.321109:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574393.321276:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669055104 00000100:00100000:3.0:1788574393.321286:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669055104 00000100:00100000:2.0:1788574393.321474:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 67 00000100:00100000:2.0:1788574393.321807:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c26b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74bce780-6a9f-42e0-9637-fe6b1665ce5b+45:15696:x1875455669055104:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788574393.322062:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c26b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74bce780-6a9f-42e0-9637-fe6b1665ce5b+45:15696:x1875455669055104:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 Request processed in 579us (961us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574393.322071:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 67 00000100:00100000:2.0:1788574393.325333:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574393.325478:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669055232 00000100:00100000:3.0:1788574393.325489:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669055232 00000100:00100000:3.0:1788574393.325550:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 68 00000100:00100000:3.0:1788574393.325561:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c26bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74bce780-6a9f-42e0-9637-fe6b1665ce5b+45:15696:x1875455669055232:12345-192.168.204.51@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788574393.327716:0:17047:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000004:00080000:2.0:1788574393.327738:0:17047:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:2.0:1788574393.327801:0:17047:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00010000:00010000:3.0:1788574393.327890:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152fe00/0x5bf8706fdac8d64b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574393.327913:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152fe00/0x5bf8706fdac8d64b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574393.327929:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152fe00/0x5bf8706fdac8d64b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574393.327936:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85c152fe00 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:3.0:1788574393.327941:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152fe00/0x5bf8706fdac8d64b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574393.327949:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152fe00/0x5bf8706fdac8d64b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574393.327963:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9c85d10a6800) 00010000:00010000:3.0:1788574393.327966:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574393.327970:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152fe00/0x5bf8706fdac8d64b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574393.327991:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152fe00/0x5bf8706fdac8d64b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574393.328023:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217fa00/0x5bf8706fdac8d652 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574393.328031:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217fa00/0x5bf8706fdac8d652 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574393.328044:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217fa00/0x5bf8706fdac8d652 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574393.328049:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c860217fa00 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:3.0:1788574393.328052:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217fa00/0x5bf8706fdac8d652 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574393.328059:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217fa00/0x5bf8706fdac8d652 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574393.328067:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c85c4fa6200) 00010000:00010000:3.0:1788574393.328070:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574393.328072:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217fa00/0x5bf8706fdac8d652 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574393.328078:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217fa00/0x5bf8706fdac8d652 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574393.328092:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f200/0x5bf8706fdac8d6fa lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574393.328098:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f200/0x5bf8706fdac8d6fa lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574393.328109:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f200/0x5bf8706fdac8d6fa lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574393.328114:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85c152f200 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:3.0:1788574393.328117:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f200/0x5bf8706fdac8d6fa lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574393.328122:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f200/0x5bf8706fdac8d6fa lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574393.328130:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9c85d10a6200) 00010000:00010000:3.0:1788574393.328132:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574393.328134:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f200/0x5bf8706fdac8d6fa lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574393.328140:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85c152f200/0x5bf8706fdac8d6fa lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574393.328154:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6000/0x5bf8706fdac8d77f lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574393.328161:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6000/0x5bf8706fdac8d77f lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574393.328167:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6000/0x5bf8706fdac8d77f lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574393.328172:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d6000 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:3.0:1788574393.328175:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6000/0x5bf8706fdac8d77f lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574393.328229:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6000/0x5bf8706fdac8d77f lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574393.328238:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c85d10a6300) 00010000:00010000:3.0:1788574393.328241:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574393.328244:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6000/0x5bf8706fdac8d77f lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574393.328250:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6000/0x5bf8706fdac8d77f lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574393.328264:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7a00/0x5bf8706fdac8d7a2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574393.328271:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7a00/0x5bf8706fdac8d7a2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574393.328277:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7a00/0x5bf8706fdac8d7a2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574393.328282:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d7a00 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:3.0:1788574393.328285:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7a00/0x5bf8706fdac8d7a2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574393.328291:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7a00/0x5bf8706fdac8d7a2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574393.328298:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c85d10a6300) 00010000:00010000:3.0:1788574393.328300:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574393.328302:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7a00/0x5bf8706fdac8d7a2 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574393.328317:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7a00/0x5bf8706fdac8d7a2 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574393.328328:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6200/0x5bf8706fdac8d7e8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574393.328334:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6200/0x5bf8706fdac8d7e8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574393.328339:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6200/0x5bf8706fdac8d7e8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574393.328355:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d6200 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:3.0:1788574393.328358:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6200/0x5bf8706fdac8d7e8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574393.328364:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6200/0x5bf8706fdac8d7e8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574393.328373:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c85d10a6300) 00010000:00010000:3.0:1788574393.328375:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788574393.328377:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6200/0x5bf8706fdac8d7e8 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574393.328795:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6671c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681717760:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788574393.328864:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788574393.328938:0:3603:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8d69f lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574393.328947:0:3603:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8d69f lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574393.328952:0:3603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8d69f lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574393.328958:0:3603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85faea2600 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:1.0:1788574393.328962:0:3603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8d69f lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574393.328968:0:3603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8d69f lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574393.328979:0:3603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c85c4fa6200) 00010000:00010000:1.0:1788574393.328981:0:3603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1788574393.328993:0:3603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8d69f lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574393.328999:0:3603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2600/0x5bf8706fdac8d69f lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574393.329111:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c26bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74bce780-6a9f-42e0-9637-fe6b1665ce5b+16:15696:x1875455669055232:12345-192.168.204.51@tcp:44:lhsmtool_posix.0 Request processed in 3548us (3783us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574393.329122:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 68 00010000:00010000:3.0:1788574393.329920:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6200/0x5bf8706fdac8d7e8 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574393.329940:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8d86d lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574393.329948:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8d86d lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574393.329963:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8d86d lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574393.329968:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d6600 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:3.0:1788574393.329971:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8d86d lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574393.329978:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8d86d lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574393.329990:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c85d10a6100) 00010000:00010000:3.0:1788574393.329992:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788574393.329996:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8d86d lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574393.330002:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6600/0x5bf8706fdac8d86d lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17067 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574393.330028:0:18571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681717760 00000100:00100000:3.0:1788574393.330036:0:18571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681717760 00000100:00080000:2.0:1788574393.330518:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788574393.331688:0:18571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788574393.331707:0:18571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f6671180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1875455681717760:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1788574393.331862:0:18571:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788574393.331866:0:18571:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1788574393.331868:0:18571:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788574393.331870:0:18571:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1788574392 -> 1788574392 00002000:00010000:2.0:1788574393.331872:0:18571:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1788574393.331947:0:18571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f6671180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3619:x1875455681717760:12345-0@lo:2:osp-syn-1-0.0 Request processed in 248us (3083us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1788574393.331954:0:18571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000004:00080000:0.0:1788574393.332012:0:3619:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c85f6671c00/2, rc 0, transno 8589934596 00000100:00100000:0.0:1788574393.332019:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6671c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3619:1875455681717760:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788574393.333118:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574393.333160:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669055360 00000100:00100000:3.0:1788574393.333169:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669055360 00000100:00100000:3.0:1788574393.333239:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 25 00000100:00100000:3.0:1788574393.333249:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f6670700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:74bce780-6a9f-42e0-9637-fe6b1665ce5b+7:2394:x1875455669055360:12345-192.168.204.51@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788574393.333358:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f6670700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:74bce780-6a9f-42e0-9637-fe6b1665ce5b+7:2394:x1875455669055360:12345-192.168.204.51@tcp:16:lhsmtool_posix.0 Request processed in 98us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574393.333366:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 25 00000100:00100000:1.0:1788574393.339455:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574393.339655:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669055616 00000100:00100000:2.0:1788574393.339667:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669055616 00000100:00100000:2.0:1788574393.339743:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 69 00000100:00100000:2.0:1788574393.339753:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74bce780-6a9f-42e0-9637-fe6b1665ce5b+14:15696:x1875455669055616:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788574393.339814:0:17069:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788574393.339980:0:17069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d08a2000/0x5bf8706fdac8d882 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6cf0 expref: 14 pid: 18898 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574393.340001:0:17069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c85d10a6100) 00010000:00010000:2.0:1788574393.340006:0:17069:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788574393.340039:0:17069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217ea00/0x5bf8706fdac8d890 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574393.340052:0:17069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217ea00/0x5bf8706fdac8d890 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574393.340061:0:17069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217ea00/0x5bf8706fdac8d890 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788574393.340522:0:17069:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002260b5e4 reply state 000000001bd345ae transno 8589934623 ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217ea00/0x5bf8706fdac8d890 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574393.340538:0:17069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217ea00/0x5bf8706fdac8d890 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574393.340545:0:17069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c85d10a6100) 00010000:00010000:2.0:1788574393.340548:0:17069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788574393.340551:0:17069:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788574393.340728:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74bce780-6a9f-42e0-9637-fe6b1665ce5b+15:15696:x1875455669055616:12345-192.168.204.51@tcp:36:lhsmtool_posix.0 Request processed in 975us (1290us total) trans 8589934623 rc 0/0 00000100:00100000:2.0:1788574393.340737:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 69 00000100:00100000:2.0:1788574393.348634:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574393.348761:0:18573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669055744 00000100:00100000:1.0:1788574393.348772:0:18573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669055744 00000100:00100000:1.0:1788574393.348919:0:18573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 26 00000100:00100000:1.0:1788574393.348931:0:18573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c26ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:74bce780-6a9f-42e0-9637-fe6b1665ce5b+7:15696:x1875455669055744:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788574393.348951:0:18573:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788574393.348969:0:18573:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005cd8c345/0x5bf8706fdac8d897 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6cfe expref: -99 pid: 18573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574393.349003:0:18573:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000042acfec9/0x5bf8706fdac8d889 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6cf7 expref: 8 pid: 19093 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574393.349012:0:18573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574393.349017:0:18573:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574393.349023:0:18573:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005cd8c345/0x5bf8706fdac8d897 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6cfe expref: 8 pid: 18573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574393.349062:0:18573:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000042acfec9/0x5bf8706fdac8d889 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6cf7 expref: 8 pid: 19093 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574393.349078:0:18573:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000042acfec9/0x5bf8706fdac8d889 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6cf7 expref: 8 pid: 19093 timeout: 633 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574393.349112:0:18573:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:18573:1875455681717888:192.168.204.51@tcp:104: 00000100:00100000:1.0:1788574393.349226:0:18573:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8600213300 going to sleep for 11 seconds 00000100:00100000:1.0:1788574393.352627:0:18573:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:18573:1875455681717888:192.168.204.51@tcp:104: 00010000:00010000:1.0:1788574393.352665:0:18573:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005cd8c345/0x5bf8706fdac8d897 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6cfe expref: 8 pid: 18573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574393.352686:0:18573:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d08a3000, rc 0) 00000100:00100000:1.0:1788574393.352801:0:18573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c26ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:74bce780-6a9f-42e0-9637-fe6b1665ce5b+8:15696:x1875455669055744:12345-192.168.204.51@tcp:101:lhsmtool_posix.0 Request processed in 3820us (4127us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574393.352811:0:18573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 26 00000100:00100000:1.0:1788574393.357740:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574393.358107:0:17054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669055872 00000100:00100000:3.0:1788574393.358119:0:17054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669055872 00010000:00010000:3.0:1788574393.358177:0:17054:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000042acfec9/0x5bf8706fdac8d889 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6cf7 expref: 8 pid: 19093 timeout: 633 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574393.358321:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 20 00000100:00100000:1.0:1788574393.358335:0:17053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:74bce780-6a9f-42e0-9637-fe6b1665ce5b+8:2394:x1875455669055872:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788574393.358373:0:17053:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574393.358559:0:17053:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000042acfec9/0x5bf8706fdac8d889 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6cf7 expref: 8 pid: 19093 timeout: 633 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574393.358573:0:17053:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000042acfec9/0x5bf8706fdac8d889 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6cf7 expref: 8 pid: 19093 timeout: 633 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574393.358597:0:17053:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000042acfec9/0x5bf8706fdac8d889 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6cf7 expref: 8 pid: 19093 timeout: 633 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574393.358627:0:17053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574393.358631:0:17053:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788574393.358639:0:17053:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005cd8c345/0x5bf8706fdac8d897 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6cfe expref: 7 pid: 18573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574393.358651:0:17053:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005cd8c345/0x5bf8706fdac8d897 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6cfe expref: 7 pid: 18573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574393.358690:0:17053:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005cd8c345/0x5bf8706fdac8d897 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6cfe expref: 7 pid: 18573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574393.358704:0:17053:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c1be3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:17053:1875455681718016:192.168.204.51@tcp:105: 00000100:00100000:1.0:1788574393.358833:0:17053:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8600213300 going to sleep for 11 seconds 00000100:00100000:1.0:1788574393.365853:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574393.366545:0:19093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669056000 00000100:00100000:0.0:1788574393.366556:0:19093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669056000 00000100:00100000:0.0:1788574393.366652:0:19093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 27 00000100:00100000:0.0:1788574393.366663:0:19093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:74bce780-6a9f-42e0-9637-fe6b1665ce5b+8:2393:x1875455669056000:12345-192.168.204.51@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788574393.366819:0:19093:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788574393.366823:0:19093:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1788574392 00002000:00010000:0.0:1788574393.366836:0:19093:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 1788574389 00002000:00010000:0.0:1788574393.366839:0:19093:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1788574392 -> 1788574392 00002000:00010000:0.0:1788574393.366841:0:19093:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1788574393.366916:0:19093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:74bce780-6a9f-42e0-9637-fe6b1665ce5b+9:2393:x1875455669056000:12345-192.168.204.51@tcp:2:lhsmtool_posix.0 Request processed in 256us (1075us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1788574393.366938:0:19093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 27 00000100:00100000:3.0:1788574393.367103:0:17053:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c1be3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:17053:1875455681718016:192.168.204.51@tcp:105: 00010000:00010000:3.0:1788574393.368227:0:17053:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788574393.368284:0:17053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:74bce780-6a9f-42e0-9637-fe6b1665ce5b+8:2394:x1875455669055872:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 9951us (10551us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574393.368294:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 20 00000100:00100000:1.0:1788574393.371018:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574393.371151:0:18571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669056128 00000100:00100000:2.0:1788574393.371162:0:18571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669056128 00000100:00100000:2.0:1788574393.371370:0:18571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 28 00000100:00100000:2.0:1788574393.371509:0:18571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:74bce780-6a9f-42e0-9637-fe6b1665ce5b+8:2394:x1875455669056128:12345-192.168.204.51@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788574393.371617:0:18571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000049cab748/0x5bf8706fdac8d89e lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574393.371640:0:18571:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005cd8c345/0x5bf8706fdac8d897 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6cfe expref: 8 pid: 18573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574393.371649:0:18571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788574393.371653:0:18571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788574393.371659:0:18571:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049cab748/0x5bf8706fdac8d89e lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574393.371697:0:18571:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005cd8c345/0x5bf8706fdac8d897 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6cfe expref: 8 pid: 18573 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574393.371713:0:18571:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005cd8c345/0x5bf8706fdac8d897 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6cfe expref: 8 pid: 18573 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574393.371727:0:18571:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c26ba300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:18571:1875455681718144:192.168.204.51@tcp:104: 00000100:00100000:2.0:1788574393.371819:0:18571:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c4f563c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788574393.375068:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574393.375224:0:17052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669056256 00000100:00100000:1.0:1788574393.375244:0:17052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669056256 00010000:00010000:1.0:1788574393.375287:0:17052:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005cd8c345/0x5bf8706fdac8d897 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6cfe expref: 9 pid: 18573 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574393.375335:0:17052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 21 00000100:00100000:1.0:1788574393.375365:0:17052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c26bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74bce780-6a9f-42e0-9637-fe6b1665ce5b+9:2394:x1875455669056256:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788574393.375580:0:17052:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788574393.375604:0:17052:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005cd8c345/0x5bf8706fdac8d897 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6cfe expref: 9 pid: 18573 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574393.375637:0:17052:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005cd8c345/0x5bf8706fdac8d897 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6cfe expref: 9 pid: 18573 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574393.375665:0:17052:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788574393.375669:0:17052:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788574393.375675:0:17052:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000049cab748/0x5bf8706fdac8d89e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574393.375685:0:17052:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000049cab748/0x5bf8706fdac8d89e lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788574393.375706:0:17052:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788574393.375767:0:17052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c26bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74bce780-6a9f-42e0-9637-fe6b1665ce5b+9:2394:x1875455669056256:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 423us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574393.375775:0:17052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 21 00010000:00010000:3.0:1788574393.376793:0:18571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005cd8c345/0x5bf8706fdac8d897 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6cfe expref: 8 pid: 18573 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574393.376814:0:18571:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c26ba300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:18571:1875455681718144:192.168.204.51@tcp:104: 00010000:00010000:3.0:1788574393.377002:0:18571:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000049cab748/0x5bf8706fdac8d89e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574393.377136:0:18571:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000049cab748/0x5bf8706fdac8d89e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574393.377145:0:18571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000049cab748/0x5bf8706fdac8d89e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574393.377217:0:18571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000049cab748/0x5bf8706fdac8d89e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574393.377283:0:18571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000049cab748/0x5bf8706fdac8d89e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574393.377294:0:18571:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000049cab748/0x5bf8706fdac8d89e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574393.377301:0:18571:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c860217e400 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:2.0:1788574393.377306:0:18571:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000049cab748/0x5bf8706fdac8d89e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574393.377315:0:18571:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000049cab748/0x5bf8706fdac8d89e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574393.377332:0:18571:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000049cab748/0x5bf8706fdac8d89e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574393.377339:0:18571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000049cab748/0x5bf8706fdac8d89e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574393.377506:0:18571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:74bce780-6a9f-42e0-9637-fe6b1665ce5b+7:2394:x1875455669056128:12345-192.168.204.51@tcp:1:lhsmtool_posix.0 Request processed in 6126us (6498us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574393.377526:0:18571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 28 00000100:00100000:2.0:1788574393.381220:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574393.381475:0:18898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669056512 00000100:00100000:0.0:1788574393.381486:0:18898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669056512 00000100:00100000:0.0:1788574393.381547:0:18898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 70 00000100:00100000:0.0:1788574393.381558:0:18898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c26b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74bce780-6a9f-42e0-9637-fe6b1665ce5b+15:15696:x1875455669056512:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788574393.382119:0:18898:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7600/0x5bf8706fdac8d8a5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.382141:0:18898:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6c00/0x5bf8706fdac8d778 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6c9c expref: 15 pid: 17068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.382152:0:18898:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7600/0x5bf8706fdac8d8a5 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.382219:0:18898:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6c00/0x5bf8706fdac8d778 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6c9c expref: 15 pid: 17068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.382244:0:18898:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6c00/0x5bf8706fdac8d778 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6c9c expref: 15 pid: 17068 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574393.382260:0:18898:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6673480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18898:1875455681718272:192.168.204.51@tcp:104: 00000100:00100000:0.0:1788574393.382356:0:18898:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c5a41240 going to sleep for 11 seconds 00000100:00100000:1.0:1788574393.388965:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574393.389053:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669056640 00000100:00100000:3.0:1788574393.389063:0:17053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669056640 00010000:00010000:3.0:1788574393.389105:0:17053:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6c00/0x5bf8706fdac8d778 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6c9c expref: 16 pid: 17068 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574393.389362:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 22 00000100:00100000:3.0:1788574393.389374:0:17053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:74bce780-6a9f-42e0-9637-fe6b1665ce5b+16:2393:x1875455669056640:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788574393.389397:0:17053:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574393.389405:0:17053:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6c00/0x5bf8706fdac8d778 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6c9c expref: 16 pid: 17068 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574393.389462:0:17053:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6c00/0x5bf8706fdac8d778 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6c9c expref: 16 pid: 17068 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574393.389487:0:17053:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c85d10a6300) 00010000:00010000:3.0:1788574393.389494:0:17053:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6a00/0x5bf8706fdac8d80b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ccd expref: 16 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574393.389515:0:17053:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7600/0x5bf8706fdac8d8a5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574393.389523:0:17053:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7600/0x5bf8706fdac8d8a5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574393.389531:0:17053:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7600/0x5bf8706fdac8d8a5 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574393.389558:0:17053:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788574393.389573:0:18898:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6c00/0x5bf8706fdac8d778 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6c9c expref: 16 pid: 17068 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574393.389591:0:18898:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6673480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18898:1875455681718272:192.168.204.51@tcp:104: 00000100:00100000:3.0:1788574393.389617:0:17053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:74bce780-6a9f-42e0-9637-fe6b1665ce5b+15:2393:x1875455669056640:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 247us (666us total) trans 0 rc 0/0 00010000:00010000:0.0:1788574393.389621:0:18898:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7600/0x5bf8706fdac8d8a5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574393.389624:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 22 00010000:00010000:0.0:1788574393.389630:0:18898:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7600/0x5bf8706fdac8d8a5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.389636:0:18898:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7600/0x5bf8706fdac8d8a5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.389848:0:18898:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6200/0x5bf8706fdac8d8ac lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.389861:0:18898:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3400/0x5bf8706fdac8d874 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ce9 expref: 15 pid: 17068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.389870:0:18898:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6200/0x5bf8706fdac8d8ac lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.389904:0:18898:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3400/0x5bf8706fdac8d874 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ce9 expref: 15 pid: 17068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.389917:0:18898:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3400/0x5bf8706fdac8d874 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ce9 expref: 15 pid: 17068 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574393.389931:0:18898:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6673480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18898:1875455681718400:192.168.204.51@tcp:104: 00000100:00100000:0.0:1788574393.390012:0:18898:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c5a416c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788574393.395605:0:18898:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6673480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18898:1875455681718400:192.168.204.51@tcp:104: 00010000:00010000:0.0:1788574393.395638:0:18898:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6200/0x5bf8706fdac8d8ac lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574393.397070:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574393.397598:0:17052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669056768 00000100:00100000:3.0:1788574393.397609:0:17052:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669056768 00010000:00010000:3.0:1788574393.397650:0:17052:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3400/0x5bf8706fdac8d874 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ce9 expref: 16 pid: 17068 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788574393.397693:0:17052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 23 00000100:00100000:3.0:1788574393.397703:0:17052:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa36d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74bce780-6a9f-42e0-9637-fe6b1665ce5b+16:2393:x1875455669056768:12345-192.168.204.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788574393.397733:0:17052:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788574393.397740:0:17052:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3400/0x5bf8706fdac8d874 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ce9 expref: 16 pid: 17068 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574393.397753:0:17052:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3400/0x5bf8706fdac8d874 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ce9 expref: 16 pid: 17068 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574393.397775:0:17052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea3400/0x5bf8706fdac8d874 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ce9 expref: 16 pid: 17068 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574393.397794:0:17052:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c85d10a6100) 00010000:00010000:3.0:1788574393.397799:0:17052:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6200/0x5bf8706fdac8d8ac lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574393.397810:0:17052:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6200/0x5bf8706fdac8d8ac lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574393.397817:0:17052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6200/0x5bf8706fdac8d8ac lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574393.397844:0:17052:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788574393.397910:0:17052:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa36d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:74bce780-6a9f-42e0-9637-fe6b1665ce5b+15:2393:x1875455669056768:12345-192.168.204.51@tcp:103:ldlm_bl.0 Request processed in 208us (847us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574393.397918:0:17052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 23 00010000:00010000:0.0:1788574393.398540:0:18898:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6200/0x5bf8706fdac8d8ac lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.398551:0:18898:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6200/0x5bf8706fdac8d8ac lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788574393.398662:0:18898:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:0.0:1788574393.398781:0:18898:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000001:00080000:0.0:1788574393.398815:0:18898:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934626 00000100:00100000:0.0:1788574393.399004:0:18898:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6673480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:18898:1875455681718528:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788574393.399146:0:18898:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574393.399185:0:18898:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c8600274b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788574393.399510:0:17072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681718528 00000100:00100000:1.0:1788574393.399517:0:17072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681718528 00000100:00100000:1.0:1788574393.399565:0:17072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788574393.399573:0:17072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f6672a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:18898:x1875455681718528:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788574393.399661:0:17072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f6672a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:18898:x1875455681718528:12345-0@lo:1000:mdt00_003.0 Request processed in 88us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574393.399668:0:17072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788574393.399880:0:18898:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6673480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:18898:1875455681718528:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1788574393.400843:0:18898:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000100:00100000:0.0:1788574393.401236:0:18898:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6673480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:18898:1875455681718656:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788574393.401303:0:18898:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574393.401335:0:18898:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c5a419c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788574393.401542:0:17807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681718656 00000100:00100000:2.0:1788574393.401550:0:17807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681718656 00000100:00100000:2.0:1788574393.401600:0:17807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788574393.401608:0:17807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601834000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:18898:x1875455681718656:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788574393.401751:0:17807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601834000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:18898:x1875455681718656:12345-0@lo:1000:mdt00_003.0 Request processed in 143us (456us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1788574393.401759:0:17807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788574393.402181:0:18898:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6673480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:18898:1875455681718656:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1788574393.402270:0:18898:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6200/0x5bf8706fdac8d8ac lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.402281:0:18898:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6200/0x5bf8706fdac8d8ac lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.402288:0:18898:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6200/0x5bf8706fdac8d8ac lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.402305:0:18898:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d6200 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:0.0:1788574393.402323:0:18898:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6200/0x5bf8706fdac8d8ac lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.402332:0:18898:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6200/0x5bf8706fdac8d8ac lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.402359:0:18898:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c85d10a6100) 00010000:00010000:0.0:1788574393.402362:0:18898:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788574393.402367:0:18898:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6200/0x5bf8706fdac8d8ac lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.402373:0:18898:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6200/0x5bf8706fdac8d8ac lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.402602:0:18898:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e800/0x5bf8706fdac8d804 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.402609:0:18898:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e800/0x5bf8706fdac8d804 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.402615:0:18898:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e800/0x5bf8706fdac8d804 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.402620:0:18898:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c860217e800 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:0.0:1788574393.402623:0:18898:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e800/0x5bf8706fdac8d804 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.402629:0:18898:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e800/0x5bf8706fdac8d804 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.402638:0:18898:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c85d10a6300) 00010000:00010000:0.0:1788574393.402641:0:18898:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788574393.402653:0:18898:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6a00/0x5bf8706fdac8d80b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ccd expref: 18 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.402665:0:18898:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6a00/0x5bf8706fdac8d80b lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ccd expref: 18 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.402675:0:18898:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6a00/0x5bf8706fdac8d80b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ccd expref: 18 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.402738:0:18898:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6a00/0x5bf8706fdac8d80b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6ccd expref: 18 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788574393.402751:0:18898:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c8601834380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18898:1875455681718784:192.168.204.51@tcp:105: 00000100:00100000:0.0:1788574393.402944:0:18898:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c85c5a419c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788574393.408928:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574393.409275:0:18898:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c8601834380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18898:1875455681718784:192.168.204.51@tcp:105: 00010000:00010000:0.0:1788574393.409318:0:18898:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e800/0x5bf8706fdac8d804 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.409329:0:18898:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e800/0x5bf8706fdac8d804 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 17068 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.409374:0:18898:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6c00/0x5bf8706fdac8d8b3 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574393.409699:0:17071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669056896 00000100:00100000:2.0:1788574393.409707:0:17071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669056896 00000100:00100000:2.0:1788574393.409766:0:17071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 12 00000100:00100000:2.0:1788574393.409776:0:17071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74bce780-6a9f-42e0-9637-fe6b1665ce5b+19:15695:x1875455669056896:12345-192.168.204.51@tcp:49:bash.0 00010000:00010000:0.0:1788574393.410115:0:18898:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6c00/0x5bf8706fdac8d8b3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.410127:0:18898:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6c00/0x5bf8706fdac8d8b3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.410152:0:18898:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6c00/0x5bf8706fdac8d8b3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.410159:0:18898:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6c00/0x5bf8706fdac8d8b3 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.410166:0:18898:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6c00/0x5bf8706fdac8d8b3 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.410172:0:18898:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d6c00 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:0.0:1788574393.410176:0:18898:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6c00/0x5bf8706fdac8d8b3 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.410183:0:18898:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6c00/0x5bf8706fdac8d8b3 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574393.410588:0:17071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74bce780-6a9f-42e0-9637-fe6b1665ce5b+19:15695:x1875455669056896:12345-192.168.204.51@tcp:49:bash.0 Request processed in 811us (1672us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574393.410597:0:17071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 12 00010000:00010000:0.0:1788574393.410791:0:18898:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c85d10a6300) 00010000:00010000:0.0:1788574393.410795:0:18898:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788574393.410800:0:18898:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6c00/0x5bf8706fdac8d8b3 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.410806:0:18898:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6c00/0x5bf8706fdac8d8b3 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.410820:0:18898:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7600/0x5bf8706fdac8d8a5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.411719:0:18898:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7600/0x5bf8706fdac8d8a5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.411734:0:18898:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7600/0x5bf8706fdac8d8a5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.411754:0:18898:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c85d20d7600 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:0.0:1788574393.411758:0:18898:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7600/0x5bf8706fdac8d8a5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.411765:0:18898:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7600/0x5bf8706fdac8d8a5 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.411777:0:18898:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c85d10a6300) 00010000:00010000:0.0:1788574393.411779:0:18898:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788574393.411783:0:18898:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7600/0x5bf8706fdac8d8a5 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.411789:0:18898:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7600/0x5bf8706fdac8d8a5 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18898 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788574393.412120:0:18898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c26b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74bce780-6a9f-42e0-9637-fe6b1665ce5b+18:15696:x1875455669056512:12345-192.168.204.51@tcp:57:lhsmtool_posix.0 Request processed in 30560us (30934us total) trans 8589934628 rc 0/0 00000100:00100000:1.0:1788574393.412130:0:18898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 70 00000020:00080000:1.0:1788574393.412136:0:18898:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788574393.412493:0:17104:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788574393.412499:0:17104:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788574393.412514:0:17104:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788574393.412520:0:17104:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788574393.416264:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574393.416320:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574393.416427:0:18574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669057024 00000100:00100000:3.0:1788574393.416459:0:18574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669057024 00000100:00100000:3.0:1788574393.416529:0:18574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 29 00000100:00100000:3.0:1788574393.416541:0:18574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c1be3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:74bce780-6a9f-42e0-9637-fe6b1665ce5b+7:15695:x1875455669057024:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:3.0:1788574393.416562:0:18574:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574393.416588:0:18574:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074960dfc/0x5bf8706fdac8d8ba lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6d05 expref: -99 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788574393.416619:0:18574:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x6a9b7ab8, atime: 0x6a9b7ab5, ctime: 0x6a9b7ab8, blocks: 0x0 00010000:00010000:3.0:1788574393.416643:0:18574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=533s v=(0 0) 00010000:00010000:3.0:1788574393.416647:0:18574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788574393.416658:0:18574:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074960dfc/0x5bf8706fdac8d8ba lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6d05 expref: 8 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574393.416676:0:18574:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000074960dfc/0x5bf8706fdac8d8ba lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6d05 expref: 8 pid: 18574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574393.416690:0:18574:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85faea3400, rc 0) 00000100:00100000:3.0:1788574393.416747:0:18574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c1be3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:74bce780-6a9f-42e0-9637-fe6b1665ce5b+8:15695:x1875455669057024:12345-192.168.204.51@tcp:101:bash.0 Request processed in 208us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574393.416755:0:18574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 29 00000100:00100000:2.0:1788574393.417601:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669057280 00000100:00100000:2.0:1788574393.417610:0:17070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669057280 00000100:00100000:2.0:1788574393.417658:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 13 00000100:00100000:2.0:1788574393.417667:0:17070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa32ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:74bce780-6a9f-42e0-9637-fe6b1665ce5b+18:15696:x1875455669057280:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788574393.417927:0:17070:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788574393.417957:0:17070:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00010000:00010000:2.0:1788574393.417984:0:17070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217f200/0x5bf8706fdac8d8c1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574393.417999:0:17070:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217f200/0x5bf8706fdac8d8c1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574393.418009:0:17070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217f200/0x5bf8706fdac8d8c1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574393.418031:0:17070:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217f200/0x5bf8706fdac8d8c1 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574393.418052:0:17070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217f200/0x5bf8706fdac8d8c1 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574393.418059:0:17070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217f200/0x5bf8706fdac8d8c1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574393.418080:0:17070:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788574393.418146:0:17070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa32ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:74bce780-6a9f-42e0-9637-fe6b1665ce5b+20:15696:x1875455669057280:12345-192.168.204.51@tcp:35:lhsmtool_posix.0 Request processed in 480us (1824us total) trans 8589934630 rc 0/0 00000100:00100000:2.0:1788574393.418153:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 13 00000020:00080000:2.0:1788574393.418158:0:17070:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788574393.419143:0:17055:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788574393.419154:0:17055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217f200/0x5bf8706fdac8d8c1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574393.419164:0:17055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c860217f200 already unused, calling callback (ffffffffc0e8a4f0) 00010000:00010000:3.0:1788574393.419177:0:17055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217f200/0x5bf8706fdac8d8c1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574393.419221:0:17055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217f200/0x5bf8706fdac8d8c1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574393.419246:0:17055:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c85d10a6100) 00010000:00010000:3.0:1788574393.419249:0:17055:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788574393.419253:0:17055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217f200/0x5bf8706fdac8d8c1 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574393.419258:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217f200/0x5bf8706fdac8d8c1 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17070 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788574393.419275:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574393.419276:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788574393.419278:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574393.425333:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:0.0:1788574393.425920:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669057408 00000100:00100000:0.0:1788574393.425943:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669057408 00000100:00100000:0.0:1788574393.426014:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 71 00000100:00100000:0.0:1788574393.426025:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c26bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74bce780-6a9f-42e0-9637-fe6b1665ce5b+20:15695:x1875455669057408:12345-192.168.204.51@tcp:101:bash.0 00010000:00010000:0.0:1788574393.426051:0:17069:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788574393.426071:0:17069:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7600/0x5bf8706fdac8d8c8 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6d0c expref: -99 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.426106:0:17069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6c00/0x5bf8706fdac8d8cf lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.426120:0:17069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6c00/0x5bf8706fdac8d8cf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.426133:0:17069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6c00/0x5bf8706fdac8d8cf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.426805:0:17069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d7600/0x5bf8706fdac8d8c8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6d0c expref: 22 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.426828:0:17069:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85d20d6c00/0x5bf8706fdac8d8cf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6d0c expref: 21 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788574393.426839:0:17069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c85d10a6300) 00010000:00010000:0.0:1788574393.426842:0:17069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788574393.426845:0:17069:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85d20d6c00, rc 0) 00000100:00100000:0.0:1788574393.426912:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c26bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74bce780-6a9f-42e0-9637-fe6b1665ce5b+21:15695:x1875455669057408:12345-192.168.204.51@tcp:101:bash.0 Request processed in 889us (1589us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574393.426920:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 71 00000100:00100000:2.0:1788574393.437329:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574393.437863:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669057664 00000100:00100000:3.0:1788574393.437875:0:17070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669057664 00000100:00100000:3.0:1788574393.438002:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 14 00000100:00100000:3.0:1788574393.438014:0:17070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c26b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:74bce780-6a9f-42e0-9637-fe6b1665ce5b+21:15695:x1875455669057664:12345-192.168.204.51@tcp:35:bash.0 00000001:00080000:3.0:1788574393.438396:0:17070:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934631 00000100:00100000:3.0:1788574393.438515:0:17070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c26b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:74bce780-6a9f-42e0-9637-fe6b1665ce5b+23:15695:x1875455669057664:12345-192.168.204.51@tcp:35:bash.0 Request processed in 503us (1195us total) trans 8589934632 rc 0/0 00000100:00100000:3.0:1788574393.438524:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 14 00000020:00080000:3.0:1788574393.438530:0:17070:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788574393.522810:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574393.522908:0:17068:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669057920 00000100:00100000:3.0:1788574393.522919:0:17068:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669057920 00000100:00100000:3.0:1788574393.522989:0:17068:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 72 00000100:00100000:3.0:1788574393.522999:0:17068:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c26b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74bce780-6a9f-42e0-9637-fe6b1665ce5b+23:15706:x1875455669057920:12345-192.168.204.51@tcp:101:lfs.0 00010000:00010000:3.0:1788574393.523024:0:17068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788574393.523061:0:17068:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2a00/0x5bf8706fdac8d8d6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x652b547cf44d6d13 expref: -99 pid: 17068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788574393.523168:0:17068:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788574393.523624:0:17068:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2a00/0x5bf8706fdac8d8d6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6d13 expref: 25 pid: 17068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574393.523641:0:17068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c85cbaaf300) 00010000:00010000:2.0:1788574393.523644:0:17068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788574393.523649:0:17068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c85faea2a00/0x5bf8706fdac8d8d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.51@tcp remote: 0x652b547cf44d6d13 expref: 25 pid: 17068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574393.523666:0:17068:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c85faea2a00, rc 0) 00000100:00100000:2.0:1788574393.523781:0:17068:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c26b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:74bce780-6a9f-42e0-9637-fe6b1665ce5b+24:15706:x1875455669057920:12345-192.168.204.51@tcp:101:lfs.0 Request processed in 782us (981us total) trans 8589934633 rc 301/301 00000100:00100000:2.0:1788574393.523800:0:17068:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 72 00000100:00100000:0.0:1788574393.528262:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574393.529160:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669058048 00000100:00100000:2.0:1788574393.529174:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669058048 00000100:00100000:2.0:1788574393.532403:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 73 00000100:00100000:2.0:1788574393.532429:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601834380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74bce780-6a9f-42e0-9637-fe6b1665ce5b+24:15706:x1875455669058048:12345-192.168.204.51@tcp:34:lfs.0 00010000:00010000:2.0:1788574393.532582:0:17069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e200/0x5bf8706fdac8d8e4 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574393.532602:0:17069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e200/0x5bf8706fdac8d8e4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574393.532615:0:17069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e200/0x5bf8706fdac8d8e4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574393.532631:0:17069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e400/0x5bf8706fdac8d8eb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574393.532639:0:17069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e400/0x5bf8706fdac8d8eb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574393.532644:0:17069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e400/0x5bf8706fdac8d8eb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574393.532735:0:17069:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217f200/0x5bf8706fdac8d8f2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574393.532746:0:17069:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217f200/0x5bf8706fdac8d8f2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574393.532753:0:17069:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217f200/0x5bf8706fdac8d8f2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788574393.532819:0:17069:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217f200/0x5bf8706fdac8d8f2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574393.533566:0:17069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e200/0x5bf8706fdac8d8e4 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574393.533573:0:17069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e200/0x5bf8706fdac8d8e4 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574393.533580:0:17069:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e200/0x5bf8706fdac8d8e4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574393.533585:0:17069:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c860217e200 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:2.0:1788574393.533589:0:17069:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e200/0x5bf8706fdac8d8e4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574393.533597:0:17069:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e200/0x5bf8706fdac8d8e4 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574393.533610:0:17069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c85c4fa6200) 00010000:00010000:2.0:1788574393.533613:0:17069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788574393.533618:0:17069:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e200/0x5bf8706fdac8d8e4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574393.533624:0:17069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e200/0x5bf8706fdac8d8e4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574393.533636:0:17069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e400/0x5bf8706fdac8d8eb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574393.533642:0:17069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e400/0x5bf8706fdac8d8eb lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574393.533657:0:17069:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e400/0x5bf8706fdac8d8eb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574393.533661:0:17069:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c860217e400 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:2.0:1788574393.533665:0:17069:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e400/0x5bf8706fdac8d8eb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574393.533670:0:17069:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e400/0x5bf8706fdac8d8eb lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574393.533679:0:17069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9c85c4fa6c00) 00010000:00010000:2.0:1788574393.533681:0:17069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788574393.533684:0:17069:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e400/0x5bf8706fdac8d8eb lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574393.533690:0:17069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217e400/0x5bf8706fdac8d8eb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574393.533705:0:17069:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217f200/0x5bf8706fdac8d8f2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574393.533711:0:17069:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217f200/0x5bf8706fdac8d8f2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574393.533717:0:17069:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217f200/0x5bf8706fdac8d8f2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574393.533722:0:17069:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c860217f200 already unused, calling callback (ffffffffc1a834f0) 00010000:00010000:2.0:1788574393.533725:0:17069:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217f200/0x5bf8706fdac8d8f2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574393.533742:0:17069:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217f200/0x5bf8706fdac8d8f2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574393.533750:0:17069:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c85d10a6300) 00010000:00010000:2.0:1788574393.533753:0:17069:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788574393.533756:0:17069:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217f200/0x5bf8706fdac8d8f2 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788574393.533761:0:17069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c860217f200/0x5bf8706fdac8d8f2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17069 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788574393.534902:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601834380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:74bce780-6a9f-42e0-9637-fe6b1665ce5b+24:15706:x1875455669058048:12345-192.168.204.51@tcp:34:lfs.0 Request processed in 2466us (6631us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574393.534916:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 73 00000100:00100000:0.0:1788574393.542732:0:3611:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574393.543388:0:17071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669058304 00000100:00100000:1.0:1788574393.543400:0:17071:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669058304 00000100:00100000:1.0:1788574393.543461:0:17071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 15 00000100:00100000:1.0:1788574393.543471:0:17071:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c36dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74bce780-6a9f-42e0-9637-fe6b1665ce5b+24:15706:x1875455669058304:12345-192.168.204.51@tcp:35:lfs.0 00000100:00100000:1.0:1788574393.544271:0:17071:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c36dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:74bce780-6a9f-42e0-9637-fe6b1665ce5b+25:15706:x1875455669058304:12345-192.168.204.51@tcp:35:lfs.0 Request processed in 797us (1544us total) trans 8589934634 rc 0/0 00000100:00100000:1.0:1788574393.544281:0:17071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 15 00010000:00010000:2.0:1788574393.811534:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788574394.003439:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788574394.009628:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c26b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681718912:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788574394.009719:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574394.010859:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681718912 00000100:00100000:1.0:1788574394.010873:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681718912 00000100:00100000:1.0:1788574394.010964:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788574394.010975:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffaff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681718912:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788574394.011011:0:18576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00080000:2.0:1788574394.011152:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788574394.011301:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffaff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681718912:12345-0@lo:13:osp-pre-0-1.0 Request processed in 327us (1580us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574394.011310:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788574394.012392:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c26b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681718912:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788574394.837264:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788574394.958005:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574394.958058:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574394.958087:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574394.958126:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574394.958145:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574394.958162:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574394.958180:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574394.958227:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574394.958253:0:3610:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:1.0:1788574394.958279:0:18898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669058688 00000100:00100000:1.0:1788574394.958287:0:18898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669058688 00000100:00100000:1.0:1788574394.958354:0:18898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669059200 00000100:00100000:1.0:1788574394.958357:0:18898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669059200 00000100:00100000:1.0:1788574394.958372:0:18898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669058560 00000100:00100000:1.0:1788574394.958375:0:18898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669058560 00000100:00100000:1.0:1788574394.958385:0:18898:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669059072 00000100:00100000:1.0:1788574394.958387:0:18898:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669059072 00000100:00100000:1.0:1788574394.958404:0:18898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 64 00000100:00100000:1.0:1788574394.958413:0:18898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa32b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74bce780-6a9f-42e0-9637-fe6b1665ce5b+5:2395:x1875455669058688:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788574394.958484:0:18898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa32b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74bce780-6a9f-42e0-9637-fe6b1665ce5b+5:2395:x1875455669058688:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 72us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574394.958491:0:18898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 64 00000100:00100000:1.0:1788574394.958509:0:18898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 65 00000100:00100000:1.0:1788574394.958515:0:18898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa32b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:408a814b-bde8-48f8-9467-4baee1a765d4+5:2395:x1875455669059200:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788574394.958538:0:18898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa32b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:408a814b-bde8-48f8-9467-4baee1a765d4+5:2395:x1875455669059200:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 24us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574394.958544:0:18898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 65 00000100:00100000:1.0:1788574394.958556:0:18898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 66 00000100:00100000:1.0:1788574394.958561:0:18898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa32bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74bce780-6a9f-42e0-9637-fe6b1665ce5b+25:2395:x1875455669058560:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788574394.958588:0:18898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa32bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:74bce780-6a9f-42e0-9637-fe6b1665ce5b+25:2395:x1875455669058560:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 26us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574394.958602:0:18898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 66 00000100:00100000:1.0:1788574394.958615:0:18898:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 67 00000100:00100000:1.0:1788574394.958621:0:18898:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa329c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:408a814b-bde8-48f8-9467-4baee1a765d4+6:2395:x1875455669059072:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788574394.958652:0:18898:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa329c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:408a814b-bde8-48f8-9467-4baee1a765d4+6:2395:x1875455669059072:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 31us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574394.958658:0:18898:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 67 00000100:00100000:1.0:1788574394.958675:0:18573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669058944 00000100:00100000:1.0:1788574394.958679:0:18573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669058944 00000100:00100000:1.0:1788574394.958694:0:18573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669059456 00000100:00100000:1.0:1788574394.958697:0:18573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669059456 00000100:00100000:1.0:1788574394.958709:0:18573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669058816 00000100:00100000:1.0:1788574394.958712:0:18573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669058816 00000100:00100000:1.0:1788574394.958722:0:18573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669059328 00000100:00100000:1.0:1788574394.958725:0:18573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669059328 00000100:00100000:1.0:1788574394.958736:0:18573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 25 00000100:00100000:1.0:1788574394.958741:0:18573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa32b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:74bce780-6a9f-42e0-9637-fe6b1665ce5b+8:2395:x1875455669058944:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788574394.958765:0:18573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa32b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:74bce780-6a9f-42e0-9637-fe6b1665ce5b+8:2395:x1875455669058944:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 24us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574394.958771:0:18573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 25 00000100:00100000:1.0:1788574394.958781:0:18573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 26 00000100:00100000:1.0:1788574394.958787:0:18573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa329180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:408a814b-bde8-48f8-9467-4baee1a765d4+5:2395:x1875455669059456:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788574394.958805:0:18573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa329180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:408a814b-bde8-48f8-9467-4baee1a765d4+5:2395:x1875455669059456:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 19us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574394.958811:0:18573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 26 00000100:00100000:1.0:1788574394.958820:0:18573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 27 00000100:00100000:1.0:1788574394.958833:0:18573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa328000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:74bce780-6a9f-42e0-9637-fe6b1665ce5b+5:2395:x1875455669058816:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788574394.958858:0:18573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa328000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:74bce780-6a9f-42e0-9637-fe6b1665ce5b+5:2395:x1875455669058816:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 27us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574394.958864:0:18573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 27 00000100:00100000:1.0:1788574394.958874:0:18573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 28 00000100:00100000:1.0:1788574394.958879:0:18573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa32a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:408a814b-bde8-48f8-9467-4baee1a765d4+5:2395:x1875455669059328:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:1.0:1788574394.958897:0:18573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa32a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:408a814b-bde8-48f8-9467-4baee1a765d4+5:2395:x1875455669059328:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 18us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574394.958902:0:18573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 28 00000100:00080000:1.0:1788574394.958935:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788574394.958939:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788574394.958941:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788574394.958943:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788574394.959527:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669058432 00000100:00100000:3.0:1788574394.959534:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669058432 00000100:00100000:3.0:1788574394.959576:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 168 00000100:00100000:3.0:1788574394.959583:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601806450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1980da70-ec0a-4d33-8959-8ff61c9350d5+13:2395:x1875455669058432:12345-192.168.204.51@tcp:400:kworker.0 00000100:00100000:3.0:1788574394.959615:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601806450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1980da70-ec0a-4d33-8959-8ff61c9350d5+13:2395:x1875455669058432:12345-192.168.204.51@tcp:400:kworker.0 Request processed in 33us (1621us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574394.959621:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 168 00000001:02000400:0.0:1788574395.239683:0:20241:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: /mnt/lustre/d1c.sanity-pcc/f1c.sanity-pcc expected pcc state: readwrite, but got: none 00000100:00100000:0.0:1788574395.539510:0:3617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85f6666a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681719040:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788574395.539585:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574395.539861:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681719040 00000100:00100000:3.0:1788574395.539870:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681719040 00000100:00100000:3.0:1788574395.539927:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788574395.539936:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffafe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681719040:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788574395.539971:0:17073:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:3.0:1788574395.540124:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffafe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875455681719040:12345-0@lo:41:osp-pre-0-1.0 Request processed in 182us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574395.540133:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788574395.540224:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c26b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681719168:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788574395.540255:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788574395.540361:0:17072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681719168 00000100:00100000:2.0:1788574395.540367:0:17072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681719168 00000100:00100000:2.0:1788574395.540452:0:17072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788574395.540461:0:17072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffafea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681719168:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788574395.540483:0:17072:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788574395.540530:0:17072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffafea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681719168:12345-0@lo:41:osp-pre-1-0.0 Request processed in 71us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574395.540537:0:17072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788574395.540668:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c26b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681719168:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788574395.542947:0:3617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85f6666a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3617:1875455681719040:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788574395.862383:0:17056:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788574396.057230:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788574396.057256:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c26bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681719296:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788574396.057339:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788574396.060130:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681719296 00000100:00100000:3.0:1788574396.060146:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681719296 00000100:00100000:3.0:1788574396.060251:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788574396.060264:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c84c26b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681719296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788574396.060309:0:18576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00080000:2.0:1788574396.060487:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788574396.060544:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c26bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681719296:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788574396.060650:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c84c26b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1875455681719296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (3045us total) trans 0 rc 0/0 00000100:00100000:3.0:1788574396.060672:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000040:00080000:2.0:1788574396.436033:0:17820:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788574396.563848:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c85fa32aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681719424:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788574396.563949:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574396.564023:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681719424 00000100:00100000:1.0:1788574396.564032:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681719424 00000100:00100000:1.0:1788574396.564100:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788574396.564112:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa329880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3620:x1875455681719424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788574396.564150:0:18576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788574396.564234:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa329880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3620:x1875455681719424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574396.564243:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:1.0:1788574396.564269:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788574396.564341:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c85fa32aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3620:1875455681719424:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788574396.565278:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c26b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681719680:0@lo:400:kworker.0 00000100:00100000:0.0:1788574396.565351:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574396.565381:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c26b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681720192:0@lo:400:kworker.0 00000100:00100000:0.0:1788574396.565405:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574396.565429:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788574396.565435:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c26bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f73678fb-d8c0-450f-a73b-e6565942045e:3618:1875455681719552:0@lo:400:kworker.0 00000100:00100000:0.0:1788574396.565462:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574396.565494:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c26b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681720064:0@lo:400:kworker.0 00000100:00100000:0.0:1788574396.565514:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574396.565863:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681719680 00000100:00100000:0.0:1788574396.565871:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681719680 00000100:00100000:0.0:1788574396.565925:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788574396.565934:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffafce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681719680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574396.565999:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffafce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1875455681719680:12345-0@lo:400:kworker.0 Request processed in 65us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574396.566006:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788574396.566052:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c26b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3618:1875455681719680:0@lo:400:kworker.0 00000100:00100000:0.0:1788574396.566299:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c26b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3618:1875455681720704:0@lo:400:kworker.0 00000100:00100000:0.0:1788574396.566338:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574396.566361:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788574396.566366:0:3618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c26ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3618:1875455681720576:0@lo:400:kworker.0 00000100:00100000:0.0:1788574396.566388:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574396.566978:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c26baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875455681719808:0@lo:400:kworker.0 00000100:00100000:1.0:1788574396.567021:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574396.567054:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c26b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875455681720320:0@lo:400:kworker.0 00000100:00100000:1.0:1788574396.567076:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574396.567103:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c22fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1875455681720832:0@lo:400:kworker.0 00000100:00100000:1.0:1788574396.567126:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574396.567141:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788574396.567148:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c26bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681719936:0@lo:400:kworker.0 00000100:00100000:1.0:1788574396.567174:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788574396.567327:0:17067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681720704 00000100:00100000:0.0:1788574396.567335:0:17067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681720704 00000100:00100000:0.0:1788574396.567391:0:17067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681720576 00000100:00100000:0.0:1788574396.567394:0:17067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681720576 00000100:00100000:0.0:1788574396.567427:0:17067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681719808 00000100:00100000:0.0:1788574396.567430:0:17067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681719808 00000100:00100000:0.0:1788574396.567445:0:17067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681720320 00000100:00100000:0.0:1788574396.567448:0:17067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681720320 00000100:00100000:0.0:1788574396.567481:0:17067:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681720832 00000100:00100000:0.0:1788574396.567484:0:17067:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681720832 00000100:00100000:0.0:1788574396.567501:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788574396.567508:0:17067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffafe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875455681720704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574396.567565:0:17067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffafe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3618:x1875455681720704:12345-0@lo:400:kworker.0 Request processed in 58us (1227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574396.567573:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788574396.567593:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788574396.567599:0:17067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffafd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875455681720576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574396.567727:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c26bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3619:1875455681720448:0@lo:400:kworker.0 00000100:00100000:1.0:1788574396.567754:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574396.567765:0:3619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c84c22fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681720960:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788574396.567930:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788574396.567978:0:18573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681720192 00000100:00100000:1.0:1788574396.567983:0:18573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681720192 00000100:00100000:1.0:1788574396.568018:0:18573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681720064 00000100:00100000:1.0:1788574396.568022:0:18573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681720064 00000100:00100000:1.0:1788574396.568045:0:18573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788574396.568052:0:18573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffaffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681720192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574396.568089:0:18573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffaffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681720192:12345-0@lo:400:kworker.0 Request processed in 38us (2682us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574396.568096:0:18573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788574396.568112:0:18573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788574396.568117:0:18573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85ffafca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681720064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574396.568159:0:18573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffafca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1875455681720064:12345-0@lo:400:kworker.0 Request processed in 42us (2643us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574396.568166:0:18573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788574396.568321:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681720448 00000100:00100000:2.0:1788574396.568327:0:17069:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681720448 00000100:00100000:2.0:1788574396.568356:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788574396.568363:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa32aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875455681719808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574396.568461:0:17067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85ffafd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1875455681720576:12345-0@lo:400:kworker.0 Request processed in 861us (2071us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574396.568469:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788574396.568489:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788574396.568497:0:17067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa329500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875455681720320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788574396.573409:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa32aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3619:x1875455681719808:12345-0@lo:400:kworker.0 Request processed in 5030us (6370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574396.573431:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788574396.573485:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788574396.573501:0:17069:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa328a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875455681720832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574396.576152:0:17067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa329500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3619:x1875455681720320:12345-0@lo:400:kworker.0 Request processed in 7643us (9060us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574396.576171:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788574396.576261:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788574396.576291:0:17067:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa328700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875455681720448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788574396.576379:0:17067:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa328700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3619:x1875455681720448:12345-0@lo:400:kworker.0 Request processed in 110us (8624us total) trans 0 rc 0/0 00000100:00100000:0.0:1788574396.576385:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:0.0:1788574396.576452:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c26ba300 x1875455681720576/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574412 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788574396.576482:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c26ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3618:1875455681720576:0@lo:400:kworker.0 00000100:00100000:0.0:1788574396.576503:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c26b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3618:1875455681720704:0@lo:400:kworker.0 00000100:00100000:0.0:1788574396.576519:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c26b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681720064:0@lo:400:kworker.0 00000100:00100000:0.0:1788574396.576532:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c26b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3618:1875455681720192:0@lo:400:kworker.0 00000100:00100000:1.0:1788574396.576915:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681719552 00000100:00100000:1.0:1788574396.576925:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681719552 00000100:00100000:1.0:1788574396.576996:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788574396.577005:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c8601804850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f73678fb-d8c0-450f-a73b-e6565942045e+24:3618:x1875455681719552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574396.577068:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c8601804850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f73678fb-d8c0-450f-a73b-e6565942045e+24:3618:x1875455681719552:12345-0@lo:400:kworker.0 Request processed in 65us (11603us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574396.577075:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00080000:1.0:1788574396.577697:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788574396.577706:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788574396.577711:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788574396.577714:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788574396.577733:0:17072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681719936 00000100:00100000:1.0:1788574396.577740:0:17072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681719936 00000100:00100000:1.0:1788574396.578350:0:17072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788574396.578363:0:17072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa328e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681719936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788574396.578454:0:17072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa328e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681719936:12345-0@lo:400:kworker.0 Request processed in 95us (11279us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574396.578468:0:17072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788574396.578564:0:17069:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa328a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1875455681720832:12345-0@lo:400:kworker.0 Request processed in 5067us (11433us total) trans 0 rc 0/0 00000100:00100000:2.0:1788574396.578575:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788574396.578933:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455681720960 00000100:00100000:1.0:1788574396.578942:0:18576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455681720960 00000100:00100000:1.0:1788574396.579028:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788574396.579036:0:18576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85fa329f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681720960:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788574396.579058:0:18576:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788574396.579105:0:18576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85fa329f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1875455681720960:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (11174us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574396.579128:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788574396.579722:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c26bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681719936:0@lo:400:kworker.0 00000100:00100000:1.0:1788574396.579743:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c26bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3619:1875455681720448:0@lo:400:kworker.0 00000100:00100000:1.0:1788574396.579764:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c22fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3619:1875455681720960:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788574396.579926:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c26baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3619:1875455681719808:0@lo:400:kworker.0 00000100:00100000:1.0:1788574396.579940:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c26b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3619:1875455681720320:0@lo:400:kworker.0 00010000:00080000:1.0:1788574396.579957:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9c84c22fa680 x1875455681720832/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788574412 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788574396.579967:0:3619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c22fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3619:1875455681720832:0@lo:400:kworker.0 00000100:00100000:1.0:1788574396.580041:0:3618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c84c26bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f73678fb-d8c0-450f-a73b-e6565942045e:3618:1875455681719552:0@lo:400:kworker.0 00010000:00010000:3.0:1788574396.889264:0:17055:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788574397.011808:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:3.0:1788574397.011878:0:3612:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.51@tcp (source: 12345-192.168.204.51@tcp) 00000100:00100000:2.0:1788574397.011931:0:18573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669059712 00000100:00100000:2.0:1788574397.011947:0:18573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669059712 00000100:00080000:3.0:1788574397.012054:0:17063:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788574397.012062:0:18573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 30 00000100:00100000:2.0:1788574397.012078:0:18573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f6664e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:74bce780-6a9f-42e0-9637-fe6b1665ce5b+8:2396:x1875455669059712:12345-192.168.204.51@tcp:16:kworker.0 00000100:00100000:0.0:1788574397.012238:0:18577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875455669059584 00000100:00100000:0.0:1788574397.012244:0:18577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875455669059584 00002000:00100000:0.0:1788574397.012284:0:18577:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x22:0x0] (0->8) req@ffff9c85f6664a80 x1875455669059584/t0(0) o4->74bce780-6a9f-42e0-9637-fe6b1665ce5b@192.168.204.51@tcp:548/0 lens 504/0 e 0 to 0 dl 1788574408 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:0.0:1788574397.012296:0:18577:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c85f6664a80 with x1875455669059584 ext(0->8) 00002000:00010000:0.0:1788574397.012303:0:18577:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c85f6664a80 00000100:00100000:0.0:1788574397.012324:0:18577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.51@tcp, seq: 0 00000100:00100000:0.0:1788574397.012331:0:18577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c85f6664a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:74bce780-6a9f-42e0-9637-fe6b1665ce5b+9:2396:x1875455669059584:12345-192.168.204.51@tcp:4:bash.0 00000100:00100000:3.0:1788574397.018968:0:18577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f6664a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:74bce780-6a9f-42e0-9637-fe6b1665ce5b+11:2396:x1875455669059584:12345-192.168.204.51@tcp:4:bash.0 Request processed in 6618us (7153us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1788574397.018996:0:18577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 0 00002000:00100000:3.0:1788574397.019014:0:18577:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x22:0x0] (0->8) req@ffff9c85f6664a80 x1875455669059584/t8589934599(0) o4->74bce780-6a9f-42e0-9637-fe6b1665ce5b@192.168.204.51@tcp:548/0 lens 504/448 e 0 to 0 dl 1788574408 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:3.0:1788574397.019025:0:18577:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c85f6664a80 with x1875455669059584 ext(0->8) 00002000:00010000:3.0:1788574397.019035:0:18577:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c85f6664a80 00000001:00080000:2.0:1788574397.024947:0:19386:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:2.0:1788574397.024972:0:19386:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00000100:00100000:1.0:1788574397.025394:0:18573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c85f6664e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:74bce780-6a9f-42e0-9637-fe6b1665ce5b+6:2396:x1875455669059712:12345-192.168.204.51@tcp:16:kworker.0 Request processed in 13312us (13506us total) trans 0 rc 0/0 00000100:00100000:1.0:1788574397.025410:0:18573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.51@tcp, seq: 30 Debug log: 43779 lines, 43779 kept, 0 dropped, 0 bad.